2026-03-28 14:00:09 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 14:00:09 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 14:00:09 [auto1.es] INFO: Batch mode enabled: batch 1/2
2026-03-28 14:00:09 [auto1.es] INFO: Starting spider auto1.es
2026-03-28 14:00:09 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 14:00:09 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 14:00:09 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 14:00:09 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 14:00:09 [scrapy.extensions.telnet] INFO: Telnet Password: 913f02d6738cc17b
2026-03-28 14:00:10 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 14:00:10 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.es/task_21_2026-03-28T14_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 14:00:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 14:00:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 14:00:10 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 14:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 14:00:10 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 14:00:10 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-28 14:00:10 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:10 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 14:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 14:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 14:00:10 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 14:00:10 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 14:00:10 [scrapy.core.engine] INFO: Spider opened
2026-03-28 14:00:10 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 14:00:10 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-28 14:00:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-28 14:00:10 [scrapy-playwright] INFO: Starting download handler
2026-03-28 14:00:10 [scrapy-playwright] INFO: Starting download handler
2026-03-28 14:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 14:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 14:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 14:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 14:00:20 [auto1.es] INFO: Channel: 24h | Page: 0 | totalHits: 2695 | hits on page: 40
2026-03-28 14:00:20 [auto1.es] INFO: Found listing with ID: TZ01977
2026-03-28 14:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ01977%27 HTTP/1.1" 200 None
2026-03-28 14:00:20 [auto1.es] INFO: Scrape type for TZ01977: 1
2026-03-28 14:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:20 [auto1.es] INFO: Found listing with ID: GW37320
2026-03-28 14:00:20 [auto1.es] INFO: Found listing with ID: GG74961
2026-03-28 14:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG74961%27 HTTP/1.1" 200 None
2026-03-28 14:00:20 [auto1.es] INFO: Scrape type for GG74961: 2
2026-03-28 14:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cb97035-7e4c-53d2-aea6-96638969a30b with identifier: GG74961
2026-03-28 14:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cb97035-7e4c-53d2-aea6-96638969a30b with scrape type 2
2026-03-28 14:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cb97035-7e4c-53d2-aea6-96638969a30b with scrape type 2
2026-03-28 14:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1cb97035-7e4c-53d2-aea6-96638969a30b, identifier: GG74961
2026-03-28 14:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1cb97035-7e4c-53d2-aea6-96638969a30b with identifier: GG74961
2026-03-28 14:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 14:00:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 14:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1cb97035-7e4c-53d2-aea6-96638969a30b with identifier: GG74961
2026-03-28 14:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1cb97035-7e4c-53d2-aea6-96638969a30b with identifier: GG74961 to the API
2026-03-28 14:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:49Z',
 'fuel_type': 'diesel',
 'id': '1cb97035-7e4c-53d2-aea6-96638969a30b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG74961',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 91575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Advance BlueMotion',
 'transmission': 'automatic',
 'trim': 'Advance BlueMotion',
 'year': 2017}
2026-03-28 14:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG74961%27 HTTP/1.1" 200 None
2026-03-28 14:00:21 [auto1.es] INFO: Saving data for GG74961: {'auction_closing_time': 1774883089.0, 'created_time': 1774101730.728922, 'last_price_update_time': 1774706421.504387}
2026-03-28 14:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GG74961') HTTP/1.1" 204 0
2026-03-28 14:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:21 [auto1.es] INFO: Found listing with ID: XW94395
2026-03-28 14:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW94395%27 HTTP/1.1" 200 None
2026-03-28 14:00:21 [auto1.es] INFO: Scrape type for XW94395: 2
2026-03-28 14:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebafa893-f5d7-5c65-9f8d-35b704ffcf83 with identifier: XW94395
2026-03-28 14:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83 with scrape type 2
2026-03-28 14:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebafa893-f5d7-5c65-9f8d-35b704ffcf83 with scrape type 2
2026-03-28 14:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ebafa893-f5d7-5c65-9f8d-35b704ffcf83, identifier: XW94395
2026-03-28 14:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ebafa893-f5d7-5c65-9f8d-35b704ffcf83 with identifier: XW94395
2026-03-28 14:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 14:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ebafa893-f5d7-5c65-9f8d-35b704ffcf83 with identifier: XW94395
2026-03-28 14:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ebafa893-f5d7-5c65-9f8d-35b704ffcf83 with identifier: XW94395 to the API
2026-03-28 14:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:47Z',
 'fuel_type': 'diesel',
 'id': 'ebafa893-f5d7-5c65-9f8d-35b704ffcf83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW94395',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 62376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-22',
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW94395%27 HTTP/1.1" 200 None
2026-03-28 14:00:24 [auto1.es] INFO: Saving data for XW94395: {'auction_closing_time': 1774885127.0, 'created_time': 1772749215.229515, 'last_price_update_time': 1774706424.016546}
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XW94395') HTTP/1.1" 204 0
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: PK32914
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: GW88114
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: RH91028
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: LZ33351
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: TR19943
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: JS77996
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: NH39190
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: ZE40352
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: CC76703
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: ES07988
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES07988%27 HTTP/1.1" 200 None
2026-03-28 14:00:24 [auto1.es] INFO: Scrape type for ES07988: 1
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: HY65431
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: RB15615
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB15615%27 HTTP/1.1" 200 None
2026-03-28 14:00:24 [auto1.es] INFO: Scrape type for RB15615: 1
2026-03-28 14:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: VZ79262
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ79262%27 HTTP/1.1" 200 None
2026-03-28 14:00:24 [auto1.es] INFO: Scrape type for VZ79262: 2
2026-03-28 14:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6261e719-0f4c-5239-998d-aa4ad793fe8e with identifier: VZ79262
2026-03-28 14:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6261e719-0f4c-5239-998d-aa4ad793fe8e with scrape type 2
2026-03-28 14:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6261e719-0f4c-5239-998d-aa4ad793fe8e with scrape type 2
2026-03-28 14:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6261e719-0f4c-5239-998d-aa4ad793fe8e, identifier: VZ79262
2026-03-28 14:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6261e719-0f4c-5239-998d-aa4ad793fe8e with identifier: VZ79262
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 14:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6261e719-0f4c-5239-998d-aa4ad793fe8e with identifier: VZ79262
2026-03-28 14:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6261e719-0f4c-5239-998d-aa4ad793fe8e with identifier: VZ79262 to the API
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:21:44Z',
 'fuel_type': 'diesel',
 'id': '6261e719-0f4c-5239-998d-aa4ad793fe8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ79262',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 224227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-03',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Emotion',
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2007}
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ79262%27 HTTP/1.1" 200 None
2026-03-28 14:00:24 [auto1.es] INFO: Saving data for VZ79262: {'auction_closing_time': 1774884104.0, 'created_time': 1773399858.684413, 'last_price_update_time': 1774706424.788882}
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VZ79262') HTTP/1.1" 204 0
2026-03-28 14:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: HA87935
2026-03-28 14:00:24 [auto1.es] INFO: Found listing with ID: XC96716
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC96716%27 HTTP/1.1" 200 None
2026-03-28 14:00:24 [auto1.es] INFO: Scrape type for XC96716: 2
2026-03-28 14:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff7d22b-d8a1-502e-b20d-01dc6ffb2736 with identifier: XC96716
2026-03-28 14:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff7d22b-d8a1-502e-b20d-01dc6ffb2736 with scrape type 2
2026-03-28 14:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff7d22b-d8a1-502e-b20d-01dc6ffb2736 with scrape type 2
2026-03-28 14:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dff7d22b-d8a1-502e-b20d-01dc6ffb2736, identifier: XC96716
2026-03-28 14:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dff7d22b-d8a1-502e-b20d-01dc6ffb2736 with identifier: XC96716
2026-03-28 14:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 14:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dff7d22b-d8a1-502e-b20d-01dc6ffb2736 with identifier: XC96716
2026-03-28 14:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dff7d22b-d8a1-502e-b20d-01dc6ffb2736 with identifier: XC96716 to the API
2026-03-28 14:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:44:32Z',
 'fuel_type': 'diesel',
 'id': 'dff7d22b-d8a1-502e-b20d-01dc6ffb2736',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC96716',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 178982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-03',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2012}
2026-03-28 14:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC96716%27 HTTP/1.1" 200 None
2026-03-28 14:00:25 [auto1.es] INFO: Saving data for XC96716: {'auction_closing_time': 1774885472.0, 'created_time': 1773399745.373876, 'last_price_update_time': 1774706425.642311}
2026-03-28 14:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XC96716') HTTP/1.1" 204 0
2026-03-28 14:00:25 [auto1.es] INFO: Found listing with ID: VC74313
2026-03-28 14:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC74313%27 HTTP/1.1" 200 None
2026-03-28 14:00:25 [auto1.es] INFO: Scrape type for VC74313: 2
2026-03-28 14:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97fac3da-4da9-5729-97a5-ccc85c1ffaa1 with identifier: VC74313
2026-03-28 14:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97fac3da-4da9-5729-97a5-ccc85c1ffaa1 with scrape type 2
2026-03-28 14:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97fac3da-4da9-5729-97a5-ccc85c1ffaa1 with scrape type 2
2026-03-28 14:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 97fac3da-4da9-5729-97a5-ccc85c1ffaa1, identifier: VC74313
2026-03-28 14:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 97fac3da-4da9-5729-97a5-ccc85c1ffaa1 with identifier: VC74313
2026-03-28 14:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 97fac3da-4da9-5729-97a5-ccc85c1ffaa1 with identifier: VC74313
2026-03-28 14:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 97fac3da-4da9-5729-97a5-ccc85c1ffaa1 with identifier: VC74313 to the API
2026-03-28 14:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:11:25Z',
 'fuel_type': 'diesel',
 'id': '97fac3da-4da9-5729-97a5-ccc85c1ffaa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC74313',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 84788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-25',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2015}
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC74313%27 HTTP/1.1" 200 None
2026-03-28 14:00:27 [auto1.es] INFO: Saving data for VC74313: {'auction_closing_time': 1774883485.0, 'created_time': 1774036831.318271, 'last_price_update_time': 1774706427.023185}
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VC74313') HTTP/1.1" 204 0
2026-03-28 14:00:27 [auto1.es] INFO: Found listing with ID: RG03753
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG03753%27 HTTP/1.1" 200 None
2026-03-28 14:00:27 [auto1.es] INFO: Scrape type for RG03753: 2
2026-03-28 14:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d94fc7ec-4bf9-5f70-bdf4-08bc0153b6fa with identifier: RG03753
2026-03-28 14:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d94fc7ec-4bf9-5f70-bdf4-08bc0153b6fa with scrape type 2
2026-03-28 14:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d94fc7ec-4bf9-5f70-bdf4-08bc0153b6fa with scrape type 2
2026-03-28 14:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d94fc7ec-4bf9-5f70-bdf4-08bc0153b6fa, identifier: RG03753
2026-03-28 14:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d94fc7ec-4bf9-5f70-bdf4-08bc0153b6fa with identifier: RG03753
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 14:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d94fc7ec-4bf9-5f70-bdf4-08bc0153b6fa with identifier: RG03753
2026-03-28 14:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d94fc7ec-4bf9-5f70-bdf4-08bc0153b6fa with identifier: RG03753 to the API
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:41:12Z',
 'fuel_type': 'petrol',
 'id': 'd94fc7ec-4bf9-5f70-bdf4-08bc0153b6fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG03753',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 82089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Concept",
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2021}
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG03753%27 HTTP/1.1" 200 None
2026-03-28 14:00:27 [auto1.es] INFO: Saving data for RG03753: {'auction_closing_time': 1774885272.0, 'created_time': 1772753360.456813, 'last_price_update_time': 1774706427.791192}
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RG03753') HTTP/1.1" 204 0
2026-03-28 14:00:27 [auto1.es] INFO: Found listing with ID: CN77625
2026-03-28 14:00:27 [auto1.es] INFO: Found listing with ID: XD32564
2026-03-28 14:00:27 [auto1.es] INFO: Found listing with ID: BB89966
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB89966%27 HTTP/1.1" 200 None
2026-03-28 14:00:27 [auto1.es] INFO: Scrape type for BB89966: 1
2026-03-28 14:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ01977/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:27 [auto1.es] INFO: Found listing with ID: EA80671
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA80671%27 HTTP/1.1" 200 None
2026-03-28 14:00:27 [auto1.es] INFO: Scrape type for EA80671: 1
2026-03-28 14:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:27 [auto1.es] INFO: Found listing with ID: YK19704
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK19704%27 HTTP/1.1" 200 None
2026-03-28 14:00:27 [auto1.es] INFO: Scrape type for YK19704: 1
2026-03-28 14:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:27 [auto1.es] INFO: Found listing with ID: AE50164
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE50164%27 HTTP/1.1" 200 None
2026-03-28 14:00:27 [auto1.es] INFO: Scrape type for AE50164: 2
2026-03-28 14:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fa7f036-b93b-5503-abca-ffead362345b with identifier: AE50164
2026-03-28 14:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa7f036-b93b-5503-abca-ffead362345b with scrape type 2
2026-03-28 14:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fa7f036-b93b-5503-abca-ffead362345b with scrape type 2
2026-03-28 14:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5fa7f036-b93b-5503-abca-ffead362345b, identifier: AE50164
2026-03-28 14:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5fa7f036-b93b-5503-abca-ffead362345b with identifier: AE50164
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 14:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5fa7f036-b93b-5503-abca-ffead362345b with identifier: AE50164
2026-03-28 14:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5fa7f036-b93b-5503-abca-ffead362345b with identifier: AE50164 to the API
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:30:06Z',
 'fuel_type': 'hybrid',
 'id': '5fa7f036-b93b-5503-abca-ffead362345b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE50164',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 153086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-30',
 'seller_name': None,
 'title': 'Audi A3 Sportback 40 e-tron sport',
 'transmission': 'automatic',
 'trim': 'sport',
 'year': 2020}
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE50164%27 HTTP/1.1" 200 None
2026-03-28 14:00:28 [auto1.es] INFO: Saving data for AE50164: {'auction_closing_time': 1774884606.0, 'created_time': 1773432167.627892, 'last_price_update_time': 1774706428.658935}
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AE50164') HTTP/1.1" 204 0
2026-03-28 14:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: RK07615
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK07615%27 HTTP/1.1" 200 None
2026-03-28 14:00:28 [auto1.es] INFO: Scrape type for RK07615: 1
2026-03-28 14:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB15615/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:28 [auto1.es] INFO: Channel: 24h | Page: 1 | totalHits: 2695 | hits on page: 40
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: UD30245
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: BX14033
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: FY68249
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: AA00980
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA00980%27 HTTP/1.1" 200 None
2026-03-28 14:00:28 [auto1.es] INFO: Scrape type for AA00980: 1
2026-03-28 14:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES07988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: TZ01977
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: HZ31017
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: KC96149
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: PJ13315
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ13315%27 HTTP/1.1" 200 None
2026-03-28 14:00:28 [auto1.es] INFO: Scrape type for PJ13315: 1
2026-03-28 14:00:28 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/TZ01977/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 14:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: GW37320
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: GG74961
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG74961%27 HTTP/1.1" 200 None
2026-03-28 14:00:28 [auto1.es] INFO: Scrape type for GG74961: 0
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: XW94395
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW94395%27 HTTP/1.1" 200 None
2026-03-28 14:00:28 [auto1.es] INFO: Scrape type for XW94395: 0
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: PK32914
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: GW88114
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: RH91028
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: LZ33351
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: TR19943
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: JS77996
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: NH39190
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: ZE40352
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: CC76703
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: ES07988
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: PL39404
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: VD65621
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: HG29658
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG29658%27 HTTP/1.1" 200 None
2026-03-28 14:00:28 [auto1.es] INFO: Scrape type for HG29658: 1
2026-03-28 14:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: HY65431
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: RB15615
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: VM52348
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM52348%27 HTTP/1.1" 200 None
2026-03-28 14:00:28 [auto1.es] INFO: Scrape type for VM52348: 1
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: VZ79262
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ79262%27 HTTP/1.1" 200 None
2026-03-28 14:00:28 [auto1.es] INFO: Scrape type for VZ79262: 0
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: HA87935
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: XC96716
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC96716%27 HTTP/1.1" 200 None
2026-03-28 14:00:28 [auto1.es] INFO: Scrape type for XC96716: 0
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: VC74313
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC74313%27 HTTP/1.1" 200 None
2026-03-28 14:00:28 [auto1.es] INFO: Scrape type for VC74313: 0
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: RG03753
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG03753%27 HTTP/1.1" 200 None
2026-03-28 14:00:28 [auto1.es] INFO: Scrape type for RG03753: 0
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: CN77625
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: XD32564
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: BB89966
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: JZ79034
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: EA80671
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: YK19704
2026-03-28 14:00:28 [auto1.es] INFO: Found listing with ID: AE50164
2026-03-28 14:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE50164%27 HTTP/1.1" 200 None
2026-03-28 14:00:29 [auto1.es] INFO: Scrape type for AE50164: 0
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: RK07615
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: UD30245
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: BX14033
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: FY68249
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: AA00980
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: HZ31017
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: KC96149
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: PJ13315
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: PL39404
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: VD65621
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: HG29658
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: VM52348
2026-03-28 14:00:29 [auto1.es] INFO: Found listing with ID: JZ79034
2026-03-28 14:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB89966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK19704/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA00980/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ13315/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ01977> (referer: https://www.auto1.com/v1/car-details-view/TZ01977/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:30 [auto1.es] INFO: Channel: 24h | Page: 2 | totalHits: 2695 | hits on page: 40
2026-03-28 14:00:30 [auto1.es] INFO: Found listing with ID: DD78517
2026-03-28 14:00:30 [auto1.es] INFO: Found listing with ID: BC82698
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC82698%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [auto1.es] INFO: Scrape type for BC82698: 1
2026-03-28 14:00:30 [auto1.es] INFO: Found listing with ID: ZV53496
2026-03-28 14:00:30 [auto1.es] INFO: Found listing with ID: ZX43091
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX43091%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [auto1.es] INFO: Scrape type for ZX43091: 1
2026-03-28 14:00:30 [auto1.es] INFO: Found listing with ID: UC73568
2026-03-28 14:00:30 [auto1.es] INFO: Found listing with ID: LN12503
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN12503%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [auto1.es] INFO: Scrape type for LN12503: 1
2026-03-28 14:00:30 [auto1.es] INFO: Found listing with ID: GV64854
2026-03-28 14:00:30 [auto1.es] INFO: Found listing with ID: KZ95264
2026-03-28 14:00:30 [auto1.es] INFO: Found listing with ID: GY48827
2026-03-28 14:00:30 [auto1.es] INFO: Found listing with ID: DA78268
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA78268%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [auto1.es] INFO: Scrape type for DA78268: 1
2026-03-28 14:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f032dd34-daaa-5e68-8bf7-462f88eb0d2f with identifier: TZ01977
2026-03-28 14:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f032dd34-daaa-5e68-8bf7-462f88eb0d2f with scrape type 1
2026-03-28 14:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f032dd34-daaa-5e68-8bf7-462f88eb0d2f
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fbb%252F08bb800ce4bf65c0ffb20dd211e7b489%252Fpa%252FTZ01977_902f7e647f278f1dac4d599f335995f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_902f7e647f278f1dac4d599f335995f9.jpg already downloaded
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fbb%252F08bb800ce4bf65c0ffb20dd211e7b489%252Fpa%252FTZ01977_ef51d4fb36d61bc0cf3923270be593f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_ef51d4fb36d61bc0cf3923270be593f7.jpg already downloaded
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fbb%252F08bb800ce4bf65c0ffb20dd211e7b489%252Fpa%252FTZ01977_f575d7fb0572ad211d76447dc1c97486.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_f575d7fb0572ad211d76447dc1c97486.jpg already downloaded
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fbb%252F08bb800ce4bf65c0ffb20dd211e7b489%252Fpa%252FTZ01977_ae5c35ee935219af4c612b8fd0ac4984.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_ae5c35ee935219af4c612b8fd0ac4984.jpg already downloaded
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fbb%252F08bb800ce4bf65c0ffb20dd211e7b489%252Fpa%252FTZ01977_e24371eb929183a00dd639b847ec7cf5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_e24371eb929183a00dd639b847ec7cf5.jpg already downloaded
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fbb%252F08bb800ce4bf65c0ffb20dd211e7b489%252Fpa%252FTZ01977_49e82c33a390f6cc6afe49250130e331.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_49e82c33a390f6cc6afe49250130e331.jpg already downloaded
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fbb%252F08bb800ce4bf65c0ffb20dd211e7b489%252Fpa%252FTZ01977_8f636fae3f5c05c5fa7f53cae73733f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_8f636fae3f5c05c5fa7f53cae73733f2.jpg already downloaded
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fbb%252F08bb800ce4bf65c0ffb20dd211e7b489%252Fpa%252FTZ01977_13c38d3e1736d0c60aa4434c0157f24a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_13c38d3e1736d0c60aa4434c0157f24a.jpg already downloaded
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fbb%252F08bb800ce4bf65c0ffb20dd211e7b489%252Fpa%252FTZ01977_47c3daceaf4e6fecd22d0b80cc0c10a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_47c3daceaf4e6fecd22d0b80cc0c10a4.jpg already downloaded
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fbb%252F08bb800ce4bf65c0ffb20dd211e7b489%252Fpa%252FTZ01977_0e0bf91f435b7a180597aca79422be19.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_0e0bf91f435b7a180597aca79422be19.jpg already downloaded
2026-03-28 14:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f032dd34-daaa-5e68-8bf7-462f88eb0d2f, identifier: TZ01977
2026-03-28 14:00:30 [auto1.es] INFO: Found listing with ID: UM67436
2026-03-28 14:00:30 [auto1.es] INFO: Found listing with ID: PZ10001
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ10001%27 HTTP/1.1" 200 None
2026-03-28 14:00:30 [auto1.es] INFO: Scrape type for PZ10001: 1
2026-03-28 14:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f032dd34-daaa-5e68-8bf7-462f88eb0d2f with identifier: TZ01977
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 14:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f032dd34-daaa-5e68-8bf7-462f88eb0d2f with identifier: TZ01977
2026-03-28 14:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f032dd34-daaa-5e68-8bf7-462f88eb0d2f with identifier: TZ01977 to the API
2026-03-28 14:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TZ01977>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:21:03Z',
 'fuel_type': 'petrol',
 'id': 'f032dd34-daaa-5e68-8bf7-462f88eb0d2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ01977',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 144947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_902f7e647f278f1dac4d599f335995f9.jpg',
                'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_ef51d4fb36d61bc0cf3923270be593f7.jpg',
                'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_f575d7fb0572ad211d76447dc1c97486.jpg',
                'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_ae5c35ee935219af4c612b8fd0ac4984.jpg',
                'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_e24371eb929183a00dd639b847ec7cf5.jpg',
                'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_49e82c33a390f6cc6afe49250130e331.jpg',
                'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_8f636fae3f5c05c5fa7f53cae73733f2.jpg',
                'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_13c38d3e1736d0c60aa4434c0157f24a.jpg',
                'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_47c3daceaf4e6fecd22d0b80cc0c10a4.jpg',
                'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_0e0bf91f435b7a180597aca79422be19.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f032dd34-daaa-5e68-8bf7-462f88eb0d2f/f032dd34-daaa-5e68-8bf7-462f88eb0d2f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_902f7e647f278f1dac4d599f335995f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f032dd34-daaa-5e68-8bf7-462f88eb0d2f/f032dd34-daaa-5e68-8bf7-462f88eb0d2f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_ef51d4fb36d61bc0cf3923270be593f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f032dd34-daaa-5e68-8bf7-462f88eb0d2f/f032dd34-daaa-5e68-8bf7-462f88eb0d2f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_f575d7fb0572ad211d76447dc1c97486.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f032dd34-daaa-5e68-8bf7-462f88eb0d2f/f032dd34-daaa-5e68-8bf7-462f88eb0d2f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_ae5c35ee935219af4c612b8fd0ac4984.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f032dd34-daaa-5e68-8bf7-462f88eb0d2f/f032dd34-daaa-5e68-8bf7-462f88eb0d2f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_e24371eb929183a00dd639b847ec7cf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f032dd34-daaa-5e68-8bf7-462f88eb0d2f/f032dd34-daaa-5e68-8bf7-462f88eb0d2f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_49e82c33a390f6cc6afe49250130e331.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f032dd34-daaa-5e68-8bf7-462f88eb0d2f/f032dd34-daaa-5e68-8bf7-462f88eb0d2f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_8f636fae3f5c05c5fa7f53cae73733f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f032dd34-daaa-5e68-8bf7-462f88eb0d2f/f032dd34-daaa-5e68-8bf7-462f88eb0d2f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_13c38d3e1736d0c60aa4434c0157f24a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f032dd34-daaa-5e68-8bf7-462f88eb0d2f/f032dd34-daaa-5e68-8bf7-462f88eb0d2f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_47c3daceaf4e6fecd22d0b80cc0c10a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f032dd34-daaa-5e68-8bf7-462f88eb0d2f/f032dd34-daaa-5e68-8bf7-462f88eb0d2f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/bb/08bb800ce4bf65c0ffb20dd211e7b489/pa/TZ01977_0e0bf91f435b7a180597aca79422be19.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2026-03-28 14:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ01977%27 HTTP/1.1" 200 None
2026-03-28 14:00:31 [auto1.es] INFO: Saving data for TZ01977: {'created_time': 1774706431.86063, 'last_price_update_time': 1774706431.860647, 'auction_closing_time': 1774884063.0}
2026-03-28 14:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TZ01977') HTTP/1.1" 204 0
2026-03-28 14:00:31 [auto1.es] INFO: Found listing with ID: DB51566
2026-03-28 14:00:31 [auto1.es] INFO: Found listing with ID: HE30029
2026-03-28 14:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE30029%27 HTTP/1.1" 200 None
2026-03-28 14:00:31 [auto1.es] INFO: Scrape type for HE30029: 1
2026-03-28 14:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA80671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK07615/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM52348/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG29658/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES07988> (referer: https://www.auto1.com/v1/car-details-view/ES07988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB15615> (referer: https://www.auto1.com/v1/car-details-view/RB15615/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: MG60856
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG60856%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [auto1.es] INFO: Scrape type for MG60856: 1
2026-03-28 14:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: FC66995
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: BA40352
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: AF24010
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: SR31558
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR31558%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [auto1.es] INFO: Scrape type for SR31558: 1
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: GG87039
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG87039%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [auto1.es] INFO: Scrape type for GG87039: 1
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: KB02091
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: MW66330
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: SP11090
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP11090%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [auto1.es] INFO: Scrape type for SP11090: 1
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: VA34349
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA34349%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [auto1.es] INFO: Scrape type for VA34349: 1
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: TW43134
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: AH45728
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: CE25443
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: MP79118
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: JM41258
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM41258%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [auto1.es] INFO: Scrape type for JM41258: 1
2026-03-28 14:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2d6b980-56de-5260-b9ff-8e9c3bc542f4 with identifier: ES07988
2026-03-28 14:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d6b980-56de-5260-b9ff-8e9c3bc542f4 with scrape type 1
2026-03-28 14:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e2d6b980-56de-5260-b9ff-8e9c3bc542f4
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe86079e958fc6a6188141d2c7866b356%252Fpa%252FES07988_4c53f4ca016f4d9dae6884a097708590.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_4c53f4ca016f4d9dae6884a097708590.jpg already downloaded
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe86079e958fc6a6188141d2c7866b356%252Fpa%252FES07988_693e588973e812c86136aa74efa2a0ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_693e588973e812c86136aa74efa2a0ba.jpg already downloaded
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe86079e958fc6a6188141d2c7866b356%252Fpa%252FES07988_e9e8dddaf4873969e5587ba9353a2b84.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_e9e8dddaf4873969e5587ba9353a2b84.jpg already downloaded
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe86079e958fc6a6188141d2c7866b356%252Fpa%252FES07988_145f095625c73c27289ae74201ca2173.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_145f095625c73c27289ae74201ca2173.jpg already downloaded
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe86079e958fc6a6188141d2c7866b356%252Fpa%252FES07988_9c890fee7f4a869c85ec9ea5f2c5ccda.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_9c890fee7f4a869c85ec9ea5f2c5ccda.jpg already downloaded
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe86079e958fc6a6188141d2c7866b356%252Fpa%252FES07988_9cd77b8c98d956d4de9bc48a42049a07.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_9cd77b8c98d956d4de9bc48a42049a07.jpg already downloaded
2026-03-28 14:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e2d6b980-56de-5260-b9ff-8e9c3bc542f4, identifier: ES07988
2026-03-28 14:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902 with identifier: RB15615
2026-03-28 14:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902 with scrape type 1
2026-03-28 14:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_7bbe2f5b5451cd3c2bb61d1b909d5311.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_7bbe2f5b5451cd3c2bb61d1b909d5311.jpg not downloaded yet
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: GU18953
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU18953%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [auto1.es] INFO: Scrape type for GU18953: 1
2026-03-28 14:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e2d6b980-56de-5260-b9ff-8e9c3bc542f4 with identifier: ES07988
2026-03-28 14:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e2d6b980-56de-5260-b9ff-8e9c3bc542f4 with identifier: ES07988
2026-03-28 14:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e2d6b980-56de-5260-b9ff-8e9c3bc542f4 with identifier: ES07988 to the API
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ES07988>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:09:31Z',
 'fuel_type': 'petrol',
 'id': 'e2d6b980-56de-5260-b9ff-8e9c3bc542f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES07988',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Honda',
 'model': 'Accord',
 'odometer': 300911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_4c53f4ca016f4d9dae6884a097708590.jpg',
                'https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_693e588973e812c86136aa74efa2a0ba.jpg',
                'https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_e9e8dddaf4873969e5587ba9353a2b84.jpg',
                'https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_145f095625c73c27289ae74201ca2173.jpg',
                'https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_9c890fee7f4a869c85ec9ea5f2c5ccda.jpg',
                'https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_9cd77b8c98d956d4de9bc48a42049a07.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d6b980-56de-5260-b9ff-8e9c3bc542f4/e2d6b980-56de-5260-b9ff-8e9c3bc542f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_4c53f4ca016f4d9dae6884a097708590.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d6b980-56de-5260-b9ff-8e9c3bc542f4/e2d6b980-56de-5260-b9ff-8e9c3bc542f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_693e588973e812c86136aa74efa2a0ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d6b980-56de-5260-b9ff-8e9c3bc542f4/e2d6b980-56de-5260-b9ff-8e9c3bc542f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_e9e8dddaf4873969e5587ba9353a2b84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d6b980-56de-5260-b9ff-8e9c3bc542f4/e2d6b980-56de-5260-b9ff-8e9c3bc542f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_145f095625c73c27289ae74201ca2173.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d6b980-56de-5260-b9ff-8e9c3bc542f4/e2d6b980-56de-5260-b9ff-8e9c3bc542f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_9c890fee7f4a869c85ec9ea5f2c5ccda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d6b980-56de-5260-b9ff-8e9c3bc542f4/e2d6b980-56de-5260-b9ff-8e9c3bc542f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/60/e86079e958fc6a6188141d2c7866b356/pa/ES07988_9cd77b8c98d956d4de9bc48a42049a07.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Accord 1.8 LS 4',
 'transmission': 'manual',
 'trim': 'LS 4',
 'year': 2002}
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES07988%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [auto1.es] INFO: Saving data for ES07988: {'created_time': 1774706432.863918, 'last_price_update_time': 1774706432.863929, 'auction_closing_time': 1774883371.0}
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ES07988') HTTP/1.1" 204 0
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_dbaa715397b4c8634d0a6ebdf2bfa141.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_dbaa715397b4c8634d0a6ebdf2bfa141.jpg not downloaded yet
2026-03-28 14:00:32 [auto1.es] INFO: Found listing with ID: HX86510
2026-03-28 14:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX86510%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [auto1.es] INFO: Scrape type for HX86510: 1
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_bf4c27145a9c1be6e0a61f99845cab4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_bf4c27145a9c1be6e0a61f99845cab4e.jpg not downloaded yet
2026-03-28 14:00:33 [auto1.es] INFO: Found listing with ID: MW71818
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW71818%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [auto1.es] INFO: Scrape type for MW71818: 2
2026-03-28 14:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 734b9f6d-ddd8-5249-a8df-1c384ae6903e with identifier: MW71818
2026-03-28 14:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 734b9f6d-ddd8-5249-a8df-1c384ae6903e with scrape type 2
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 734b9f6d-ddd8-5249-a8df-1c384ae6903e with scrape type 2
2026-03-28 14:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 734b9f6d-ddd8-5249-a8df-1c384ae6903e, identifier: MW71818
2026-03-28 14:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 734b9f6d-ddd8-5249-a8df-1c384ae6903e with identifier: MW71818
2026-03-28 14:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 734b9f6d-ddd8-5249-a8df-1c384ae6903e with identifier: MW71818
2026-03-28 14:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 734b9f6d-ddd8-5249-a8df-1c384ae6903e with identifier: MW71818 to the API
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:38:11Z',
 'fuel_type': 'petrol',
 'id': '734b9f6d-ddd8-5249-a8df-1c384ae6903e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW71818',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 52664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2021}
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW71818%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [auto1.es] INFO: Saving data for MW71818: {'auction_closing_time': 1774885091.0, 'created_time': 1773918112.008695, 'last_price_update_time': 1774706433.49435}
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MW71818') HTTP/1.1" 204 0
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_cd8d3c7601f0650cf72ae86cbd202b27.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_cd8d3c7601f0650cf72ae86cbd202b27.jpg not downloaded yet
2026-03-28 14:00:33 [auto1.es] INFO: Found listing with ID: YA27330
2026-03-28 14:00:33 [auto1.es] INFO: Found listing with ID: SX49726
2026-03-28 14:00:33 [auto1.es] INFO: Found listing with ID: ZD82748
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD82748%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [auto1.es] INFO: Scrape type for ZD82748: 1
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_2514e6705862d3aba5befef47cbfb9b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_2514e6705862d3aba5befef47cbfb9b1.jpg not downloaded yet
2026-03-28 14:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK19704> (referer: https://www.auto1.com/v1/car-details-view/YK19704/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:33 [auto1.es] INFO: Found listing with ID: DM23337
2026-03-28 14:00:33 [auto1.es] INFO: Found listing with ID: ZJ73246
2026-03-28 14:00:33 [auto1.es] INFO: Found listing with ID: EA73564
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA73564%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [auto1.es] INFO: Scrape type for EA73564: 1
2026-03-28 14:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_053bd5fa22f4ebae10388f6d308c8d5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_053bd5fa22f4ebae10388f6d308c8d5f.jpg not downloaded yet
2026-03-28 14:00:33 [auto1.es] INFO: Found listing with ID: ZM37535
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM37535%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [auto1.es] INFO: Scrape type for ZM37535: 1
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_423ab567ab87356b53d3805bb6641b07.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_423ab567ab87356b53d3805bb6641b07.jpg not downloaded yet
2026-03-28 14:00:33 [auto1.es] INFO: Found listing with ID: PE94683
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_da5cf39025730cd739b8d643d3e6d8ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_da5cf39025730cd739b8d643d3e6d8ab.jpg not downloaded yet
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_d5b4a834e99ab6108f39f9cd1bc3551d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_d5b4a834e99ab6108f39f9cd1bc3551d.jpg not downloaded yet
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_db8e0a60f528cc55cbedbf5658aa2974.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_db8e0a60f528cc55cbedbf5658aa2974.jpg not downloaded yet
2026-03-28 14:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0 with identifier: YK19704
2026-03-28 14:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0 with scrape type 1
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fec%252Fbaec6c96a358bc15a6e6ac011f5a255c%252Fpa%252FYK19704_faefbc34452bf6d9a9808ecc2cda62f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_faefbc34452bf6d9a9808ecc2cda62f1.jpg already downloaded
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fec%252Fbaec6c96a358bc15a6e6ac011f5a255c%252Fpa%252FYK19704_a888af78e681324fddcad723fe31d17d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_a888af78e681324fddcad723fe31d17d.jpg already downloaded
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fec%252Fbaec6c96a358bc15a6e6ac011f5a255c%252Fpa%252FYK19704_83b50f0b0e974ecba4f770dd3cc283b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_83b50f0b0e974ecba4f770dd3cc283b4.jpg already downloaded
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fec%252Fbaec6c96a358bc15a6e6ac011f5a255c%252Fpa%252FYK19704_1567444dbdfe1deb878158ffb2f3554d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_1567444dbdfe1deb878158ffb2f3554d.jpg already downloaded
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fec%252Fbaec6c96a358bc15a6e6ac011f5a255c%252Fpa%252FYK19704_4b593d8e762deefd4293649614c2c040.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_4b593d8e762deefd4293649614c2c040.jpg already downloaded
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fec%252Fbaec6c96a358bc15a6e6ac011f5a255c%252Fpa%252FYK19704_02f288edfbc1f9a0712fe683887b5256.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_02f288edfbc1f9a0712fe683887b5256.jpg already downloaded
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fec%252Fbaec6c96a358bc15a6e6ac011f5a255c%252Fpa%252FYK19704_566366284328803c2cf3c22579c937ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_566366284328803c2cf3c22579c937ae.jpg already downloaded
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fec%252Fbaec6c96a358bc15a6e6ac011f5a255c%252Fpa%252FYK19704_37a09efec49031b033cbbd9d18b4dbd4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_37a09efec49031b033cbbd9d18b4dbd4.jpg already downloaded
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fec%252Fbaec6c96a358bc15a6e6ac011f5a255c%252Fpa%252FYK19704_cea0e4184234e9e2300ba49fdc0a4c30.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_cea0e4184234e9e2300ba49fdc0a4c30.jpg already downloaded
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fec%252Fbaec6c96a358bc15a6e6ac011f5a255c%252Fpa%252FYK19704_d67ca40d2dc1b110237eeab55f185b19.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_d67ca40d2dc1b110237eeab55f185b19.jpg already downloaded
2026-03-28 14:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0, identifier: YK19704
2026-03-28 14:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0 with identifier: YK19704
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 14:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0 with identifier: YK19704
2026-03-28 14:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0 with identifier: YK19704 to the API
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YK19704>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:52Z',
 'fuel_type': 'petrol',
 'id': 'd87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK19704',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 122854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_faefbc34452bf6d9a9808ecc2cda62f1.jpg',
                'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_a888af78e681324fddcad723fe31d17d.jpg',
                'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_83b50f0b0e974ecba4f770dd3cc283b4.jpg',
                'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_1567444dbdfe1deb878158ffb2f3554d.jpg',
                'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_4b593d8e762deefd4293649614c2c040.jpg',
                'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_02f288edfbc1f9a0712fe683887b5256.jpg',
                'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_566366284328803c2cf3c22579c937ae.jpg',
                'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_37a09efec49031b033cbbd9d18b4dbd4.jpg',
                'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_cea0e4184234e9e2300ba49fdc0a4c30.jpg',
                'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_d67ca40d2dc1b110237eeab55f185b19.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0/d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_faefbc34452bf6d9a9808ecc2cda62f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0/d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_a888af78e681324fddcad723fe31d17d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0/d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_83b50f0b0e974ecba4f770dd3cc283b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0/d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_1567444dbdfe1deb878158ffb2f3554d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0/d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_4b593d8e762deefd4293649614c2c040.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0/d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_02f288edfbc1f9a0712fe683887b5256.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0/d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_566366284328803c2cf3c22579c937ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0/d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_37a09efec49031b033cbbd9d18b4dbd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0/d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_cea0e4184234e9e2300ba49fdc0a4c30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0/d87b5a97-5a0c-5fb2-9bda-0b09cbe69dd0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ec/baec6c96a358bc15a6e6ac011f5a255c/pa/YK19704_d67ca40d2dc1b110237eeab55f185b19.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-THP GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2017}
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK19704%27 HTTP/1.1" 200 None
2026-03-28 14:00:34 [auto1.es] INFO: Saving data for YK19704: {'created_time': 1774706434.506364, 'last_price_update_time': 1774706434.506377, 'auction_closing_time': 1774884892.0}
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YK19704') HTTP/1.1" 204 0
2026-03-28 14:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX43091/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LN12503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ13315> (referer: https://www.auto1.com/v1/car-details-view/PJ13315/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AA00980> (referer: https://www.auto1.com/v1/car-details-view/AA00980/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c430373b-6fdb-58ab-b1f4-7c443ed8dcaa with identifier: PJ13315
2026-03-28 14:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa with scrape type 1
2026-03-28 14:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_80240b76cb71053ce5a5783c49e98038.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_80240b76cb71053ce5a5783c49e98038.jpg not downloaded yet
2026-03-28 14:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb78d2c4-4377-50a9-8218-cb0a969c3fb7 with identifier: AA00980
2026-03-28 14:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7 with scrape type 1
2026-03-28 14:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_7317cba8dda72dea044c0889fc8003b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_7317cba8dda72dea044c0889fc8003b5.jpg not downloaded yet
2026-03-28 14:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_db8e0a60f528cc55cbedbf5658aa2974.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_6b149b893c2913aa582fa18ece94e160.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_6b149b893c2913aa582fa18ece94e160.jpg not downloaded yet
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_9fdf311cad230dd623390f1130fd52e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_9fdf311cad230dd623390f1130fd52e7.jpg not downloaded yet
2026-03-28 14:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_6881154705f676efab1a645328e71c07.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_6881154705f676efab1a645328e71c07.jpg not downloaded yet
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_675bf775a04e08129c9de34cc3cb73db.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_675bf775a04e08129c9de34cc3cb73db.jpg not downloaded yet
2026-03-28 14:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_423ab567ab87356b53d3805bb6641b07.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_050296ce8a12509af7b733bd78ba02b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_050296ce8a12509af7b733bd78ba02b3.jpg not downloaded yet
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_b287b312d7d59672b45aa1e6b0080c02.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_b287b312d7d59672b45aa1e6b0080c02.jpg not downloaded yet
2026-03-28 14:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_7317cba8dda72dea044c0889fc8003b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_d5b4a834e99ab6108f39f9cd1bc3551d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_e2043d040cbb8f23842c4e3df7167f3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_e2043d040cbb8f23842c4e3df7167f3e.jpg not downloaded yet
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_378c5c523f808d8f4a7bd3f1bb94d2b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_378c5c523f808d8f4a7bd3f1bb94d2b0.jpg not downloaded yet
2026-03-28 14:00:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 14:00:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 14:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1c5b90>
2026-03-28 14:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_db8e0a60f528cc55cbedbf5658aa2974.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_db8e0a60f528cc55cbedbf5658aa2974.jpg saved to cache
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902
2026-03-28 14:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_da5cf39025730cd739b8d643d3e6d8ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_ff89ccab7819eec19289eab2da0a72b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_ff89ccab7819eec19289eab2da0a72b5.jpg not downloaded yet
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_946bb73568e7c2c1ff55d700c8f99cec.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_946bb73568e7c2c1ff55d700c8f99cec.jpg not downloaded yet
2026-03-28 14:00:35 [auto1.es] INFO: Channel: 24h | Page: 3 | totalHits: 2695 | hits on page: 40
2026-03-28 14:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_675bf775a04e08129c9de34cc3cb73db.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_6881154705f676efab1a645328e71c07.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_48a521c11adefef791e6f4ef7afa4747.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_48a521c11adefef791e6f4ef7afa4747.jpg not downloaded yet
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_53737549163c4b46058cbb3bfb906b6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_53737549163c4b46058cbb3bfb906b6a.jpg not downloaded yet
2026-03-28 14:00:35 [auto1.es] INFO: Found listing with ID: UD02034
2026-03-28 14:00:35 [auto1.es] INFO: Found listing with ID: FK96312
2026-03-28 14:00:35 [auto1.es] INFO: Found listing with ID: SL01045
2026-03-28 14:00:35 [auto1.es] INFO: Found listing with ID: WA68428
2026-03-28 14:00:35 [auto1.es] INFO: Found listing with ID: DK05159
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DK05159%27 HTTP/1.1" 200 None
2026-03-28 14:00:35 [auto1.es] INFO: Scrape type for DK05159: 1
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a127650>
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_423ab567ab87356b53d3805bb6641b07.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_423ab567ab87356b53d3805bb6641b07.jpg saved to cache
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686db2d0>
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_7317cba8dda72dea044c0889fc8003b5.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_7317cba8dda72dea044c0889fc8003b5.jpg saved to cache
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686e5e50>
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_d5b4a834e99ab6108f39f9cd1bc3551d.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_d5b4a834e99ab6108f39f9cd1bc3551d.jpg saved to cache
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_3adc7d4c02bb0a9fa69a7a6157a70399.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_3adc7d4c02bb0a9fa69a7a6157a70399.jpg not downloaded yet
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_ffa710f06c5c0859cc7c3f48879b0534.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_ffa710f06c5c0859cc7c3f48879b0534.jpg not downloaded yet
2026-03-28 14:00:35 [auto1.es] INFO: Found listing with ID: VJ61216
2026-03-28 14:00:35 [auto1.es] INFO: Found listing with ID: KX75561
2026-03-28 14:00:35 [auto1.es] INFO: Found listing with ID: ZE38757
2026-03-28 14:00:35 [auto1.es] INFO: Found listing with ID: HX37636
2026-03-28 14:00:35 [auto1.es] INFO: Found listing with ID: GW51820
2026-03-28 14:00:35 [auto1.es] INFO: Found listing with ID: BT71977
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT71977%27 HTTP/1.1" 200 None
2026-03-28 14:00:35 [auto1.es] INFO: Scrape type for BT71977: 2
2026-03-28 14:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f61e0f2-c6ef-55a2-92c5-b0a86584eac8 with identifier: BT71977
2026-03-28 14:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f61e0f2-c6ef-55a2-92c5-b0a86584eac8 with scrape type 2
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f61e0f2-c6ef-55a2-92c5-b0a86584eac8 with scrape type 2
2026-03-28 14:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f61e0f2-c6ef-55a2-92c5-b0a86584eac8, identifier: BT71977
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686f5450>
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_da5cf39025730cd739b8d643d3e6d8ab.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_da5cf39025730cd739b8d643d3e6d8ab.jpg saved to cache
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902
2026-03-28 14:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_b287b312d7d59672b45aa1e6b0080c02.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_4e83d3244751475b5d09b2b1399bd7a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_4e83d3244751475b5d09b2b1399bd7a6.jpg not downloaded yet
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_9db07bf51481ad809ab8baab06afd369.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_9db07bf51481ad809ab8baab06afd369.jpg not downloaded yet
2026-03-28 14:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f61e0f2-c6ef-55a2-92c5-b0a86584eac8 with identifier: BT71977
2026-03-28 14:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f61e0f2-c6ef-55a2-92c5-b0a86584eac8 with identifier: BT71977
2026-03-28 14:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f61e0f2-c6ef-55a2-92c5-b0a86584eac8 with identifier: BT71977 to the API
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:36Z',
 'fuel_type': 'petrol',
 'id': '2f61e0f2-c6ef-55a2-92c5-b0a86584eac8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT71977',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 69162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seller_name': None,
 'title': 'Seat Tarraco 1.5 TSI ACT Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2021}
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT71977%27 HTTP/1.1" 200 None
2026-03-28 14:00:36 [auto1.es] INFO: Saving data for BT71977: {'auction_closing_time': 1774885596.0, 'created_time': 1772697645.917138, 'last_price_update_time': 1774706436.1116}
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BT71977') HTTP/1.1" 204 0
2026-03-28 14:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA78268/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_378c5c523f808d8f4a7bd3f1bb94d2b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:36 [auto1.es] INFO: Found listing with ID: TH94228
2026-03-28 14:00:36 [auto1.es] INFO: Found listing with ID: JK26154
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK26154%27 HTTP/1.1" 200 None
2026-03-28 14:00:36 [auto1.es] INFO: Scrape type for JK26154: 1
2026-03-28 14:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a045890>
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_675bf775a04e08129c9de34cc3cb73db.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_675bf775a04e08129c9de34cc3cb73db.jpg saved to cache
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686eab50>
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_6881154705f676efab1a645328e71c07.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_6881154705f676efab1a645328e71c07.jpg saved to cache
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa
2026-03-28 14:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_9fdf311cad230dd623390f1130fd52e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_ff89ccab7819eec19289eab2da0a72b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_946bb73568e7c2c1ff55d700c8f99cec.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_3831d6ca7c9008df9623fc55d453fb2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_3831d6ca7c9008df9623fc55d453fb2a.jpg not downloaded yet
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_ba10d3dfea9636c36305783a8b3e6bb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_ba10d3dfea9636c36305783a8b3e6bb1.jpg not downloaded yet
2026-03-28 14:00:36 [auto1.es] INFO: Found listing with ID: EA32126
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA32126%27 HTTP/1.1" 200 None
2026-03-28 14:00:36 [auto1.es] INFO: Scrape type for EA32126: 1
2026-03-28 14:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG60856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR31558/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ10001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c2b7610>
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_b287b312d7d59672b45aa1e6b0080c02.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_b287b312d7d59672b45aa1e6b0080c02.jpg saved to cache
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7
2026-03-28 14:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686b4210>
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_378c5c523f808d8f4a7bd3f1bb94d2b0.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_378c5c523f808d8f4a7bd3f1bb94d2b0.jpg saved to cache
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7
2026-03-28 14:00:36 [auto1.es] INFO: Found listing with ID: JE13816
2026-03-28 14:00:36 [auto1.es] INFO: Found listing with ID: XP47447
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP47447%27 HTTP/1.1" 200 None
2026-03-28 14:00:36 [auto1.es] INFO: Scrape type for XP47447: 1
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a273610>
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_9fdf311cad230dd623390f1130fd52e7.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_9fdf311cad230dd623390f1130fd52e7.jpg saved to cache
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff169feead0>
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_ff89ccab7819eec19289eab2da0a72b5.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_ff89ccab7819eec19289eab2da0a72b5.jpg saved to cache
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686d7690>
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_946bb73568e7c2c1ff55d700c8f99cec.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_946bb73568e7c2c1ff55d700c8f99cec.jpg saved to cache
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7
2026-03-28 14:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_9db07bf51481ad809ab8baab06afd369.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:36 [auto1.es] INFO: Found listing with ID: YV42226
2026-03-28 14:00:36 [auto1.es] INFO: Found listing with ID: GU66337
2026-03-28 14:00:36 [auto1.es] INFO: Found listing with ID: NG71405
2026-03-28 14:00:36 [auto1.es] INFO: Found listing with ID: CC89526
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC89526%27 HTTP/1.1" 200 None
2026-03-28 14:00:36 [auto1.es] INFO: Scrape type for CC89526: 2
2026-03-28 14:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38679723-8fd3-59e1-9e1a-0ece5488ce76 with identifier: CC89526
2026-03-28 14:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38679723-8fd3-59e1-9e1a-0ece5488ce76 with scrape type 2
2026-03-28 14:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38679723-8fd3-59e1-9e1a-0ece5488ce76 with scrape type 2
2026-03-28 14:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38679723-8fd3-59e1-9e1a-0ece5488ce76, identifier: CC89526
2026-03-28 14:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_53737549163c4b46058cbb3bfb906b6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_4e83d3244751475b5d09b2b1399bd7a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38679723-8fd3-59e1-9e1a-0ece5488ce76 with identifier: CC89526
2026-03-28 14:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38679723-8fd3-59e1-9e1a-0ece5488ce76 with identifier: CC89526
2026-03-28 14:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 38679723-8fd3-59e1-9e1a-0ece5488ce76 with identifier: CC89526 to the API
2026-03-28 14:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:58:30Z',
 'fuel_type': 'diesel',
 'id': '38679723-8fd3-59e1-9e1a-0ece5488ce76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC89526',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 282016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-17',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC89526%27 HTTP/1.1" 200 None
2026-03-28 14:00:37 [auto1.es] INFO: Saving data for CC89526: {'auction_closing_time': 1774886310.0, 'created_time': 1773324260.640426, 'last_price_update_time': 1774706437.21885}
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CC89526') HTTP/1.1" 204 0
2026-03-28 14:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_3adc7d4c02bb0a9fa69a7a6157a70399.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_ffa710f06c5c0859cc7c3f48879b0534.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:37 [auto1.es] INFO: Found listing with ID: MY23078
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY23078%27 HTTP/1.1" 200 None
2026-03-28 14:00:37 [auto1.es] INFO: Scrape type for MY23078: 1
2026-03-28 14:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG87039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE30029/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:37 [auto1.es] INFO: Found listing with ID: PN58754
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN58754%27 HTTP/1.1" 200 None
2026-03-28 14:00:37 [auto1.es] INFO: Scrape type for PN58754: 2
2026-03-28 14:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0fd2129-c771-5bc9-b04e-99b36e81aa91 with identifier: PN58754
2026-03-28 14:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0fd2129-c771-5bc9-b04e-99b36e81aa91 with scrape type 2
2026-03-28 14:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0fd2129-c771-5bc9-b04e-99b36e81aa91 with scrape type 2
2026-03-28 14:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c0fd2129-c771-5bc9-b04e-99b36e81aa91, identifier: PN58754
2026-03-28 14:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1a9550>
2026-03-28 14:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_9db07bf51481ad809ab8baab06afd369.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_9db07bf51481ad809ab8baab06afd369.jpg saved to cache
2026-03-28 14:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7
2026-03-28 14:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a181d90>
2026-03-28 14:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_53737549163c4b46058cbb3bfb906b6a.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_53737549163c4b46058cbb3bfb906b6a.jpg saved to cache
2026-03-28 14:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7
2026-03-28 14:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a34cf10>
2026-03-28 14:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_4e83d3244751475b5d09b2b1399bd7a6.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_4e83d3244751475b5d09b2b1399bd7a6.jpg saved to cache
2026-03-28 14:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa
2026-03-28 14:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c0fd2129-c771-5bc9-b04e-99b36e81aa91 with identifier: PN58754
2026-03-28 14:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c0fd2129-c771-5bc9-b04e-99b36e81aa91 with identifier: PN58754
2026-03-28 14:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c0fd2129-c771-5bc9-b04e-99b36e81aa91 with identifier: PN58754 to the API
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:12:33Z',
 'fuel_type': 'petrol',
 'id': 'c0fd2129-c771-5bc9-b04e-99b36e81aa91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN58754',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 33204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-05',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN58754%27 HTTP/1.1" 200 None
2026-03-28 14:00:37 [auto1.es] INFO: Saving data for PN58754: {'auction_closing_time': 1774883553.0, 'created_time': 1773432284.924768, 'last_price_update_time': 1774706437.967901}
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PN58754') HTTP/1.1" 204 0
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: XM15498
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: XL95591
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL95591%27 HTTP/1.1" 200 None
2026-03-28 14:00:38 [auto1.es] INFO: Scrape type for XL95591: 1
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1ebe50>
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_3adc7d4c02bb0a9fa69a7a6157a70399.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_3adc7d4c02bb0a9fa69a7a6157a70399.jpg saved to cache
2026-03-28 14:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686f9350>
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_ffa710f06c5c0859cc7c3f48879b0534.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_ffa710f06c5c0859cc7c3f48879b0534.jpg saved to cache
2026-03-28 14:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: DA49671
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: GH57787
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: KC85026
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC85026%27 HTTP/1.1" 200 None
2026-03-28 14:00:38 [auto1.es] INFO: Scrape type for KC85026: 1
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: BX27064
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: AT82365
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT82365%27 HTTP/1.1" 200 None
2026-03-28 14:00:38 [auto1.es] INFO: Scrape type for AT82365: 1
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: WK81773
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: TS39016
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS39016%27 HTTP/1.1" 200 None
2026-03-28 14:00:38 [auto1.es] INFO: Scrape type for TS39016: 1
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: TT65809
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT65809%27 HTTP/1.1" 200 None
2026-03-28 14:00:38 [auto1.es] INFO: Scrape type for TT65809: 1
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: EH49664
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH49664%27 HTTP/1.1" 200 None
2026-03-28 14:00:38 [auto1.es] INFO: Scrape type for EH49664: 1
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: EB66589
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: PA52283
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA52283%27 HTTP/1.1" 200 None
2026-03-28 14:00:38 [auto1.es] INFO: Scrape type for PA52283: 1
2026-03-28 14:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_3831d6ca7c9008df9623fc55d453fb2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: PG75974
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: BE72749
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE72749%27 HTTP/1.1" 200 None
2026-03-28 14:00:38 [auto1.es] INFO: Scrape type for BE72749: 1
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: ZK42012
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: PS53569
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS53569%27 HTTP/1.1" 200 None
2026-03-28 14:00:38 [auto1.es] INFO: Scrape type for PS53569: 1
2026-03-28 14:00:38 [auto1.es] INFO: Found listing with ID: LG52328
2026-03-28 14:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_ba10d3dfea9636c36305783a8b3e6bb1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0c3310>
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_3831d6ca7c9008df9623fc55d453fb2a.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_3831d6ca7c9008df9623fc55d453fb2a.jpg saved to cache
2026-03-28 14:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff169fcf610>
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b7e511775a488d910af58a7a90efc%252Fpa%252FAA00980_ba10d3dfea9636c36305783a8b3e6bb1.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_ba10d3dfea9636c36305783a8b3e6bb1.jpg saved to cache
2026-03-28 14:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7
2026-03-28 14:00:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb78d2c4-4377-50a9-8218-cb0a969c3fb7, skipping ID generation
2026-03-28 14:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7 with scrape type 1
2026-03-28 14:00:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb78d2c4-4377-50a9-8218-cb0a969c3fb7 sending to next pipeline
2026-03-28 14:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bb78d2c4-4377-50a9-8218-cb0a969c3fb7, identifier: AA00980
2026-03-28 14:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bb78d2c4-4377-50a9-8218-cb0a969c3fb7 with identifier: AA00980
2026-03-28 14:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bb78d2c4-4377-50a9-8218-cb0a969c3fb7 with identifier: AA00980
2026-03-28 14:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bb78d2c4-4377-50a9-8218-cb0a969c3fb7 with identifier: AA00980 to the API
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_ba10d3dfea9636c36305783a8b3e6bb1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:51:10Z',
 'fuel_type': 'petrol',
 'id': 'bb78d2c4-4377-50a9-8218-cb0a969c3fb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA00980',
 'listing': 'auction',
 'location': 'ES, Torrejon de Ardoz',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 109006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_7317cba8dda72dea044c0889fc8003b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_9fdf311cad230dd623390f1130fd52e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_675bf775a04e08129c9de34cc3cb73db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_b287b312d7d59672b45aa1e6b0080c02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_378c5c523f808d8f4a7bd3f1bb94d2b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_946bb73568e7c2c1ff55d700c8f99cec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_53737549163c4b46058cbb3bfb906b6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_ffa710f06c5c0859cc7c3f48879b0534.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_9db07bf51481ad809ab8baab06afd369.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb78d2c4-4377-50a9-8218-cb0a969c3fb7/bb78d2c4-4377-50a9-8218-cb0a969c3fb7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b7e511775a488d910af58a7a90efc/pa/AA00980_ba10d3dfea9636c36305783a8b3e6bb1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Style Copa',
 'transmission': 'manual',
 'trim': 'Style Copa',
 'year': 2012}
2026-03-28 14:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA00980%27 HTTP/1.1" 200 None
2026-03-28 14:00:39 [auto1.es] INFO: Saving data for AA00980: {'created_time': 1774706439.055277, 'last_price_update_time': 1774706439.055286, 'auction_closing_time': 1774885870.0}
2026-03-28 14:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AA00980') HTTP/1.1" 204 0
2026-03-28 14:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD82748/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK05159/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP11090/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR31558> (referer: https://www.auto1.com/v1/car-details-view/SR31558/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea34bea6-89a6-5c14-9d06-060a2ac142be with identifier: SR31558
2026-03-28 14:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea34bea6-89a6-5c14-9d06-060a2ac142be with scrape type 1
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea34bea6-89a6-5c14-9d06-060a2ac142be
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_4abf3b36ea02f8e9a1d9ffc5772eafcb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_4abf3b36ea02f8e9a1d9ffc5772eafcb.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_9dbda4c2db646292739d02a175dca792.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_9dbda4c2db646292739d02a175dca792.jpg not downloaded yet
2026-03-28 14:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ10001> (referer: https://www.auto1.com/v1/car-details-view/PZ10001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_e74fd7a44cfa23a768e7ac35f9622737.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_e74fd7a44cfa23a768e7ac35f9622737.jpg not downloaded yet
2026-03-28 14:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_6278a9b4c42958dd88b757082c296a46.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_6278a9b4c42958dd88b757082c296a46.jpg not downloaded yet
2026-03-28 14:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG60856> (referer: https://www.auto1.com/v1/car-details-view/MG60856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_765076320b46b00104b3adf07e72f478.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_765076320b46b00104b3adf07e72f478.jpg not downloaded yet
2026-03-28 14:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_47ebbaaa6476f47ea187767a0285c1e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_47ebbaaa6476f47ea187767a0285c1e0.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_74bf3a61647889a28773407c2cc4d0c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_74bf3a61647889a28773407c2cc4d0c3.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_e18117163c32bd91f182aefc1dc854b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_e18117163c32bd91f182aefc1dc854b5.jpg not downloaded yet
2026-03-28 14:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c with identifier: PZ10001
2026-03-28 14:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c with scrape type 1
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_88fea1b033b736a5fd85ede497cb15ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_88fea1b033b736a5fd85ede497cb15ed.jpg not downloaded yet
2026-03-28 14:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_9dbda4c2db646292739d02a175dca792.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_c08e78c20cdcc6a2ef3cb5d1f1adebe8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_c08e78c20cdcc6a2ef3cb5d1f1adebe8.jpg not downloaded yet
2026-03-28 14:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_6278a9b4c42958dd88b757082c296a46.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_0502f0a3612d2fc827bafc9936b19767.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_0502f0a3612d2fc827bafc9936b19767.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_5fedd572a7ed075106523b85186b969a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_5fedd572a7ed075106523b85186b969a.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_3d42426a8d6ba450b0db06f7c4171256.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_3d42426a8d6ba450b0db06f7c4171256.jpg not downloaded yet
2026-03-28 14:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6434ab56-7714-5170-a309-4940d26a154c with identifier: MG60856
2026-03-28 14:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6434ab56-7714-5170-a309-4940d26a154c with scrape type 1
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6434ab56-7714-5170-a309-4940d26a154c
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7b%252Fb57b58bf63ac1fd9facf042655e58883%252Fpa%252FMG60856_664ba7c62d487645eacd0cbaa2f948df.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_664ba7c62d487645eacd0cbaa2f948df.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_457df3d8617f2c4aeafcf5317e802a80.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_457df3d8617f2c4aeafcf5317e802a80.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7b%252Fb57b58bf63ac1fd9facf042655e58883%252Fpa%252FMG60856_9dda0809603c503bab7cae6b2afbcabd.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_9dda0809603c503bab7cae6b2afbcabd.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_d6279340825c78ae9a46bac6c600c00e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_d6279340825c78ae9a46bac6c600c00e.jpg not downloaded yet
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0ff610>
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_9dbda4c2db646292739d02a175dca792.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_9dbda4c2db646292739d02a175dca792.jpg saved to cache
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea34bea6-89a6-5c14-9d06-060a2ac142be
2026-03-28 14:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_88fea1b033b736a5fd85ede497cb15ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7b%252Fb57b58bf63ac1fd9facf042655e58883%252Fpa%252FMG60856_42b8876d3f933cc12a532afcc7d1de96.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_42b8876d3f933cc12a532afcc7d1de96.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_b37b99740ca8b4cc2883555e51f62a76.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_b37b99740ca8b4cc2883555e51f62a76.jpg not downloaded yet
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a096450>
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_6278a9b4c42958dd88b757082c296a46.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_6278a9b4c42958dd88b757082c296a46.jpg saved to cache
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea34bea6-89a6-5c14-9d06-060a2ac142be
2026-03-28 14:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_e18117163c32bd91f182aefc1dc854b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7b%252Fb57b58bf63ac1fd9facf042655e58883%252Fpa%252FMG60856_d9fcbd003b151675575fedc168349e4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_d9fcbd003b151675575fedc168349e4b.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_2d281d86b7217ec7ed984d6b44aed0b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_2d281d86b7217ec7ed984d6b44aed0b2.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7b%252Fb57b58bf63ac1fd9facf042655e58883%252Fpa%252FMG60856_36265bcdef891500c8509b64c7173300.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_36265bcdef891500c8509b64c7173300.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_5d0cd559e1089aeaf674b3b9fd6ef250.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_5d0cd559e1089aeaf674b3b9fd6ef250.jpg not downloaded yet
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7b%252Fb57b58bf63ac1fd9facf042655e58883%252Fpa%252FMG60856_0fddad5f8f2306546a2c8dac4004200f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_0fddad5f8f2306546a2c8dac4004200f.jpg not downloaded yet
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a22c310>
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_88fea1b033b736a5fd85ede497cb15ed.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_88fea1b033b736a5fd85ede497cb15ed.jpg saved to cache
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_03c4ea4f67bd787c1e2ab4077393d15b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_03c4ea4f67bd787c1e2ab4077393d15b.jpg not downloaded yet
2026-03-28 14:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_d6279340825c78ae9a46bac6c600c00e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_cdf55e29752a48fc3d8b33c78970f016.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_cdf55e29752a48fc3d8b33c78970f016.jpg not downloaded yet
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a168cd0>
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_e18117163c32bd91f182aefc1dc854b5.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_e18117163c32bd91f182aefc1dc854b5.jpg saved to cache
2026-03-28 14:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea34bea6-89a6-5c14-9d06-060a2ac142be
2026-03-28 14:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_42b8876d3f933cc12a532afcc7d1de96.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686c5c10>
2026-03-28 14:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_d6279340825c78ae9a46bac6c600c00e.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_d6279340825c78ae9a46bac6c600c00e.jpg saved to cache
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a257a10>
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6434ab56-7714-5170-a309-4940d26a154c/6434ab56-7714-5170-a309-4940d26a154c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7b%252Fb57b58bf63ac1fd9facf042655e58883%252Fpa%252FMG60856_42b8876d3f933cc12a532afcc7d1de96.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_42b8876d3f933cc12a532afcc7d1de96.jpg saved to cache
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6434ab56-7714-5170-a309-4940d26a154c
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_cdf55e29752a48fc3d8b33c78970f016.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_03c4ea4f67bd787c1e2ab4077393d15b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a160310>
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_cdf55e29752a48fc3d8b33c78970f016.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_cdf55e29752a48fc3d8b33c78970f016.jpg saved to cache
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686c4050>
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_03c4ea4f67bd787c1e2ab4077393d15b.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_03c4ea4f67bd787c1e2ab4077393d15b.jpg saved to cache
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_0fddad5f8f2306546a2c8dac4004200f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY23078/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_5d0cd559e1089aeaf674b3b9fd6ef250.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a010b50>
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6434ab56-7714-5170-a309-4940d26a154c/6434ab56-7714-5170-a309-4940d26a154c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7b%252Fb57b58bf63ac1fd9facf042655e58883%252Fpa%252FMG60856_0fddad5f8f2306546a2c8dac4004200f.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_0fddad5f8f2306546a2c8dac4004200f.jpg saved to cache
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6434ab56-7714-5170-a309-4940d26a154c
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686c6ed0>
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_5d0cd559e1089aeaf674b3b9fd6ef250.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_5d0cd559e1089aeaf674b3b9fd6ef250.jpg saved to cache
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA32126/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP47447/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_36265bcdef891500c8509b64c7173300.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_2d281d86b7217ec7ed984d6b44aed0b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_d9fcbd003b151675575fedc168349e4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_9dda0809603c503bab7cae6b2afbcabd.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_457df3d8617f2c4aeafcf5317e802a80.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC82698/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_664ba7c62d487645eacd0cbaa2f948df.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c3f5410>
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6434ab56-7714-5170-a309-4940d26a154c/6434ab56-7714-5170-a309-4940d26a154c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7b%252Fb57b58bf63ac1fd9facf042655e58883%252Fpa%252FMG60856_36265bcdef891500c8509b64c7173300.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_36265bcdef891500c8509b64c7173300.jpg saved to cache
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6434ab56-7714-5170-a309-4940d26a154c
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_5fedd572a7ed075106523b85186b969a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a032850>
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_2d281d86b7217ec7ed984d6b44aed0b2.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_2d281d86b7217ec7ed984d6b44aed0b2.jpg saved to cache
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a096e90>
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6434ab56-7714-5170-a309-4940d26a154c/6434ab56-7714-5170-a309-4940d26a154c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7b%252Fb57b58bf63ac1fd9facf042655e58883%252Fpa%252FMG60856_d9fcbd003b151675575fedc168349e4b.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_d9fcbd003b151675575fedc168349e4b.jpg saved to cache
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6434ab56-7714-5170-a309-4940d26a154c
2026-03-28 14:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_b37b99740ca8b4cc2883555e51f62a76.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a12ff10>
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6434ab56-7714-5170-a309-4940d26a154c/6434ab56-7714-5170-a309-4940d26a154c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7b%252Fb57b58bf63ac1fd9facf042655e58883%252Fpa%252FMG60856_9dda0809603c503bab7cae6b2afbcabd.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_9dda0809603c503bab7cae6b2afbcabd.jpg saved to cache
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6434ab56-7714-5170-a309-4940d26a154c
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a19e990>
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_457df3d8617f2c4aeafcf5317e802a80.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_457df3d8617f2c4aeafcf5317e802a80.jpg saved to cache
2026-03-28 14:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a093710>
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6434ab56-7714-5170-a309-4940d26a154c/6434ab56-7714-5170-a309-4940d26a154c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7b%252Fb57b58bf63ac1fd9facf042655e58883%252Fpa%252FMG60856_664ba7c62d487645eacd0cbaa2f948df.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_664ba7c62d487645eacd0cbaa2f948df.jpg saved to cache
2026-03-28 14:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6434ab56-7714-5170-a309-4940d26a154c
2026-03-28 14:00:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6434ab56-7714-5170-a309-4940d26a154c, skipping ID generation
2026-03-28 14:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6434ab56-7714-5170-a309-4940d26a154c with scrape type 1
2026-03-28 14:00:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6434ab56-7714-5170-a309-4940d26a154c sending to next pipeline
2026-03-28 14:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6434ab56-7714-5170-a309-4940d26a154c, identifier: MG60856
2026-03-28 14:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6434ab56-7714-5170-a309-4940d26a154c with identifier: MG60856
2026-03-28 14:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6434ab56-7714-5170-a309-4940d26a154c with identifier: MG60856
2026-03-28 14:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6434ab56-7714-5170-a309-4940d26a154c with identifier: MG60856 to the API
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_664ba7c62d487645eacd0cbaa2f948df.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:41:52Z',
 'fuel_type': 'diesel',
 'id': '6434ab56-7714-5170-a309-4940d26a154c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG60856',
 'listing': 'auction',
 'location': 'ES, Ciudad Real',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 173809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6434ab56-7714-5170-a309-4940d26a154c/6434ab56-7714-5170-a309-4940d26a154c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_664ba7c62d487645eacd0cbaa2f948df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6434ab56-7714-5170-a309-4940d26a154c/6434ab56-7714-5170-a309-4940d26a154c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_9dda0809603c503bab7cae6b2afbcabd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6434ab56-7714-5170-a309-4940d26a154c/6434ab56-7714-5170-a309-4940d26a154c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_42b8876d3f933cc12a532afcc7d1de96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6434ab56-7714-5170-a309-4940d26a154c/6434ab56-7714-5170-a309-4940d26a154c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_d9fcbd003b151675575fedc168349e4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6434ab56-7714-5170-a309-4940d26a154c/6434ab56-7714-5170-a309-4940d26a154c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_36265bcdef891500c8509b64c7173300.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6434ab56-7714-5170-a309-4940d26a154c/6434ab56-7714-5170-a309-4940d26a154c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7b/b57b58bf63ac1fd9facf042655e58883/pa/MG60856_0fddad5f8f2306546a2c8dac4004200f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Bravo 1.6 JTDM Multijet Dynamic',
 'transmission': 'manual',
 'trim': 'Multijet Dynamic',
 'year': 2008}
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG60856%27 HTTP/1.1" 200 None
2026-03-28 14:00:42 [auto1.es] INFO: Saving data for MG60856: {'created_time': 1774706442.620338, 'last_price_update_time': 1774706442.620351, 'auction_closing_time': 1774885312.0}
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MG60856') HTTP/1.1" 204 0
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c5e70d0>
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_5fedd572a7ed075106523b85186b969a.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_5fedd572a7ed075106523b85186b969a.jpg saved to cache
2026-03-28 14:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea34bea6-89a6-5c14-9d06-060a2ac142be
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_3d42426a8d6ba450b0db06f7c4171256.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_0502f0a3612d2fc827bafc9936b19767.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS53569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE72749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_c08e78c20cdcc6a2ef3cb5d1f1adebe8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA78268> (referer: https://www.auto1.com/v1/car-details-view/DA78268/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA34349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA52283/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16db56f10>
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_b37b99740ca8b4cc2883555e51f62a76.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_b37b99740ca8b4cc2883555e51f62a76.jpg saved to cache
2026-03-28 14:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c
2026-03-28 14:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686c9750>
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_3d42426a8d6ba450b0db06f7c4171256.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_3d42426a8d6ba450b0db06f7c4171256.jpg saved to cache
2026-03-28 14:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_74bf3a61647889a28773407c2cc4d0c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_e74fd7a44cfa23a768e7ac35f9622737.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_4abf3b36ea02f8e9a1d9ffc5772eafcb.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_765076320b46b00104b3adf07e72f478.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_47ebbaaa6476f47ea187767a0285c1e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0fb750>
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fed%252F38edab639b915e8499a6c9aad9987deb%252Fpa%252FPZ10001_0502f0a3612d2fc827bafc9936b19767.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_0502f0a3612d2fc827bafc9936b19767.jpg saved to cache
2026-03-28 14:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c
2026-03-28 14:00:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c, skipping ID generation
2026-03-28 14:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c with scrape type 1
2026-03-28 14:00:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c sending to next pipeline
2026-03-28 14:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c, identifier: PZ10001
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1059d0>
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_c08e78c20cdcc6a2ef3cb5d1f1adebe8.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_c08e78c20cdcc6a2ef3cb5d1f1adebe8.jpg saved to cache
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea34bea6-89a6-5c14-9d06-060a2ac142be
2026-03-28 14:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cfbecb0-2039-5421-a812-e290ec86b875 with identifier: DA78268
2026-03-28 14:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cfbecb0-2039-5421-a812-e290ec86b875 with scrape type 1
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5cfbecb0-2039-5421-a812-e290ec86b875
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_63c8d2ff330058bc9ac06052d6e9fdea.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_63c8d2ff330058bc9ac06052d6e9fdea.jpg not downloaded yet
2026-03-28 14:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c with identifier: PZ10001
2026-03-28 14:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c with identifier: PZ10001
2026-03-28 14:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c with identifier: PZ10001 to the API
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_0502f0a3612d2fc827bafc9936b19767.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:15:23Z',
 'fuel_type': 'diesel',
 'id': 'c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ10001',
 'listing': 'auction',
 'location': 'ES, Xirivella, Valencia.',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 250793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_88fea1b033b736a5fd85ede497cb15ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_0502f0a3612d2fc827bafc9936b19767.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_3d42426a8d6ba450b0db06f7c4171256.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_457df3d8617f2c4aeafcf5317e802a80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_d6279340825c78ae9a46bac6c600c00e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_b37b99740ca8b4cc2883555e51f62a76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_2d281d86b7217ec7ed984d6b44aed0b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_5d0cd559e1089aeaf674b3b9fd6ef250.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_03c4ea4f67bd787c1e2ab4077393d15b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c/c0cc78ad-ef4d-5e17-9d9e-7f3fcabd0e6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ed/38edab639b915e8499a6c9aad9987deb/pa/PZ10001_cdf55e29752a48fc3d8b33c78970f016.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ10001%27 HTTP/1.1" 200 None
2026-03-28 14:00:43 [auto1.es] INFO: Saving data for PZ10001: {'created_time': 1774706443.583148, 'last_price_update_time': 1774706443.583162, 'auction_closing_time': 1774883723.0}
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PZ10001') HTTP/1.1" 204 0
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_b5ce9ef12a9fc9938ed044dbb53796fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_b5ce9ef12a9fc9938ed044dbb53796fb.jpg not downloaded yet
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1d5890>
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_74bf3a61647889a28773407c2cc4d0c3.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_74bf3a61647889a28773407c2cc4d0c3.jpg saved to cache
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea34bea6-89a6-5c14-9d06-060a2ac142be
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168603e10>
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_e74fd7a44cfa23a768e7ac35f9622737.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_e74fd7a44cfa23a768e7ac35f9622737.jpg saved to cache
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea34bea6-89a6-5c14-9d06-060a2ac142be
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a3a1850>
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_4abf3b36ea02f8e9a1d9ffc5772eafcb.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_4abf3b36ea02f8e9a1d9ffc5772eafcb.jpg saved to cache
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea34bea6-89a6-5c14-9d06-060a2ac142be
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168711d90>
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_765076320b46b00104b3adf07e72f478.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_765076320b46b00104b3adf07e72f478.jpg saved to cache
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea34bea6-89a6-5c14-9d06-060a2ac142be
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a05c310>
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fe8%252Fc1e82dbd011d27292ec31511211c6274%252Fpa%252FSR31558_47ebbaaa6476f47ea187767a0285c1e0.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_47ebbaaa6476f47ea187767a0285c1e0.jpg saved to cache
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea34bea6-89a6-5c14-9d06-060a2ac142be
2026-03-28 14:00:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea34bea6-89a6-5c14-9d06-060a2ac142be, skipping ID generation
2026-03-28 14:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea34bea6-89a6-5c14-9d06-060a2ac142be with scrape type 1
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea34bea6-89a6-5c14-9d06-060a2ac142be sending to next pipeline
2026-03-28 14:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ea34bea6-89a6-5c14-9d06-060a2ac142be, identifier: SR31558
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_cf0efcdc4500a24cfcf1f23ac96de19b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_cf0efcdc4500a24cfcf1f23ac96de19b.jpg not downloaded yet
2026-03-28 14:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH49664/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ea34bea6-89a6-5c14-9d06-060a2ac142be with identifier: SR31558
2026-03-28 14:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ea34bea6-89a6-5c14-9d06-060a2ac142be with identifier: SR31558
2026-03-28 14:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ea34bea6-89a6-5c14-9d06-060a2ac142be with identifier: SR31558 to the API
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_47ebbaaa6476f47ea187767a0285c1e0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:29:30Z',
 'fuel_type': 'petrol',
 'id': 'ea34bea6-89a6-5c14-9d06-060a2ac142be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR31558',
 'listing': 'auction',
 'location': 'ES, Móstoles',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 198398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_4abf3b36ea02f8e9a1d9ffc5772eafcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_9dbda4c2db646292739d02a175dca792.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_e74fd7a44cfa23a768e7ac35f9622737.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_6278a9b4c42958dd88b757082c296a46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_765076320b46b00104b3adf07e72f478.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_47ebbaaa6476f47ea187767a0285c1e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_74bf3a61647889a28773407c2cc4d0c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_e18117163c32bd91f182aefc1dc854b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_c08e78c20cdcc6a2ef3cb5d1f1adebe8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea34bea6-89a6-5c14-9d06-060a2ac142be/ea34bea6-89a6-5c14-9d06-060a2ac142be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/e8/c1e82dbd011d27292ec31511211c6274/pa/SR31558_5fedd572a7ed075106523b85186b969a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-02',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT 1.8 TFSI Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 2011}
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR31558%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [auto1.es] INFO: Saving data for SR31558: {'created_time': 1774706444.315777, 'last_price_update_time': 1774706444.315787, 'auction_closing_time': 1774884570.0}
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SR31558') HTTP/1.1" 204 0
2026-03-28 14:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_d1e42d0428fc8214f74947b618680658.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_d1e42d0428fc8214f74947b618680658.jpg not downloaded yet
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_b7827473b2b642b5e626ee22803365eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_b7827473b2b642b5e626ee22803365eb.jpg not downloaded yet
2026-03-28 14:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP11090> (referer: https://www.auto1.com/v1/car-details-view/SP11090/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_804912dbe14f13a31b753b7ea1e68c2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_804912dbe14f13a31b753b7ea1e68c2d.jpg not downloaded yet
2026-03-28 14:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_456e11437d5098a101e78530e039a153.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_456e11437d5098a101e78530e039a153.jpg not downloaded yet
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_5cfd85d4a15d1726d8e96356a56dbfb9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_5cfd85d4a15d1726d8e96356a56dbfb9.jpg not downloaded yet
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_227f44d8759d4b1144cab8982062057f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_227f44d8759d4b1144cab8982062057f.jpg not downloaded yet
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_550168af334ec46580bf85d00ee01774.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_550168af334ec46580bf85d00ee01774.jpg not downloaded yet
2026-03-28 14:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c884f06-02e6-5499-aef7-f6338cf93b37 with identifier: SP11090
2026-03-28 14:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c884f06-02e6-5499-aef7-f6338cf93b37 with scrape type 1
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4c884f06-02e6-5499-aef7-f6338cf93b37
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F627502e6fa0b7f84dea5f15d8f776024%252Fpa%252FSP11090_bb90bbf72d204ba3d52bff2f47d23b72.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_bb90bbf72d204ba3d52bff2f47d23b72.jpg not downloaded yet
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F627502e6fa0b7f84dea5f15d8f776024%252Fpa%252FSP11090_803ac6a3ef65e4e8a04679ac7c2a2364.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_803ac6a3ef65e4e8a04679ac7c2a2364.jpg not downloaded yet
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F627502e6fa0b7f84dea5f15d8f776024%252Fpa%252FSP11090_37a6d106c674beee6ac337398a427d59.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_37a6d106c674beee6ac337398a427d59.jpg not downloaded yet
2026-03-28 14:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_b5ce9ef12a9fc9938ed044dbb53796fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F627502e6fa0b7f84dea5f15d8f776024%252Fpa%252FSP11090_3acb0dc0ebcc8a0071e6842b43c850da.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_3acb0dc0ebcc8a0071e6842b43c850da.jpg not downloaded yet
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F627502e6fa0b7f84dea5f15d8f776024%252Fpa%252FSP11090_b4e0307cf47bd3bf731fa9e479a23b19.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_b4e0307cf47bd3bf731fa9e479a23b19.jpg not downloaded yet
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F627502e6fa0b7f84dea5f15d8f776024%252Fpa%252FSP11090_07a3e6d35b021ef5b1fc13581fb909e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_07a3e6d35b021ef5b1fc13581fb909e8.jpg not downloaded yet
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686e63d0>
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_b5ce9ef12a9fc9938ed044dbb53796fb.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_b5ce9ef12a9fc9938ed044dbb53796fb.jpg saved to cache
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5cfbecb0-2039-5421-a812-e290ec86b875
2026-03-28 14:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_37a6d106c674beee6ac337398a427d59.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_07a3e6d35b021ef5b1fc13581fb909e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686e4590>
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c884f06-02e6-5499-aef7-f6338cf93b37/4c884f06-02e6-5499-aef7-f6338cf93b37_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F627502e6fa0b7f84dea5f15d8f776024%252Fpa%252FSP11090_37a6d106c674beee6ac337398a427d59.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_37a6d106c674beee6ac337398a427d59.jpg saved to cache
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c884f06-02e6-5499-aef7-f6338cf93b37
2026-03-28 14:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_b4e0307cf47bd3bf731fa9e479a23b19.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c4cb090>
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c884f06-02e6-5499-aef7-f6338cf93b37/4c884f06-02e6-5499-aef7-f6338cf93b37_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F627502e6fa0b7f84dea5f15d8f776024%252Fpa%252FSP11090_07a3e6d35b021ef5b1fc13581fb909e8.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_07a3e6d35b021ef5b1fc13581fb909e8.jpg saved to cache
2026-03-28 14:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c884f06-02e6-5499-aef7-f6338cf93b37
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687b2c10>
2026-03-28 14:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c884f06-02e6-5499-aef7-f6338cf93b37/4c884f06-02e6-5499-aef7-f6338cf93b37_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F627502e6fa0b7f84dea5f15d8f776024%252Fpa%252FSP11090_b4e0307cf47bd3bf731fa9e479a23b19.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_b4e0307cf47bd3bf731fa9e479a23b19.jpg saved to cache
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c884f06-02e6-5499-aef7-f6338cf93b37
2026-03-28 14:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_3acb0dc0ebcc8a0071e6842b43c850da.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA32126> (referer: https://www.auto1.com/v1/car-details-view/EA32126/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_803ac6a3ef65e4e8a04679ac7c2a2364.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP47447> (referer: https://www.auto1.com/v1/car-details-view/XP47447/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687a1dd0>
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c884f06-02e6-5499-aef7-f6338cf93b37/4c884f06-02e6-5499-aef7-f6338cf93b37_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F627502e6fa0b7f84dea5f15d8f776024%252Fpa%252FSP11090_3acb0dc0ebcc8a0071e6842b43c850da.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_3acb0dc0ebcc8a0071e6842b43c850da.jpg saved to cache
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c884f06-02e6-5499-aef7-f6338cf93b37
2026-03-28 14:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_bb90bbf72d204ba3d52bff2f47d23b72.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY23078> (referer: https://www.auto1.com/v1/car-details-view/MY23078/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c3dcf52-5d0f-519b-a832-6173e69a6505 with identifier: EA32126
2026-03-28 14:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c3dcf52-5d0f-519b-a832-6173e69a6505 with scrape type 1
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c3dcf52-5d0f-519b-a832-6173e69a6505
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_ac470572d2a2a18b283cd9e1f2ba9f77.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_ac470572d2a2a18b283cd9e1f2ba9f77.jpg not downloaded yet
2026-03-28 14:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_227f44d8759d4b1144cab8982062057f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_5c5afeade6f683ad49e05b238bfc491c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_5c5afeade6f683ad49e05b238bfc491c.jpg not downloaded yet
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_3d9db8f7ac92cdb51a1aa7dad6a5c463.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_3d9db8f7ac92cdb51a1aa7dad6a5c463.jpg not downloaded yet
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168747710>
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c884f06-02e6-5499-aef7-f6338cf93b37/4c884f06-02e6-5499-aef7-f6338cf93b37_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F627502e6fa0b7f84dea5f15d8f776024%252Fpa%252FSP11090_803ac6a3ef65e4e8a04679ac7c2a2364.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_803ac6a3ef65e4e8a04679ac7c2a2364.jpg saved to cache
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c884f06-02e6-5499-aef7-f6338cf93b37
2026-03-28 14:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce0d1adc-f80b-5c6f-9999-2b7a097cd837 with identifier: XP47447
2026-03-28 14:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837 with scrape type 1
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_a92710a9d381527d3f9a87171a9d6392.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_a92710a9d381527d3f9a87171a9d6392.jpg not downloaded yet
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_f9dea99ba4da231b6e5676c32b765c80.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_f9dea99ba4da231b6e5676c32b765c80.jpg not downloaded yet
2026-03-28 14:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_5cfd85d4a15d1726d8e96356a56dbfb9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_550168af334ec46580bf85d00ee01774.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_124b8386e74e1602fcaa9d273c22cedf.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_124b8386e74e1602fcaa9d273c22cedf.jpg not downloaded yet
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a331ad0>
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c884f06-02e6-5499-aef7-f6338cf93b37/4c884f06-02e6-5499-aef7-f6338cf93b37_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F627502e6fa0b7f84dea5f15d8f776024%252Fpa%252FSP11090_bb90bbf72d204ba3d52bff2f47d23b72.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_bb90bbf72d204ba3d52bff2f47d23b72.jpg saved to cache
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c884f06-02e6-5499-aef7-f6338cf93b37
2026-03-28 14:00:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c884f06-02e6-5499-aef7-f6338cf93b37, skipping ID generation
2026-03-28 14:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c884f06-02e6-5499-aef7-f6338cf93b37 with scrape type 1
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c884f06-02e6-5499-aef7-f6338cf93b37 sending to next pipeline
2026-03-28 14:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c884f06-02e6-5499-aef7-f6338cf93b37, identifier: SP11090
2026-03-28 14:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2cf181d-c6e9-579c-b701-c984e3ae6186 with identifier: MY23078
2026-03-28 14:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2cf181d-c6e9-579c-b701-c984e3ae6186 with scrape type 1
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c2cf181d-c6e9-579c-b701-c984e3ae6186
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Ff0%252F03f005c48ea1a45f82882b52338c5dbb%252Fpa%252FMY23078_13e4b3dc99dd01a41c01b676ccea28eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_13e4b3dc99dd01a41c01b676ccea28eb.jpg already downloaded
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Ff0%252F03f005c48ea1a45f82882b52338c5dbb%252Fpa%252FMY23078_f9ad87119920d8ed337b532786310c86.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_f9ad87119920d8ed337b532786310c86.jpg already downloaded
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Ff0%252F03f005c48ea1a45f82882b52338c5dbb%252Fpa%252FMY23078_8bc0db9ecbd8703bbec8ad97ee00b5f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_8bc0db9ecbd8703bbec8ad97ee00b5f1.jpg already downloaded
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Ff0%252F03f005c48ea1a45f82882b52338c5dbb%252Fpa%252FMY23078_97dfd87105425f37b27bbddb23c089c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_97dfd87105425f37b27bbddb23c089c8.jpg already downloaded
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Ff0%252F03f005c48ea1a45f82882b52338c5dbb%252Fpa%252FMY23078_43f1ee1eddd2c0385b6160814546c102.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_43f1ee1eddd2c0385b6160814546c102.jpg already downloaded
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Ff0%252F03f005c48ea1a45f82882b52338c5dbb%252Fpa%252FMY23078_3c483c4c72600ade85e78854e805e44c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_3c483c4c72600ade85e78854e805e44c.jpg already downloaded
2026-03-28 14:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c2cf181d-c6e9-579c-b701-c984e3ae6186, identifier: MY23078
2026-03-28 14:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_ac470572d2a2a18b283cd9e1f2ba9f77.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_11cd98edd9540697db9a5c574922e103.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_11cd98edd9540697db9a5c574922e103.jpg not downloaded yet
2026-03-28 14:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC82698> (referer: https://www.auto1.com/v1/car-details-view/BC82698/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c884f06-02e6-5499-aef7-f6338cf93b37 with identifier: SP11090
2026-03-28 14:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c884f06-02e6-5499-aef7-f6338cf93b37 with identifier: SP11090
2026-03-28 14:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4c884f06-02e6-5499-aef7-f6338cf93b37 with identifier: SP11090 to the API
2026-03-28 14:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_bb90bbf72d204ba3d52bff2f47d23b72.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:44:50Z',
 'fuel_type': 'diesel',
 'id': '4c884f06-02e6-5499-aef7-f6338cf93b37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP11090',
 'listing': 'auction',
 'location': 'ES, Córdoba',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 168947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c884f06-02e6-5499-aef7-f6338cf93b37/4c884f06-02e6-5499-aef7-f6338cf93b37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_bb90bbf72d204ba3d52bff2f47d23b72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c884f06-02e6-5499-aef7-f6338cf93b37/4c884f06-02e6-5499-aef7-f6338cf93b37_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_803ac6a3ef65e4e8a04679ac7c2a2364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c884f06-02e6-5499-aef7-f6338cf93b37/4c884f06-02e6-5499-aef7-f6338cf93b37_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_37a6d106c674beee6ac337398a427d59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c884f06-02e6-5499-aef7-f6338cf93b37/4c884f06-02e6-5499-aef7-f6338cf93b37_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_3acb0dc0ebcc8a0071e6842b43c850da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c884f06-02e6-5499-aef7-f6338cf93b37/4c884f06-02e6-5499-aef7-f6338cf93b37_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_b4e0307cf47bd3bf731fa9e479a23b19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c884f06-02e6-5499-aef7-f6338cf93b37/4c884f06-02e6-5499-aef7-f6338cf93b37_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/627502e6fa0b7f84dea5f15d8f776024/pa/SP11090_07a3e6d35b021ef5b1fc13581fb909e8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.9 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2006}
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP11090%27 HTTP/1.1" 200 None
2026-03-28 14:00:46 [auto1.es] INFO: Saving data for SP11090: {'created_time': 1774706446.252188, 'last_price_update_time': 1774706446.252203, 'auction_closing_time': 1774885490.0}
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SP11090') HTTP/1.1" 204 0
2026-03-28 14:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c2cf181d-c6e9-579c-b701-c984e3ae6186 with identifier: MY23078
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 14:00:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c2cf181d-c6e9-579c-b701-c984e3ae6186 with identifier: MY23078
2026-03-28 14:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c2cf181d-c6e9-579c-b701-c984e3ae6186 with identifier: MY23078 to the API
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MY23078>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:54:11Z',
 'fuel_type': 'diesel',
 'id': 'c2cf181d-c6e9-579c-b701-c984e3ae6186',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY23078',
 'listing': 'auction',
 'location': 'ES, A Coruña',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_13e4b3dc99dd01a41c01b676ccea28eb.jpg',
                'https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_f9ad87119920d8ed337b532786310c86.jpg',
                'https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_8bc0db9ecbd8703bbec8ad97ee00b5f1.jpg',
                'https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_97dfd87105425f37b27bbddb23c089c8.jpg',
                'https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_43f1ee1eddd2c0385b6160814546c102.jpg',
                'https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_3c483c4c72600ade85e78854e805e44c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2cf181d-c6e9-579c-b701-c984e3ae6186/c2cf181d-c6e9-579c-b701-c984e3ae6186_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_13e4b3dc99dd01a41c01b676ccea28eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2cf181d-c6e9-579c-b701-c984e3ae6186/c2cf181d-c6e9-579c-b701-c984e3ae6186_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_f9ad87119920d8ed337b532786310c86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2cf181d-c6e9-579c-b701-c984e3ae6186/c2cf181d-c6e9-579c-b701-c984e3ae6186_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_8bc0db9ecbd8703bbec8ad97ee00b5f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2cf181d-c6e9-579c-b701-c984e3ae6186/c2cf181d-c6e9-579c-b701-c984e3ae6186_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_97dfd87105425f37b27bbddb23c089c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2cf181d-c6e9-579c-b701-c984e3ae6186/c2cf181d-c6e9-579c-b701-c984e3ae6186_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_43f1ee1eddd2c0385b6160814546c102.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2cf181d-c6e9-579c-b701-c984e3ae6186/c2cf181d-c6e9-579c-b701-c984e3ae6186_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/f0/03f005c48ea1a45f82882b52338c5dbb/pa/MY23078_3c483c4c72600ade85e78854e805e44c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-05-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira 2.2 DTI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2005}
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY23078%27 HTTP/1.1" 200 None
2026-03-28 14:00:46 [auto1.es] INFO: Saving data for MY23078: {'created_time': 1774706446.726254, 'last_price_update_time': 1774706446.726265, 'auction_closing_time': 1774886051.0}
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MY23078') HTTP/1.1" 204 0
2026-03-28 14:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_456e11437d5098a101e78530e039a153.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_354c28764ad8ead549e10be2ad97d62e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_354c28764ad8ead549e10be2ad97d62e.jpg not downloaded yet
2026-03-28 14:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff169fc0050>
2026-03-28 14:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_227f44d8759d4b1144cab8982062057f.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_227f44d8759d4b1144cab8982062057f.jpg saved to cache
2026-03-28 14:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5cfbecb0-2039-5421-a812-e290ec86b875
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_9026c4ad183d42afb2320a6f0635a740.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_9026c4ad183d42afb2320a6f0635a740.jpg not downloaded yet
2026-03-28 14:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK05159> (referer: https://www.auto1.com/v1/car-details-view/DK05159/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff169fe5890>
2026-03-28 14:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_5cfd85d4a15d1726d8e96356a56dbfb9.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_5cfd85d4a15d1726d8e96356a56dbfb9.jpg saved to cache
2026-03-28 14:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5cfbecb0-2039-5421-a812-e290ec86b875
2026-03-28 14:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0f1150>
2026-03-28 14:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_550168af334ec46580bf85d00ee01774.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_550168af334ec46580bf85d00ee01774.jpg saved to cache
2026-03-28 14:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5cfbecb0-2039-5421-a812-e290ec86b875
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_45e9298fc8c46353d42f58503c5b354f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_45e9298fc8c46353d42f58503c5b354f.jpg not downloaded yet
2026-03-28 14:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK26154/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TT65809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_a92710a9d381527d3f9a87171a9d6392.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_3d9db8f7ac92cdb51a1aa7dad6a5c463.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_ba8e75dd440c82fec5a0ee78b9cb5c5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_ba8e75dd440c82fec5a0ee78b9cb5c5e.jpg not downloaded yet
2026-03-28 14:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c4b63d0>
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_ac470572d2a2a18b283cd9e1f2ba9f77.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_ac470572d2a2a18b283cd9e1f2ba9f77.jpg saved to cache
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c3dcf52-5d0f-519b-a832-6173e69a6505
2026-03-28 14:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a296372-def5-5367-b7a2-2dd036c68a37 with identifier: BC82698
2026-03-28 14:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a296372-def5-5367-b7a2-2dd036c68a37 with scrape type 1
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a296372-def5-5367-b7a2-2dd036c68a37
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_39cae7fd5936da62ce3f18968f1f9634.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_39cae7fd5936da62ce3f18968f1f9634.jpg not downloaded yet
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff17948eb50>
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_456e11437d5098a101e78530e039a153.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_456e11437d5098a101e78530e039a153.jpg saved to cache
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5cfbecb0-2039-5421-a812-e290ec86b875
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_77cdbc0a0582c7ca1e8f38b646f30fed.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_77cdbc0a0582c7ca1e8f38b646f30fed.jpg not downloaded yet
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_2d8c3d2e353f1a9f6f84c1947890ac02.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_2d8c3d2e353f1a9f6f84c1947890ac02.jpg not downloaded yet
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_ef5909be193d8aa64e99da8432cef396.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_ef5909be193d8aa64e99da8432cef396.jpg not downloaded yet
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_f9dea99ba4da231b6e5676c32b765c80.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_4a2dc10b15d895c7103d45d5bba93608.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_4a2dc10b15d895c7103d45d5bba93608.jpg not downloaded yet
2026-03-28 14:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 951c9296-f90a-5f43-994c-cc6624312f10 with identifier: DK05159
2026-03-28 14:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 951c9296-f90a-5f43-994c-cc6624312f10 with scrape type 1
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 951c9296-f90a-5f43-994c-cc6624312f10
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_f31379d1bbfdd1312e468b184adff2a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_f31379d1bbfdd1312e468b184adff2a3.jpg not downloaded yet
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a106350>
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_a92710a9d381527d3f9a87171a9d6392.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_a92710a9d381527d3f9a87171a9d6392.jpg saved to cache
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1d4d10>
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_3d9db8f7ac92cdb51a1aa7dad6a5c463.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_3d9db8f7ac92cdb51a1aa7dad6a5c463.jpg saved to cache
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c3dcf52-5d0f-519b-a832-6173e69a6505
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_124b8386e74e1602fcaa9d273c22cedf.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_d89558f3124f8ca1cecfefb9452bbfd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_d89558f3124f8ca1cecfefb9452bbfd6.jpg not downloaded yet
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_441257433b3f7e0cae9fee10caffe859.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_441257433b3f7e0cae9fee10caffe859.jpg not downloaded yet
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_5c5afeade6f683ad49e05b238bfc491c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_354c28764ad8ead549e10be2ad97d62e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_11cd98edd9540697db9a5c574922e103.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_01f14978f735db58a1323ceefbe55ef8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_01f14978f735db58a1323ceefbe55ef8.jpg not downloaded yet
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_1a2a8b06f659923d99c7d092bad772e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_1a2a8b06f659923d99c7d092bad772e7.jpg not downloaded yet
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS39016/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_804912dbe14f13a31b753b7ea1e68c2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_9026c4ad183d42afb2320a6f0635a740.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_3bd24779a9f055a21661dba5bbd1d0e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_3bd24779a9f055a21661dba5bbd1d0e5.jpg not downloaded yet
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_41012fdf1e1b767301fbfa92a568ccd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_41012fdf1e1b767301fbfa92a568ccd9.jpg not downloaded yet
2026-03-28 14:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT82365/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a178890>
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_f9dea99ba4da231b6e5676c32b765c80.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_f9dea99ba4da231b6e5676c32b765c80.jpg saved to cache
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c3dcf52-5d0f-519b-a832-6173e69a6505
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_05b1faa31659c17228890c9d4fdc21a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_05b1faa31659c17228890c9d4fdc21a4.jpg not downloaded yet
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_9d1223970c0c70cc27223087be8254d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_9d1223970c0c70cc27223087be8254d3.jpg not downloaded yet
2026-03-28 14:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_2b6ef92ebaabb4cb9d59d4dd0d7411f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_2b6ef92ebaabb4cb9d59d4dd0d7411f9.jpg not downloaded yet
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a03ee50>
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_124b8386e74e1602fcaa9d273c22cedf.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_124b8386e74e1602fcaa9d273c22cedf.jpg saved to cache
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_ef5909be193d8aa64e99da8432cef396.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_6ed071c4962d547e0cbdfa2069ad295e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_6ed071c4962d547e0cbdfa2069ad295e.jpg not downloaded yet
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_111af6e15061d7e4027e06b07b4d9807.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_111af6e15061d7e4027e06b07b4d9807.jpg not downloaded yet
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168603550>
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_5c5afeade6f683ad49e05b238bfc491c.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_5c5afeade6f683ad49e05b238bfc491c.jpg saved to cache
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c3dcf52-5d0f-519b-a832-6173e69a6505
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16862a9d0>
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_354c28764ad8ead549e10be2ad97d62e.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_354c28764ad8ead549e10be2ad97d62e.jpg saved to cache
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168632b10>
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_11cd98edd9540697db9a5c574922e103.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_11cd98edd9540697db9a5c574922e103.jpg saved to cache
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c3dcf52-5d0f-519b-a832-6173e69a6505
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_77cdbc0a0582c7ca1e8f38b646f30fed.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_f31379d1bbfdd1312e468b184adff2a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_da90ee3ab3215e42bb8946a3259ebc14.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_da90ee3ab3215e42bb8946a3259ebc14.jpg not downloaded yet
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a218a10>
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_804912dbe14f13a31b753b7ea1e68c2d.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_804912dbe14f13a31b753b7ea1e68c2d.jpg saved to cache
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5cfbecb0-2039-5421-a812-e290ec86b875
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1685bc790>
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_9026c4ad183d42afb2320a6f0635a740.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_9026c4ad183d42afb2320a6f0635a740.jpg saved to cache
2026-03-28 14:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c3dcf52-5d0f-519b-a832-6173e69a6505
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_441257433b3f7e0cae9fee10caffe859.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_4a2dc10b15d895c7103d45d5bba93608.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_d89558f3124f8ca1cecfefb9452bbfd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_0b6279c63e9de0fc672dcdfdbad20947.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_0b6279c63e9de0fc672dcdfdbad20947.jpg not downloaded yet
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_d611ff56dd8c30546c2e2853559a7e2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_d611ff56dd8c30546c2e2853559a7e2b.jpg not downloaded yet
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_b7827473b2b642b5e626ee22803365eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_1a2a8b06f659923d99c7d092bad772e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_24f5bf1b88c79c2edd504191964996b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_24f5bf1b88c79c2edd504191964996b9.jpg not downloaded yet
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD82748> (referer: https://www.auto1.com/v1/car-details-view/ZD82748/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a257c10>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_ef5909be193d8aa64e99da8432cef396.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_ef5909be193d8aa64e99da8432cef396.jpg saved to cache
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a296372-def5-5367-b7a2-2dd036c68a37
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_b184fbaf2aab4eadefdd2cf4f3c82847.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_b184fbaf2aab4eadefdd2cf4f3c82847.jpg not downloaded yet
2026-03-28 14:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1a2990>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_77cdbc0a0582c7ca1e8f38b646f30fed.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_77cdbc0a0582c7ca1e8f38b646f30fed.jpg saved to cache
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0a2110>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_f31379d1bbfdd1312e468b184adff2a3.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_f31379d1bbfdd1312e468b184adff2a3.jpg saved to cache
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 951c9296-f90a-5f43-994c-cc6624312f10
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_9d1223970c0c70cc27223087be8254d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_b7bb221016c63e9711a538e60c50ef18.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_b7bb221016c63e9711a538e60c50ef18.jpg not downloaded yet
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_111af6e15061d7e4027e06b07b4d9807.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_2b6ef92ebaabb4cb9d59d4dd0d7411f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_6d22452dd8e44d32a1e7fb2031b61e63.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_6d22452dd8e44d32a1e7fb2031b61e63.jpg not downloaded yet
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE30029> (referer: https://www.auto1.com/v1/car-details-view/HE30029/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a273a10>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_441257433b3f7e0cae9fee10caffe859.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_441257433b3f7e0cae9fee10caffe859.jpg saved to cache
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a296372-def5-5367-b7a2-2dd036c68a37
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1685ec590>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_4a2dc10b15d895c7103d45d5bba93608.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_4a2dc10b15d895c7103d45d5bba93608.jpg saved to cache
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1a16d0>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_d89558f3124f8ca1cecfefb9452bbfd6.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_d89558f3124f8ca1cecfefb9452bbfd6.jpg saved to cache
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c3dcf52-5d0f-519b-a832-6173e69a6505
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_41012fdf1e1b767301fbfa92a568ccd9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_05b1faa31659c17228890c9d4fdc21a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_c4526761dea5546c22d2e04971eba2bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_c4526761dea5546c22d2e04971eba2bc.jpg not downloaded yet
2026-03-28 14:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_da90ee3ab3215e42bb8946a3259ebc14.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_b2e290b2f51de5d3071aca2652077550.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_b2e290b2f51de5d3071aca2652077550.jpg not downloaded yet
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG87039> (referer: https://www.auto1.com/v1/car-details-view/GG87039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1685ec590>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_b7827473b2b642b5e626ee22803365eb.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_b7827473b2b642b5e626ee22803365eb.jpg saved to cache
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5cfbecb0-2039-5421-a812-e290ec86b875
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a2540d0>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_1a2a8b06f659923d99c7d092bad772e7.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_1a2a8b06f659923d99c7d092bad772e7.jpg saved to cache
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 951c9296-f90a-5f43-994c-cc6624312f10
2026-03-28 14:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61308c68-8911-556b-b566-9144f960ddb2 with identifier: ZD82748
2026-03-28 14:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61308c68-8911-556b-b566-9144f960ddb2 with scrape type 1
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 61308c68-8911-556b-b566-9144f960ddb2
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F45%252Fb1458126fdc466086134d4d3284b65fb%252Fpa%252FZD82748_8f07e2a839b3135640855453f9a123b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_8f07e2a839b3135640855453f9a123b3.jpg not downloaded yet
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c3f1d50>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_9d1223970c0c70cc27223087be8254d3.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_9d1223970c0c70cc27223087be8254d3.jpg saved to cache
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 951c9296-f90a-5f43-994c-cc6624312f10
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_6ed071c4962d547e0cbdfa2069ad295e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_fdefb423971b92110491f3b98b37fa48.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_fdefb423971b92110491f3b98b37fa48.jpg not downloaded yet
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC85026/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH49664> (referer: https://www.auto1.com/v1/car-details-view/EH49664/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686e7110>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_111af6e15061d7e4027e06b07b4d9807.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_111af6e15061d7e4027e06b07b4d9807.jpg saved to cache
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 951c9296-f90a-5f43-994c-cc6624312f10
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a22ff10>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_2b6ef92ebaabb4cb9d59d4dd0d7411f9.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_2b6ef92ebaabb4cb9d59d4dd0d7411f9.jpg saved to cache
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a296372-def5-5367-b7a2-2dd036c68a37
2026-03-28 14:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b24aa342-48ff-5010-b660-8576d8353690 with identifier: HE30029
2026-03-28 14:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b24aa342-48ff-5010-b660-8576d8353690 with scrape type 1
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b24aa342-48ff-5010-b660-8576d8353690
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_358c57f15db0f7a35819098c4997b25f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_358c57f15db0f7a35819098c4997b25f.jpg not downloaded yet
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_b184fbaf2aab4eadefdd2cf4f3c82847.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_8cb691d2eb03e66576e977a86bfc63dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_8cb691d2eb03e66576e977a86bfc63dc.jpg not downloaded yet
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F45%252Fb1458126fdc466086134d4d3284b65fb%252Fpa%252FZD82748_fbcf9397cb0fc13ee29da7a1f25779d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_fbcf9397cb0fc13ee29da7a1f25779d6.jpg not downloaded yet
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_d611ff56dd8c30546c2e2853559a7e2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_24f5bf1b88c79c2edd504191964996b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_1384d8fd0f72ba753d2ca2622595795a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_1384d8fd0f72ba753d2ca2622595795a.jpg not downloaded yet
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a373110>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_41012fdf1e1b767301fbfa92a568ccd9.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_41012fdf1e1b767301fbfa92a568ccd9.jpg saved to cache
2026-03-28 14:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a296372-def5-5367-b7a2-2dd036c68a37
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16864e650>
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_05b1faa31659c17228890c9d4fdc21a4.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_05b1faa31659c17228890c9d4fdc21a4.jpg saved to cache
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168650f90>
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_da90ee3ab3215e42bb8946a3259ebc14.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_da90ee3ab3215e42bb8946a3259ebc14.jpg saved to cache
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a296372-def5-5367-b7a2-2dd036c68a37
2026-03-28 14:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b8662a0-84eb-57e7-9db1-da6421540df2 with identifier: GG87039
2026-03-28 14:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b8662a0-84eb-57e7-9db1-da6421540df2 with scrape type 1
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b8662a0-84eb-57e7-9db1-da6421540df2
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_d45b0278ccf0f4556716a8b5b11fcc4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_d45b0278ccf0f4556716a8b5b11fcc4f.jpg not downloaded yet
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_0b6279c63e9de0fc672dcdfdbad20947.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_b7bb221016c63e9711a538e60c50ef18.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_b0f5d00bfd8ed5747324744f1cd8c53b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_b0f5d00bfd8ed5747324744f1cd8c53b.jpg not downloaded yet
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F45%252Fb1458126fdc466086134d4d3284b65fb%252Fpa%252FZD82748_677c78b01c0d8af4b42e292be04066a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_677c78b01c0d8af4b42e292be04066a2.jpg not downloaded yet
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168665ad0>
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_6ed071c4962d547e0cbdfa2069ad295e.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_6ed071c4962d547e0cbdfa2069ad295e.jpg saved to cache
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837
2026-03-28 14:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd5123f9-4788-5527-8b78-4979f3c08c97 with identifier: EH49664
2026-03-28 14:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd5123f9-4788-5527-8b78-4979f3c08c97 with scrape type 1
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item bd5123f9-4788-5527-8b78-4979f3c08c97
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9d%252F8d9d0a8180acb9ea6d7e1e9887116418%252Fpa%252FEH49664_8d70d56da5b34b0afff536c828b82e37.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_8d70d56da5b34b0afff536c828b82e37.jpg not downloaded yet
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_6d22452dd8e44d32a1e7fb2031b61e63.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_55dd3334810a84bbef65e9851bfdff8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_55dd3334810a84bbef65e9851bfdff8f.jpg not downloaded yet
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_877915db6c3803c8d96615a1fc33cd25.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_877915db6c3803c8d96615a1fc33cd25.jpg not downloaded yet
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_3bd24779a9f055a21661dba5bbd1d0e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_c4526761dea5546c22d2e04971eba2bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_01f14978f735db58a1323ceefbe55ef8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F45%252Fb1458126fdc466086134d4d3284b65fb%252Fpa%252FZD82748_e0d776c81937e850d5c458a2f5837637.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_e0d776c81937e850d5c458a2f5837637.jpg not downloaded yet
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9d%252F8d9d0a8180acb9ea6d7e1e9887116418%252Fpa%252FEH49664_6ca4d8e5b01e35d18e5ce12a3e000bbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_6ca4d8e5b01e35d18e5ce12a3e000bbd.jpg not downloaded yet
2026-03-28 14:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686ae690>
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_b184fbaf2aab4eadefdd2cf4f3c82847.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_b184fbaf2aab4eadefdd2cf4f3c82847.jpg saved to cache
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 951c9296-f90a-5f43-994c-cc6624312f10
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168711190>
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_d611ff56dd8c30546c2e2853559a7e2b.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_d611ff56dd8c30546c2e2853559a7e2b.jpg saved to cache
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 951c9296-f90a-5f43-994c-cc6624312f10
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684b7710>
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_24f5bf1b88c79c2edd504191964996b9.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_24f5bf1b88c79c2edd504191964996b9.jpg saved to cache
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a296372-def5-5367-b7a2-2dd036c68a37
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_b2e290b2f51de5d3071aca2652077550.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_8f07e2a839b3135640855453f9a123b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_291b884956c1fcedcfb6a4d7f2cac402.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_291b884956c1fcedcfb6a4d7f2cac402.jpg not downloaded yet
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_bd21134407e2c828a87d8a364c963bd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_bd21134407e2c828a87d8a364c963bd5.jpg not downloaded yet
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_358c57f15db0f7a35819098c4997b25f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F45%252Fb1458126fdc466086134d4d3284b65fb%252Fpa%252FZD82748_70e0948b2bcdc927d509e3e42c0371ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_70e0948b2bcdc927d509e3e42c0371ed.jpg not downloaded yet
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9d%252F8d9d0a8180acb9ea6d7e1e9887116418%252Fpa%252FEH49664_298a3a40fad61aaf66d9d321e852de5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_298a3a40fad61aaf66d9d321e852de5f.jpg not downloaded yet
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_2d8c3d2e353f1a9f6f84c1947890ac02.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_c3e199139307322b1fafe1432d8405c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_c3e199139307322b1fafe1432d8405c8.jpg not downloaded yet
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_89ded061d260a57d977e918a2fb1159f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_89ded061d260a57d977e918a2fb1159f.jpg not downloaded yet
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK26154> (referer: https://www.auto1.com/v1/car-details-view/JK26154/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TT65809> (referer: https://www.auto1.com/v1/car-details-view/TT65809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a2fb790>
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_0b6279c63e9de0fc672dcdfdbad20947.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_0b6279c63e9de0fc672dcdfdbad20947.jpg saved to cache
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a087490>
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_b7bb221016c63e9711a538e60c50ef18.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_b7bb221016c63e9711a538e60c50ef18.jpg saved to cache
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a296372-def5-5367-b7a2-2dd036c68a37
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684dd890>
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_6d22452dd8e44d32a1e7fb2031b61e63.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_6d22452dd8e44d32a1e7fb2031b61e63.jpg saved to cache
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 951c9296-f90a-5f43-994c-cc6624312f10
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168670a50>
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_3bd24779a9f055a21661dba5bbd1d0e5.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_3bd24779a9f055a21661dba5bbd1d0e5.jpg saved to cache
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c3dcf52-5d0f-519b-a832-6173e69a6505
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686e7b10>
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_c4526761dea5546c22d2e04971eba2bc.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_c4526761dea5546c22d2e04971eba2bc.jpg saved to cache
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a296372-def5-5367-b7a2-2dd036c68a37
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0850d0>
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_01f14978f735db58a1323ceefbe55ef8.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_01f14978f735db58a1323ceefbe55ef8.jpg saved to cache
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_fdefb423971b92110491f3b98b37fa48.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_b0f5d00bfd8ed5747324744f1cd8c53b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F45%252Fb1458126fdc466086134d4d3284b65fb%252Fpa%252FZD82748_fdc167893a884afd04949b0b1cdc2ff0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_fdc167893a884afd04949b0b1cdc2ff0.jpg not downloaded yet
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9d%252F8d9d0a8180acb9ea6d7e1e9887116418%252Fpa%252FEH49664_ac9b279114ad2ea64eca953b8aa6877f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_ac9b279114ad2ea64eca953b8aa6877f.jpg not downloaded yet
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_677c78b01c0d8af4b42e292be04066a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_7bc15884f5db3450bdfb533b89900494.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_7bc15884f5db3450bdfb533b89900494.jpg not downloaded yet
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_4d26f0629feab62adb274544e6514c22.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_4d26f0629feab62adb274544e6514c22.jpg not downloaded yet
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_fbcf9397cb0fc13ee29da7a1f25779d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_8cb691d2eb03e66576e977a86bfc63dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_8d70d56da5b34b0afff536c828b82e37.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9d%252F8d9d0a8180acb9ea6d7e1e9887116418%252Fpa%252FEH49664_34b3b0ba3499323dae717b08de9a34d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_34b3b0ba3499323dae717b08de9a34d2.jpg not downloaded yet
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684dc490>
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_b2e290b2f51de5d3071aca2652077550.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_b2e290b2f51de5d3071aca2652077550.jpg saved to cache
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 951c9296-f90a-5f43-994c-cc6624312f10
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a185110>
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61308c68-8911-556b-b566-9144f960ddb2/61308c68-8911-556b-b566-9144f960ddb2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F45%252Fb1458126fdc466086134d4d3284b65fb%252Fpa%252FZD82748_8f07e2a839b3135640855453f9a123b3.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_8f07e2a839b3135640855453f9a123b3.jpg saved to cache
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61308c68-8911-556b-b566-9144f960ddb2
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a232490>
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_358c57f15db0f7a35819098c4997b25f.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_358c57f15db0f7a35819098c4997b25f.jpg saved to cache
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b24aa342-48ff-5010-b660-8576d8353690
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a185710>
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_2d8c3d2e353f1a9f6f84c1947890ac02.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_2d8c3d2e353f1a9f6f84c1947890ac02.jpg saved to cache
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c3dcf52-5d0f-519b-a832-6173e69a6505
2026-03-28 14:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 170845b3-bf94-5eb3-939a-5aba1bda1d50 with identifier: JK26154
2026-03-28 14:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 170845b3-bf94-5eb3-939a-5aba1bda1d50 with scrape type 1
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 170845b3-bf94-5eb3-939a-5aba1bda1d50
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F21%252F76216222eca08709c5e88e9bba12e342%252Fpa%252FJK26154_86a06ec8a9fd8aebe2c1529e7dc2b2b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_86a06ec8a9fd8aebe2c1529e7dc2b2b1.jpg not downloaded yet
2026-03-28 14:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20b2eae5-3619-5176-9fb9-4f816d77eef4 with identifier: TT65809
2026-03-28 14:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20b2eae5-3619-5176-9fb9-4f816d77eef4 with scrape type 1
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 20b2eae5-3619-5176-9fb9-4f816d77eef4
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3c%252F213c172f171592a652e52ad4653b606a%252Fpa%252FTT65809_87e38d07c432e18ce44c899a9f8c19b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_87e38d07c432e18ce44c899a9f8c19b4.jpg not downloaded yet
2026-03-28 14:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_877915db6c3803c8d96615a1fc33cd25.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_3f1c781a85933671036c6b0d5a631746.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_3f1c781a85933671036c6b0d5a631746.jpg not downloaded yet
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_75856d045b94cf4c9389750ec2035651.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_75856d045b94cf4c9389750ec2035651.jpg not downloaded yet
2026-03-28 14:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_bd21134407e2c828a87d8a364c963bd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9d%252F8d9d0a8180acb9ea6d7e1e9887116418%252Fpa%252FEH49664_087b0bca53d8aee7e13a344d06faa702.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_087b0bca53d8aee7e13a344d06faa702.jpg not downloaded yet
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F21%252F76216222eca08709c5e88e9bba12e342%252Fpa%252FJK26154_9abedba4f5782fcfe719ee823d6c8e87.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_9abedba4f5782fcfe719ee823d6c8e87.jpg not downloaded yet
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3c%252F213c172f171592a652e52ad4653b606a%252Fpa%252FTT65809_cd8adfa6a4e8a932426ff0118a7fd85e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_cd8adfa6a4e8a932426ff0118a7fd85e.jpg not downloaded yet
2026-03-28 14:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_55dd3334810a84bbef65e9851bfdff8f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_291b884956c1fcedcfb6a4d7f2cac402.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_8a69c7c0874e7b07aeebe30b09b359f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_8a69c7c0874e7b07aeebe30b09b359f4.jpg not downloaded yet
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_c4ac85bbbd292beec9d7b03259614485.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_c4ac85bbbd292beec9d7b03259614485.jpg not downloaded yet
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168501e50>
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_fdefb423971b92110491f3b98b37fa48.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_fdefb423971b92110491f3b98b37fa48.jpg saved to cache
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a296372-def5-5367-b7a2-2dd036c68a37
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff169fcd410>
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_b0f5d00bfd8ed5747324744f1cd8c53b.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_b0f5d00bfd8ed5747324744f1cd8c53b.jpg saved to cache
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 951c9296-f90a-5f43-994c-cc6624312f10
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0a5890>
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61308c68-8911-556b-b566-9144f960ddb2/61308c68-8911-556b-b566-9144f960ddb2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F45%252Fb1458126fdc466086134d4d3284b65fb%252Fpa%252FZD82748_677c78b01c0d8af4b42e292be04066a2.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_677c78b01c0d8af4b42e292be04066a2.jpg saved to cache
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61308c68-8911-556b-b566-9144f960ddb2
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a167710>
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61308c68-8911-556b-b566-9144f960ddb2/61308c68-8911-556b-b566-9144f960ddb2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F45%252Fb1458126fdc466086134d4d3284b65fb%252Fpa%252FZD82748_fbcf9397cb0fc13ee29da7a1f25779d6.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_fbcf9397cb0fc13ee29da7a1f25779d6.jpg saved to cache
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61308c68-8911-556b-b566-9144f960ddb2
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687ab050>
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F97%252F73971fafd697b6d9dcdfc1b55981cf6f%252Fpa%252FDK05159_8cb691d2eb03e66576e977a86bfc63dc.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_8cb691d2eb03e66576e977a86bfc63dc.jpg saved to cache
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 951c9296-f90a-5f43-994c-cc6624312f10
2026-03-28 14:00:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 951c9296-f90a-5f43-994c-cc6624312f10, skipping ID generation
2026-03-28 14:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 951c9296-f90a-5f43-994c-cc6624312f10 with scrape type 1
2026-03-28 14:00:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 951c9296-f90a-5f43-994c-cc6624312f10 sending to next pipeline
2026-03-28 14:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 951c9296-f90a-5f43-994c-cc6624312f10, identifier: DK05159
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168502d10>
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5123f9-4788-5527-8b78-4979f3c08c97/bd5123f9-4788-5527-8b78-4979f3c08c97_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9d%252F8d9d0a8180acb9ea6d7e1e9887116418%252Fpa%252FEH49664_8d70d56da5b34b0afff536c828b82e37.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_8d70d56da5b34b0afff536c828b82e37.jpg saved to cache
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd5123f9-4788-5527-8b78-4979f3c08c97
2026-03-28 14:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_ac9b279114ad2ea64eca953b8aa6877f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F21%252F76216222eca08709c5e88e9bba12e342%252Fpa%252FJK26154_579a3813a43d026ecafbeee4ceda0515.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_579a3813a43d026ecafbeee4ceda0515.jpg not downloaded yet
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3c%252F213c172f171592a652e52ad4653b606a%252Fpa%252FTT65809_bd30ba28de98eed571f8e868489ce430.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_bd30ba28de98eed571f8e868489ce430.jpg not downloaded yet
2026-03-28 14:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 951c9296-f90a-5f43-994c-cc6624312f10 with identifier: DK05159
2026-03-28 14:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 951c9296-f90a-5f43-994c-cc6624312f10 with identifier: DK05159
2026-03-28 14:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 951c9296-f90a-5f43-994c-cc6624312f10 with identifier: DK05159 to the API
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_8cb691d2eb03e66576e977a86bfc63dc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:54:47Z',
 'fuel_type': 'diesel',
 'id': '951c9296-f90a-5f43-994c-cc6624312f10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK05159',
 'listing': 'auction',
 'location': 'ES, Basauri',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 179478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_f31379d1bbfdd1312e468b184adff2a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_1a2a8b06f659923d99c7d092bad772e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_9d1223970c0c70cc27223087be8254d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_111af6e15061d7e4027e06b07b4d9807.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_d611ff56dd8c30546c2e2853559a7e2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_b184fbaf2aab4eadefdd2cf4f3c82847.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_6d22452dd8e44d32a1e7fb2031b61e63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_b2e290b2f51de5d3071aca2652077550.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_8cb691d2eb03e66576e977a86bfc63dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951c9296-f90a-5f43-994c-cc6624312f10/951c9296-f90a-5f43-994c-cc6624312f10_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/97/73971fafd697b6d9dcdfc1b55981cf6f/pa/DK05159_b0f5d00bfd8ed5747324744f1cd8c53b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DK05159%27 HTTP/1.1" 200 None
2026-03-28 14:00:51 [auto1.es] INFO: Saving data for DK05159: {'created_time': 1774706451.523163, 'last_price_update_time': 1774706451.523172, 'auction_closing_time': 1774886087.0}
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DK05159') HTTP/1.1" 204 0
2026-03-28 14:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_298a3a40fad61aaf66d9d321e852de5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_6ca4d8e5b01e35d18e5ce12a3e000bbd.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_b2716253e0e4333fa357cfe010d027b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_b2716253e0e4333fa357cfe010d027b4.jpg not downloaded yet
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_de751df53d9af29feb2c95bc2b050dba.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_de751df53d9af29feb2c95bc2b050dba.jpg not downloaded yet
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1685e2c10>
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_877915db6c3803c8d96615a1fc33cd25.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_877915db6c3803c8d96615a1fc33cd25.jpg saved to cache
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b8662a0-84eb-57e7-9db1-da6421540df2
2026-03-28 14:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_e0d776c81937e850d5c458a2f5837637.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_70e0948b2bcdc927d509e3e42c0371ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F21%252F76216222eca08709c5e88e9bba12e342%252Fpa%252FJK26154_cf9719a74d78582fd4493493ca1ea7ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_cf9719a74d78582fd4493493ca1ea7ee.jpg not downloaded yet
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3c%252F213c172f171592a652e52ad4653b606a%252Fpa%252FTT65809_77e6a8999d55f5c1c73f79e4fa3813ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_77e6a8999d55f5c1c73f79e4fa3813ac.jpg not downloaded yet
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a008390>
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_bd21134407e2c828a87d8a364c963bd5.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_bd21134407e2c828a87d8a364c963bd5.jpg saved to cache
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b8662a0-84eb-57e7-9db1-da6421540df2
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16860ded0>
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_55dd3334810a84bbef65e9851bfdff8f.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_55dd3334810a84bbef65e9851bfdff8f.jpg saved to cache
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b24aa342-48ff-5010-b660-8576d8353690
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c156090>
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_291b884956c1fcedcfb6a4d7f2cac402.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_291b884956c1fcedcfb6a4d7f2cac402.jpg saved to cache
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b24aa342-48ff-5010-b660-8576d8353690
2026-03-28 14:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_89ded061d260a57d977e918a2fb1159f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_c3e199139307322b1fafe1432d8405c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_fdc167893a884afd04949b0b1cdc2ff0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_bae177a2f6fa6c74645a40fa45ffdbb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_bae177a2f6fa6c74645a40fa45ffdbb4.jpg not downloaded yet
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_059529423defc4b54335a8b9cd73ec01.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_059529423defc4b54335a8b9cd73ec01.jpg not downloaded yet
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a128390>
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5123f9-4788-5527-8b78-4979f3c08c97/bd5123f9-4788-5527-8b78-4979f3c08c97_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9d%252F8d9d0a8180acb9ea6d7e1e9887116418%252Fpa%252FEH49664_ac9b279114ad2ea64eca953b8aa6877f.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_ac9b279114ad2ea64eca953b8aa6877f.jpg saved to cache
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd5123f9-4788-5527-8b78-4979f3c08c97
2026-03-28 14:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_4d26f0629feab62adb274544e6514c22.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F21%252F76216222eca08709c5e88e9bba12e342%252Fpa%252FJK26154_c6551d180d88d475f376de923fbceaff.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_c6551d180d88d475f376de923fbceaff.jpg not downloaded yet
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3c%252F213c172f171592a652e52ad4653b606a%252Fpa%252FTT65809_e3bc17a00e21a33cb5257b4567e99b2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_e3bc17a00e21a33cb5257b4567e99b2b.jpg not downloaded yet
2026-03-28 14:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_75856d045b94cf4c9389750ec2035651.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_0503e466934c297789e475b1768fddec.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_0503e466934c297789e475b1768fddec.jpg not downloaded yet
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff169fce010>
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5123f9-4788-5527-8b78-4979f3c08c97/bd5123f9-4788-5527-8b78-4979f3c08c97_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9d%252F8d9d0a8180acb9ea6d7e1e9887116418%252Fpa%252FEH49664_298a3a40fad61aaf66d9d321e852de5f.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_298a3a40fad61aaf66d9d321e852de5f.jpg saved to cache
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd5123f9-4788-5527-8b78-4979f3c08c97
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a371590>
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5123f9-4788-5527-8b78-4979f3c08c97/bd5123f9-4788-5527-8b78-4979f3c08c97_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9d%252F8d9d0a8180acb9ea6d7e1e9887116418%252Fpa%252FEH49664_6ca4d8e5b01e35d18e5ce12a3e000bbd.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_6ca4d8e5b01e35d18e5ce12a3e000bbd.jpg saved to cache
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd5123f9-4788-5527-8b78-4979f3c08c97
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a189210>
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61308c68-8911-556b-b566-9144f960ddb2/61308c68-8911-556b-b566-9144f960ddb2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F45%252Fb1458126fdc466086134d4d3284b65fb%252Fpa%252FZD82748_e0d776c81937e850d5c458a2f5837637.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_e0d776c81937e850d5c458a2f5837637.jpg saved to cache
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61308c68-8911-556b-b566-9144f960ddb2
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687a22d0>
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61308c68-8911-556b-b566-9144f960ddb2/61308c68-8911-556b-b566-9144f960ddb2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F45%252Fb1458126fdc466086134d4d3284b65fb%252Fpa%252FZD82748_70e0948b2bcdc927d509e3e42c0371ed.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_70e0948b2bcdc927d509e3e42c0371ed.jpg saved to cache
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61308c68-8911-556b-b566-9144f960ddb2
2026-03-28 14:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_87e38d07c432e18ce44c899a9f8c19b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_3f1c781a85933671036c6b0d5a631746.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F21%252F76216222eca08709c5e88e9bba12e342%252Fpa%252FJK26154_f44e05c4d304f09b1c0e87ca4c1cb28e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_f44e05c4d304f09b1c0e87ca4c1cb28e.jpg not downloaded yet
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3c%252F213c172f171592a652e52ad4653b606a%252Fpa%252FTT65809_b93449cb84952a450a54f6fd31b7ea37.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_b93449cb84952a450a54f6fd31b7ea37.jpg not downloaded yet
2026-03-28 14:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_c4ac85bbbd292beec9d7b03259614485.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_bd30ba28de98eed571f8e868489ce430.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_cd8adfa6a4e8a932426ff0118a7fd85e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_579a3813a43d026ecafbeee4ceda0515.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_8a69c7c0874e7b07aeebe30b09b359f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT82365> (referer: https://www.auto1.com/v1/car-details-view/AT82365/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a382bd0>
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_89ded061d260a57d977e918a2fb1159f.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_89ded061d260a57d977e918a2fb1159f.jpg saved to cache
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b8662a0-84eb-57e7-9db1-da6421540df2
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a093b90>
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_c3e199139307322b1fafe1432d8405c8.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_c3e199139307322b1fafe1432d8405c8.jpg saved to cache
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b24aa342-48ff-5010-b660-8576d8353690
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a03ffd0>
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61308c68-8911-556b-b566-9144f960ddb2/61308c68-8911-556b-b566-9144f960ddb2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F45%252Fb1458126fdc466086134d4d3284b65fb%252Fpa%252FZD82748_fdc167893a884afd04949b0b1cdc2ff0.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_fdc167893a884afd04949b0b1cdc2ff0.jpg saved to cache
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61308c68-8911-556b-b566-9144f960ddb2
2026-03-28 14:00:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61308c68-8911-556b-b566-9144f960ddb2, skipping ID generation
2026-03-28 14:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61308c68-8911-556b-b566-9144f960ddb2 with scrape type 1
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61308c68-8911-556b-b566-9144f960ddb2 sending to next pipeline
2026-03-28 14:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 61308c68-8911-556b-b566-9144f960ddb2, identifier: ZD82748
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff179d94c90>
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_4d26f0629feab62adb274544e6514c22.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_4d26f0629feab62adb274544e6514c22.jpg saved to cache
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b8662a0-84eb-57e7-9db1-da6421540df2
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a3ac710>
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_75856d045b94cf4c9389750ec2035651.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_75856d045b94cf4c9389750ec2035651.jpg saved to cache
2026-03-28 14:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b8662a0-84eb-57e7-9db1-da6421540df2
2026-03-28 14:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 61308c68-8911-556b-b566-9144f960ddb2 with identifier: ZD82748
2026-03-28 14:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 61308c68-8911-556b-b566-9144f960ddb2 with identifier: ZD82748
2026-03-28 14:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 61308c68-8911-556b-b566-9144f960ddb2 with identifier: ZD82748 to the API
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_fdc167893a884afd04949b0b1cdc2ff0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:54:52Z',
 'fuel_type': 'diesel',
 'id': '61308c68-8911-556b-b566-9144f960ddb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD82748',
 'listing': 'auction',
 'location': 'ES, Terrassa',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 263273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61308c68-8911-556b-b566-9144f960ddb2/61308c68-8911-556b-b566-9144f960ddb2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_8f07e2a839b3135640855453f9a123b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61308c68-8911-556b-b566-9144f960ddb2/61308c68-8911-556b-b566-9144f960ddb2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_fbcf9397cb0fc13ee29da7a1f25779d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61308c68-8911-556b-b566-9144f960ddb2/61308c68-8911-556b-b566-9144f960ddb2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_677c78b01c0d8af4b42e292be04066a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61308c68-8911-556b-b566-9144f960ddb2/61308c68-8911-556b-b566-9144f960ddb2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_e0d776c81937e850d5c458a2f5837637.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61308c68-8911-556b-b566-9144f960ddb2/61308c68-8911-556b-b566-9144f960ddb2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_70e0948b2bcdc927d509e3e42c0371ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61308c68-8911-556b-b566-9144f960ddb2/61308c68-8911-556b-b566-9144f960ddb2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/45/b1458126fdc466086134d4d3284b65fb/pa/ZD82748_fdc167893a884afd04949b0b1cdc2ff0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD82748%27 HTTP/1.1" 200 None
2026-03-28 14:00:53 [auto1.es] INFO: Saving data for ZD82748: {'created_time': 1774706453.024713, 'last_price_update_time': 1774706453.024724, 'auction_closing_time': 1774886092.0}
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZD82748') HTTP/1.1" 204 0
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_77e6a8999d55f5c1c73f79e4fa3813ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_9abedba4f5782fcfe719ee823d6c8e87.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_de751df53d9af29feb2c95bc2b050dba.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_b2716253e0e4333fa357cfe010d027b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC85026> (referer: https://www.auto1.com/v1/car-details-view/KC85026/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a092a50>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b2eae5-3619-5176-9fb9-4f816d77eef4/20b2eae5-3619-5176-9fb9-4f816d77eef4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3c%252F213c172f171592a652e52ad4653b606a%252Fpa%252FTT65809_87e38d07c432e18ce44c899a9f8c19b4.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_87e38d07c432e18ce44c899a9f8c19b4.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20b2eae5-3619-5176-9fb9-4f816d77eef4
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16863e490>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_3f1c781a85933671036c6b0d5a631746.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_3f1c781a85933671036c6b0d5a631746.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b24aa342-48ff-5010-b660-8576d8353690
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c169b90>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_c4ac85bbbd292beec9d7b03259614485.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_c4ac85bbbd292beec9d7b03259614485.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b8662a0-84eb-57e7-9db1-da6421540df2
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a09ee90>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b2eae5-3619-5176-9fb9-4f816d77eef4/20b2eae5-3619-5176-9fb9-4f816d77eef4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3c%252F213c172f171592a652e52ad4653b606a%252Fpa%252FTT65809_bd30ba28de98eed571f8e868489ce430.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_bd30ba28de98eed571f8e868489ce430.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20b2eae5-3619-5176-9fb9-4f816d77eef4
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0382d0>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b2eae5-3619-5176-9fb9-4f816d77eef4/20b2eae5-3619-5176-9fb9-4f816d77eef4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3c%252F213c172f171592a652e52ad4653b606a%252Fpa%252FTT65809_cd8adfa6a4e8a932426ff0118a7fd85e.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_cd8adfa6a4e8a932426ff0118a7fd85e.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20b2eae5-3619-5176-9fb9-4f816d77eef4
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16cdcec50>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170845b3-bf94-5eb3-939a-5aba1bda1d50/170845b3-bf94-5eb3-939a-5aba1bda1d50_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F21%252F76216222eca08709c5e88e9bba12e342%252Fpa%252FJK26154_579a3813a43d026ecafbeee4ceda0515.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_579a3813a43d026ecafbeee4ceda0515.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 170845b3-bf94-5eb3-939a-5aba1bda1d50
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a03bbd0>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_8a69c7c0874e7b07aeebe30b09b359f4.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_8a69c7c0874e7b07aeebe30b09b359f4.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b24aa342-48ff-5010-b660-8576d8353690
2026-03-28 14:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87f77a54-66d4-52d7-9166-30210f5e7653 with identifier: AT82365
2026-03-28 14:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f77a54-66d4-52d7-9166-30210f5e7653 with scrape type 1
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87f77a54-66d4-52d7-9166-30210f5e7653
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_823b56535c1d772f6fbaa901ce44b071.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_823b56535c1d772f6fbaa901ce44b071.jpg not downloaded yet
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_c6551d180d88d475f376de923fbceaff.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_059529423defc4b54335a8b9cd73ec01.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_e3bc17a00e21a33cb5257b4567e99b2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_c2dc7813bcd09f81934e62039f73adaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_c2dc7813bcd09f81934e62039f73adaa.jpg not downloaded yet
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_b93449cb84952a450a54f6fd31b7ea37.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_efd1edf458843d96cb1a9733eb2f5257.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_efd1edf458843d96cb1a9733eb2f5257.jpg not downloaded yet
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168527bd0>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b2eae5-3619-5176-9fb9-4f816d77eef4/20b2eae5-3619-5176-9fb9-4f816d77eef4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3c%252F213c172f171592a652e52ad4653b606a%252Fpa%252FTT65809_77e6a8999d55f5c1c73f79e4fa3813ac.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_77e6a8999d55f5c1c73f79e4fa3813ac.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20b2eae5-3619-5176-9fb9-4f816d77eef4
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a340d90>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170845b3-bf94-5eb3-939a-5aba1bda1d50/170845b3-bf94-5eb3-939a-5aba1bda1d50_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F21%252F76216222eca08709c5e88e9bba12e342%252Fpa%252FJK26154_9abedba4f5782fcfe719ee823d6c8e87.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_9abedba4f5782fcfe719ee823d6c8e87.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 170845b3-bf94-5eb3-939a-5aba1bda1d50
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16db76410>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_de751df53d9af29feb2c95bc2b050dba.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_de751df53d9af29feb2c95bc2b050dba.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b8662a0-84eb-57e7-9db1-da6421540df2
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686c1b90>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_b2716253e0e4333fa357cfe010d027b4.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_b2716253e0e4333fa357cfe010d027b4.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b24aa342-48ff-5010-b660-8576d8353690
2026-03-28 14:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2f98b8f-7c08-5680-8179-e3628f601f31 with identifier: KC85026
2026-03-28 14:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f98b8f-7c08-5680-8179-e3628f601f31 with scrape type 1
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2f98b8f-7c08-5680-8179-e3628f601f31
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_ce28bb3098fc08ab856fbfdd2b437d9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_ce28bb3098fc08ab856fbfdd2b437d9f.jpg not downloaded yet
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_16623d0811676edf9a5c0804b8099f58.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_16623d0811676edf9a5c0804b8099f58.jpg not downloaded yet
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_0503e466934c297789e475b1768fddec.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_bae177a2f6fa6c74645a40fa45ffdbb4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_7a6401b1e0e870fb8bd6750534cd3b79.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_7a6401b1e0e870fb8bd6750534cd3b79.jpg not downloaded yet
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_86a06ec8a9fd8aebe2c1529e7dc2b2b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_cf9719a74d78582fd4493493ca1ea7ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_f44e05c4d304f09b1c0e87ca4c1cb28e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_34b3b0ba3499323dae717b08de9a34d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_5a77c8920809b43d8b0052f526ff8c4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_5a77c8920809b43d8b0052f526ff8c4d.jpg not downloaded yet
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_087b0bca53d8aee7e13a344d06faa702.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_7bc15884f5db3450bdfb533b89900494.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_6f0f327ab59d2f46435570dd491780fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_6f0f327ab59d2f46435570dd491780fd.jpg not downloaded yet
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_bd6c39d691ab935ed6699f0eaafc79ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_bd6c39d691ab935ed6699f0eaafc79ec.jpg not downloaded yet
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a2a3790>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170845b3-bf94-5eb3-939a-5aba1bda1d50/170845b3-bf94-5eb3-939a-5aba1bda1d50_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F21%252F76216222eca08709c5e88e9bba12e342%252Fpa%252FJK26154_c6551d180d88d475f376de923fbceaff.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_c6551d180d88d475f376de923fbceaff.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 170845b3-bf94-5eb3-939a-5aba1bda1d50
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168528690>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_059529423defc4b54335a8b9cd73ec01.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_059529423defc4b54335a8b9cd73ec01.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b8662a0-84eb-57e7-9db1-da6421540df2
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1ab990>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b2eae5-3619-5176-9fb9-4f816d77eef4/20b2eae5-3619-5176-9fb9-4f816d77eef4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3c%252F213c172f171592a652e52ad4653b606a%252Fpa%252FTT65809_e3bc17a00e21a33cb5257b4567e99b2b.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_e3bc17a00e21a33cb5257b4567e99b2b.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20b2eae5-3619-5176-9fb9-4f816d77eef4
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168712790>
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b2eae5-3619-5176-9fb9-4f816d77eef4/20b2eae5-3619-5176-9fb9-4f816d77eef4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3c%252F213c172f171592a652e52ad4653b606a%252Fpa%252FTT65809_b93449cb84952a450a54f6fd31b7ea37.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_b93449cb84952a450a54f6fd31b7ea37.jpg saved to cache
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20b2eae5-3619-5176-9fb9-4f816d77eef4
2026-03-28 14:00:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20b2eae5-3619-5176-9fb9-4f816d77eef4, skipping ID generation
2026-03-28 14:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20b2eae5-3619-5176-9fb9-4f816d77eef4 with scrape type 1
2026-03-28 14:00:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20b2eae5-3619-5176-9fb9-4f816d77eef4 sending to next pipeline
2026-03-28 14:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 20b2eae5-3619-5176-9fb9-4f816d77eef4, identifier: TT65809
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_344742bc7700b1b9f756261f1ed52e46.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_344742bc7700b1b9f756261f1ed52e46.jpg not downloaded yet
2026-03-28 14:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 20b2eae5-3619-5176-9fb9-4f816d77eef4 with identifier: TT65809
2026-03-28 14:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 20b2eae5-3619-5176-9fb9-4f816d77eef4 with identifier: TT65809
2026-03-28 14:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 20b2eae5-3619-5176-9fb9-4f816d77eef4 with identifier: TT65809 to the API
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_b93449cb84952a450a54f6fd31b7ea37.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.8L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:45:58Z',
 'fuel_type': 'diesel',
 'id': '20b2eae5-3619-5176-9fb9-4f816d77eef4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT65809',
 'listing': 'auction',
 'location': 'ES, Huelva',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 213384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b2eae5-3619-5176-9fb9-4f816d77eef4/20b2eae5-3619-5176-9fb9-4f816d77eef4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_87e38d07c432e18ce44c899a9f8c19b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b2eae5-3619-5176-9fb9-4f816d77eef4/20b2eae5-3619-5176-9fb9-4f816d77eef4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_cd8adfa6a4e8a932426ff0118a7fd85e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b2eae5-3619-5176-9fb9-4f816d77eef4/20b2eae5-3619-5176-9fb9-4f816d77eef4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_bd30ba28de98eed571f8e868489ce430.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b2eae5-3619-5176-9fb9-4f816d77eef4/20b2eae5-3619-5176-9fb9-4f816d77eef4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_77e6a8999d55f5c1c73f79e4fa3813ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b2eae5-3619-5176-9fb9-4f816d77eef4/20b2eae5-3619-5176-9fb9-4f816d77eef4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_e3bc17a00e21a33cb5257b4567e99b2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b2eae5-3619-5176-9fb9-4f816d77eef4/20b2eae5-3619-5176-9fb9-4f816d77eef4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/3c/213c172f171592a652e52ad4653b606a/pa/TT65809_b93449cb84952a450a54f6fd31b7ea37.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 2.8 CRD Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2010}
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT65809%27 HTTP/1.1" 200 None
2026-03-28 14:00:54 [auto1.es] INFO: Saving data for TT65809: {'created_time': 1774706454.526604, 'last_price_update_time': 1774706454.526619, 'auction_closing_time': 1774885558.0}
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TT65809') HTTP/1.1" 204 0
2026-03-28 14:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_823b56535c1d772f6fbaa901ce44b071.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_d45b0278ccf0f4556716a8b5b11fcc4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_083dc8afe99444842301c4d92fc43b9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_083dc8afe99444842301c4d92fc43b9c.jpg not downloaded yet
2026-03-28 14:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_39cae7fd5936da62ce3f18968f1f9634.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_1384d8fd0f72ba753d2ca2622595795a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_45e9298fc8c46353d42f58503c5b354f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_ba8e75dd440c82fec5a0ee78b9cb5c5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_dc93b03a1b64bd291f44bccc9c638d6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_dc93b03a1b64bd291f44bccc9c638d6f.jpg not downloaded yet
2026-03-28 14:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_efd1edf458843d96cb1a9733eb2f5257.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_ce28bb3098fc08ab856fbfdd2b437d9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_34b1c3359a3ceaf0b1313e57f55e4f3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_34b1c3359a3ceaf0b1313e57f55e4f3d.jpg not downloaded yet
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_09b2956e965733d509cf4cdaf2f5af29.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_09b2956e965733d509cf4cdaf2f5af29.jpg not downloaded yet
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687270d0>
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_0503e466934c297789e475b1768fddec.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_0503e466934c297789e475b1768fddec.jpg saved to cache
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b8662a0-84eb-57e7-9db1-da6421540df2
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686b4d10>
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_bae177a2f6fa6c74645a40fa45ffdbb4.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_bae177a2f6fa6c74645a40fa45ffdbb4.jpg saved to cache
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b24aa342-48ff-5010-b660-8576d8353690
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a173c50>
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170845b3-bf94-5eb3-939a-5aba1bda1d50/170845b3-bf94-5eb3-939a-5aba1bda1d50_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F21%252F76216222eca08709c5e88e9bba12e342%252Fpa%252FJK26154_86a06ec8a9fd8aebe2c1529e7dc2b2b1.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_86a06ec8a9fd8aebe2c1529e7dc2b2b1.jpg saved to cache
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 170845b3-bf94-5eb3-939a-5aba1bda1d50
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a217710>
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170845b3-bf94-5eb3-939a-5aba1bda1d50/170845b3-bf94-5eb3-939a-5aba1bda1d50_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F21%252F76216222eca08709c5e88e9bba12e342%252Fpa%252FJK26154_cf9719a74d78582fd4493493ca1ea7ee.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_cf9719a74d78582fd4493493ca1ea7ee.jpg saved to cache
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 170845b3-bf94-5eb3-939a-5aba1bda1d50
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a03e9d0>
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_170845b3-bf94-5eb3-939a-5aba1bda1d50/170845b3-bf94-5eb3-939a-5aba1bda1d50_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F21%252F76216222eca08709c5e88e9bba12e342%252Fpa%252FJK26154_f44e05c4d304f09b1c0e87ca4c1cb28e.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_f44e05c4d304f09b1c0e87ca4c1cb28e.jpg saved to cache
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 170845b3-bf94-5eb3-939a-5aba1bda1d50
2026-03-28 14:00:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 170845b3-bf94-5eb3-939a-5aba1bda1d50, skipping ID generation
2026-03-28 14:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 170845b3-bf94-5eb3-939a-5aba1bda1d50 with scrape type 1
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 170845b3-bf94-5eb3-939a-5aba1bda1d50 sending to next pipeline
2026-03-28 14:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 170845b3-bf94-5eb3-939a-5aba1bda1d50, identifier: JK26154
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168712090>
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5123f9-4788-5527-8b78-4979f3c08c97/bd5123f9-4788-5527-8b78-4979f3c08c97_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9d%252F8d9d0a8180acb9ea6d7e1e9887116418%252Fpa%252FEH49664_34b3b0ba3499323dae717b08de9a34d2.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_34b3b0ba3499323dae717b08de9a34d2.jpg saved to cache
2026-03-28 14:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd5123f9-4788-5527-8b78-4979f3c08c97
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686b5dd0>
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5123f9-4788-5527-8b78-4979f3c08c97/bd5123f9-4788-5527-8b78-4979f3c08c97_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9d%252F8d9d0a8180acb9ea6d7e1e9887116418%252Fpa%252FEH49664_087b0bca53d8aee7e13a344d06faa702.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_087b0bca53d8aee7e13a344d06faa702.jpg saved to cache
2026-03-28 14:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd5123f9-4788-5527-8b78-4979f3c08c97
2026-03-28 14:00:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd5123f9-4788-5527-8b78-4979f3c08c97, skipping ID generation
2026-03-28 14:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd5123f9-4788-5527-8b78-4979f3c08c97 with scrape type 1
2026-03-28 14:00:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd5123f9-4788-5527-8b78-4979f3c08c97 sending to next pipeline
2026-03-28 14:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bd5123f9-4788-5527-8b78-4979f3c08c97, identifier: EH49664
2026-03-28 14:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a272b10>
2026-03-28 14:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_7bc15884f5db3450bdfb533b89900494.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_7bc15884f5db3450bdfb533b89900494.jpg saved to cache
2026-03-28 14:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b24aa342-48ff-5010-b660-8576d8353690
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_cab67b052d972e9d05c304a7ba9c5a67.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_cab67b052d972e9d05c304a7ba9c5a67.jpg not downloaded yet
2026-03-28 14:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 170845b3-bf94-5eb3-939a-5aba1bda1d50 with identifier: JK26154
2026-03-28 14:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 170845b3-bf94-5eb3-939a-5aba1bda1d50 with identifier: JK26154
2026-03-28 14:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 170845b3-bf94-5eb3-939a-5aba1bda1d50 with identifier: JK26154 to the API
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_f44e05c4d304f09b1c0e87ca4c1cb28e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:38:49Z',
 'fuel_type': 'petrol',
 'id': '170845b3-bf94-5eb3-939a-5aba1bda1d50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK26154',
 'listing': 'auction',
 'location': 'ES, Barberà del Vallès',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 109746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170845b3-bf94-5eb3-939a-5aba1bda1d50/170845b3-bf94-5eb3-939a-5aba1bda1d50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_86a06ec8a9fd8aebe2c1529e7dc2b2b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170845b3-bf94-5eb3-939a-5aba1bda1d50/170845b3-bf94-5eb3-939a-5aba1bda1d50_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_9abedba4f5782fcfe719ee823d6c8e87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170845b3-bf94-5eb3-939a-5aba1bda1d50/170845b3-bf94-5eb3-939a-5aba1bda1d50_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_579a3813a43d026ecafbeee4ceda0515.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170845b3-bf94-5eb3-939a-5aba1bda1d50/170845b3-bf94-5eb3-939a-5aba1bda1d50_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_cf9719a74d78582fd4493493ca1ea7ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170845b3-bf94-5eb3-939a-5aba1bda1d50/170845b3-bf94-5eb3-939a-5aba1bda1d50_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_c6551d180d88d475f376de923fbceaff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_170845b3-bf94-5eb3-939a-5aba1bda1d50/170845b3-bf94-5eb3-939a-5aba1bda1d50_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/21/76216222eca08709c5e88e9bba12e342/pa/JK26154_f44e05c4d304f09b1c0e87ca4c1cb28e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2007}
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK26154%27 HTTP/1.1" 200 None
2026-03-28 14:00:55 [auto1.es] INFO: Saving data for JK26154: {'created_time': 1774706455.518699, 'last_price_update_time': 1774706455.518709, 'auction_closing_time': 1774885129.0}
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JK26154') HTTP/1.1" 204 0
2026-03-28 14:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bd5123f9-4788-5527-8b78-4979f3c08c97 with identifier: EH49664
2026-03-28 14:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bd5123f9-4788-5527-8b78-4979f3c08c97 with identifier: EH49664
2026-03-28 14:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bd5123f9-4788-5527-8b78-4979f3c08c97 with identifier: EH49664 to the API
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_087b0bca53d8aee7e13a344d06faa702.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:29Z',
 'fuel_type': 'diesel',
 'id': 'bd5123f9-4788-5527-8b78-4979f3c08c97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH49664',
 'listing': 'auction',
 'location': 'ES, Alcobendas',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 228734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5123f9-4788-5527-8b78-4979f3c08c97/bd5123f9-4788-5527-8b78-4979f3c08c97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_8d70d56da5b34b0afff536c828b82e37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5123f9-4788-5527-8b78-4979f3c08c97/bd5123f9-4788-5527-8b78-4979f3c08c97_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_6ca4d8e5b01e35d18e5ce12a3e000bbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5123f9-4788-5527-8b78-4979f3c08c97/bd5123f9-4788-5527-8b78-4979f3c08c97_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_298a3a40fad61aaf66d9d321e852de5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5123f9-4788-5527-8b78-4979f3c08c97/bd5123f9-4788-5527-8b78-4979f3c08c97_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_ac9b279114ad2ea64eca953b8aa6877f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5123f9-4788-5527-8b78-4979f3c08c97/bd5123f9-4788-5527-8b78-4979f3c08c97_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_34b3b0ba3499323dae717b08de9a34d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5123f9-4788-5527-8b78-4979f3c08c97/bd5123f9-4788-5527-8b78-4979f3c08c97_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9d/8d9d0a8180acb9ea6d7e1e9887116418/pa/EH49664_087b0bca53d8aee7e13a344d06faa702.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Cruze 2.0 Diesel LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2011}
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH49664%27 HTTP/1.1" 200 None
2026-03-28 14:00:55 [auto1.es] INFO: Saving data for EH49664: {'created_time': 1774706455.95062, 'last_price_update_time': 1774706455.950631, 'auction_closing_time': 1774885529.0}
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EH49664') HTTP/1.1" 204 0
2026-03-28 14:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_cf0efcdc4500a24cfcf1f23ac96de19b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_5a77c8920809b43d8b0052f526ff8c4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_16623d0811676edf9a5c0804b8099f58.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_d1e42d0428fc8214f74947b618680658.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_e93659dfcc81c740ab980495746ad626.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_e93659dfcc81c740ab980495746ad626.jpg not downloaded yet
2026-03-28 14:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_6f0f327ab59d2f46435570dd491780fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_c2dc7813bcd09f81934e62039f73adaa.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_7a6401b1e0e870fb8bd6750534cd3b79.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_201a5a6ade0358f887c73d5a518f3374.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_201a5a6ade0358f887c73d5a518f3374.jpg not downloaded yet
2026-03-28 14:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1685f4dd0>
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_823b56535c1d772f6fbaa901ce44b071.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_823b56535c1d772f6fbaa901ce44b071.jpg saved to cache
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87f77a54-66d4-52d7-9166-30210f5e7653
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a046a50>
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fe8%252Fc0e80a3a93e190d3d11fab84340f4939%252Fpa%252FGG87039_d45b0278ccf0f4556716a8b5b11fcc4f.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_d45b0278ccf0f4556716a8b5b11fcc4f.jpg saved to cache
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b8662a0-84eb-57e7-9db1-da6421540df2
2026-03-28 14:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b8662a0-84eb-57e7-9db1-da6421540df2, skipping ID generation
2026-03-28 14:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b8662a0-84eb-57e7-9db1-da6421540df2 with scrape type 1
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b8662a0-84eb-57e7-9db1-da6421540df2 sending to next pipeline
2026-03-28 14:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b8662a0-84eb-57e7-9db1-da6421540df2, identifier: GG87039
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c0c2b90>
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fd3%252Fdcd3f9dcdbeda2e5b05928667818a4ab%252Fpa%252FBC82698_39cae7fd5936da62ce3f18968f1f9634.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_39cae7fd5936da62ce3f18968f1f9634.jpg saved to cache
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a296372-def5-5367-b7a2-2dd036c68a37
2026-03-28 14:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a296372-def5-5367-b7a2-2dd036c68a37, skipping ID generation
2026-03-28 14:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a296372-def5-5367-b7a2-2dd036c68a37 with scrape type 1
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a296372-def5-5367-b7a2-2dd036c68a37 sending to next pipeline
2026-03-28 14:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4a296372-def5-5367-b7a2-2dd036c68a37, identifier: BC82698
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c914bd0>
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0b%252F390b414761d8319ad3b8ba70d1b94bc9%252Fpa%252FHE30029_1384d8fd0f72ba753d2ca2622595795a.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_1384d8fd0f72ba753d2ca2622595795a.jpg saved to cache
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b24aa342-48ff-5010-b660-8576d8353690
2026-03-28 14:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b24aa342-48ff-5010-b660-8576d8353690, skipping ID generation
2026-03-28 14:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b24aa342-48ff-5010-b660-8576d8353690 with scrape type 1
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b24aa342-48ff-5010-b660-8576d8353690 sending to next pipeline
2026-03-28 14:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b24aa342-48ff-5010-b660-8576d8353690, identifier: HE30029
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168526290>
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fdd%252Fb0dd86f33b02ad74644b15f19edd9208%252Fpa%252FXP47447_45e9298fc8c46353d42f58503c5b354f.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_45e9298fc8c46353d42f58503c5b354f.jpg saved to cache
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837
2026-03-28 14:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce0d1adc-f80b-5c6f-9999-2b7a097cd837, skipping ID generation
2026-03-28 14:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837 with scrape type 1
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce0d1adc-f80b-5c6f-9999-2b7a097cd837 sending to next pipeline
2026-03-28 14:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce0d1adc-f80b-5c6f-9999-2b7a097cd837, identifier: XP47447
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a2158d0>
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fcb%252F36cbc1dd5813e85e32d7926af0e451db%252Fpa%252FEA32126_ba8e75dd440c82fec5a0ee78b9cb5c5e.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_ba8e75dd440c82fec5a0ee78b9cb5c5e.jpg saved to cache
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c3dcf52-5d0f-519b-a832-6173e69a6505
2026-03-28 14:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c3dcf52-5d0f-519b-a832-6173e69a6505, skipping ID generation
2026-03-28 14:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c3dcf52-5d0f-519b-a832-6173e69a6505 with scrape type 1
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c3dcf52-5d0f-519b-a832-6173e69a6505 sending to next pipeline
2026-03-28 14:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c3dcf52-5d0f-519b-a832-6173e69a6505, identifier: EA32126
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1fd750>
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_efd1edf458843d96cb1a9733eb2f5257.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_efd1edf458843d96cb1a9733eb2f5257.jpg saved to cache
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87f77a54-66d4-52d7-9166-30210f5e7653
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c104690>
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_ce28bb3098fc08ab856fbfdd2b437d9f.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_ce28bb3098fc08ab856fbfdd2b437d9f.jpg saved to cache
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2f98b8f-7c08-5680-8179-e3628f601f31
2026-03-28 14:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_bd6c39d691ab935ed6699f0eaafc79ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_deb6952e5d048824199eb116914b97ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_deb6952e5d048824199eb116914b97ee.jpg not downloaded yet
2026-03-28 14:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b8662a0-84eb-57e7-9db1-da6421540df2 with identifier: GG87039
2026-03-28 14:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b8662a0-84eb-57e7-9db1-da6421540df2 with identifier: GG87039
2026-03-28 14:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b8662a0-84eb-57e7-9db1-da6421540df2 with identifier: GG87039 to the API
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_d45b0278ccf0f4556716a8b5b11fcc4f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:59Z',
 'fuel_type': 'diesel',
 'id': '1b8662a0-84eb-57e7-9db1-da6421540df2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG87039',
 'listing': 'auction',
 'location': 'ES, Marbella',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 116303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_d45b0278ccf0f4556716a8b5b11fcc4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_877915db6c3803c8d96615a1fc33cd25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_bd21134407e2c828a87d8a364c963bd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_89ded061d260a57d977e918a2fb1159f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_4d26f0629feab62adb274544e6514c22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_75856d045b94cf4c9389750ec2035651.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_c4ac85bbbd292beec9d7b03259614485.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_de751df53d9af29feb2c95bc2b050dba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_059529423defc4b54335a8b9cd73ec01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8662a0-84eb-57e7-9db1-da6421540df2/1b8662a0-84eb-57e7-9db1-da6421540df2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/e8/c0e80a3a93e190d3d11fab84340f4939/pa/GG87039_0503e466934c297789e475b1768fddec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion BlueMotion',
 'year': 2015}
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG87039%27 HTTP/1.1" 200 None
2026-03-28 14:00:57 [auto1.es] INFO: Saving data for GG87039: {'created_time': 1774706457.346314, 'last_price_update_time': 1774706457.346327, 'auction_closing_time': 1774886219.0}
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GG87039') HTTP/1.1" 204 0
2026-03-28 14:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4a296372-def5-5367-b7a2-2dd036c68a37 with identifier: BC82698
2026-03-28 14:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4a296372-def5-5367-b7a2-2dd036c68a37 with identifier: BC82698
2026-03-28 14:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4a296372-def5-5367-b7a2-2dd036c68a37 with identifier: BC82698 to the API
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_39cae7fd5936da62ce3f18968f1f9634.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:30:40Z',
 'fuel_type': 'diesel',
 'id': '4a296372-def5-5367-b7a2-2dd036c68a37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC82698',
 'listing': 'auction',
 'location': 'ES, Tarragona',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 97015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_39cae7fd5936da62ce3f18968f1f9634.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_ef5909be193d8aa64e99da8432cef396.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_441257433b3f7e0cae9fee10caffe859.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_41012fdf1e1b767301fbfa92a568ccd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_2b6ef92ebaabb4cb9d59d4dd0d7411f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_da90ee3ab3215e42bb8946a3259ebc14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_24f5bf1b88c79c2edd504191964996b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_b7bb221016c63e9711a538e60c50ef18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_c4526761dea5546c22d2e04971eba2bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a296372-def5-5367-b7a2-2dd036c68a37/4a296372-def5-5367-b7a2-2dd036c68a37_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/d3/dcd3f9dcdbeda2e5b05928667818a4ab/pa/BC82698_fdefb423971b92110491f3b98b37fa48.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 407 2.0 HDi ST Confort Pack',
 'transmission': 'manual',
 'trim': 'ST Confort Pack',
 'year': 2007}
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC82698%27 HTTP/1.1" 200 None
2026-03-28 14:00:57 [auto1.es] INFO: Saving data for BC82698: {'created_time': 1774706457.770335, 'last_price_update_time': 1774706457.770349, 'auction_closing_time': 1774884640.0}
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BC82698') HTTP/1.1" 204 0
2026-03-28 14:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b24aa342-48ff-5010-b660-8576d8353690 with identifier: HE30029
2026-03-28 14:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b24aa342-48ff-5010-b660-8576d8353690 with identifier: HE30029
2026-03-28 14:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b24aa342-48ff-5010-b660-8576d8353690 with identifier: HE30029 to the API
2026-03-28 14:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_1384d8fd0f72ba753d2ca2622595795a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:05:05Z',
 'fuel_type': 'petrol',
 'id': 'b24aa342-48ff-5010-b660-8576d8353690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE30029',
 'listing': 'auction',
 'location': 'ES, Rivas-Vaciamadrid, Madrid',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 45587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_358c57f15db0f7a35819098c4997b25f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_1384d8fd0f72ba753d2ca2622595795a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_55dd3334810a84bbef65e9851bfdff8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_291b884956c1fcedcfb6a4d7f2cac402.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_c3e199139307322b1fafe1432d8405c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_7bc15884f5db3450bdfb533b89900494.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_3f1c781a85933671036c6b0d5a631746.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_8a69c7c0874e7b07aeebe30b09b359f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_b2716253e0e4333fa357cfe010d027b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24aa342-48ff-5010-b660-8576d8353690/b24aa342-48ff-5010-b660-8576d8353690_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0b/390b414761d8319ad3b8ba70d1b94bc9/pa/HE30029_bae177a2f6fa6c74645a40fa45ffdbb4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 2007}
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE30029%27 HTTP/1.1" 200 None
2026-03-28 14:00:58 [auto1.es] INFO: Saving data for HE30029: {'created_time': 1774706458.165023, 'last_price_update_time': 1774706458.165035, 'auction_closing_time': 1774883105.0}
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HE30029') HTTP/1.1" 204 0
2026-03-28 14:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce0d1adc-f80b-5c6f-9999-2b7a097cd837 with identifier: XP47447
2026-03-28 14:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce0d1adc-f80b-5c6f-9999-2b7a097cd837 with identifier: XP47447
2026-03-28 14:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce0d1adc-f80b-5c6f-9999-2b7a097cd837 with identifier: XP47447 to the API
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_45e9298fc8c46353d42f58503c5b354f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:09Z',
 'fuel_type': 'diesel',
 'id': 'ce0d1adc-f80b-5c6f-9999-2b7a097cd837',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP47447',
 'listing': 'auction',
 'location': 'ES, Rubí',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 117622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_a92710a9d381527d3f9a87171a9d6392.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_124b8386e74e1602fcaa9d273c22cedf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_354c28764ad8ead549e10be2ad97d62e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_45e9298fc8c46353d42f58503c5b354f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_77cdbc0a0582c7ca1e8f38b646f30fed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_4a2dc10b15d895c7103d45d5bba93608.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_01f14978f735db58a1323ceefbe55ef8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_05b1faa31659c17228890c9d4fdc21a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_6ed071c4962d547e0cbdfa2069ad295e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0d1adc-f80b-5c6f-9999-2b7a097cd837/ce0d1adc-f80b-5c6f-9999-2b7a097cd837_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/dd/b0dd86f33b02ad74644b15f19edd9208/pa/XP47447_0b6279c63e9de0fc672dcdfdbad20947.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP47447%27 HTTP/1.1" 200 None
2026-03-28 14:00:58 [auto1.es] INFO: Saving data for XP47447: {'created_time': 1774706458.675408, 'last_price_update_time': 1774706458.675417, 'auction_closing_time': 1774884069.0}
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XP47447') HTTP/1.1" 204 0
2026-03-28 14:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c3dcf52-5d0f-519b-a832-6173e69a6505 with identifier: EA32126
2026-03-28 14:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c3dcf52-5d0f-519b-a832-6173e69a6505 with identifier: EA32126
2026-03-28 14:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4c3dcf52-5d0f-519b-a832-6173e69a6505 with identifier: EA32126 to the API
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_ba8e75dd440c82fec5a0ee78b9cb5c5e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:28:44Z',
 'fuel_type': 'diesel',
 'id': '4c3dcf52-5d0f-519b-a832-6173e69a6505',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA32126',
 'listing': 'auction',
 'location': 'ES, Jaén',
 'make': 'Volkswagen',
 'model': 'CC',
 'odometer': 139457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_ac470572d2a2a18b283cd9e1f2ba9f77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_5c5afeade6f683ad49e05b238bfc491c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_3d9db8f7ac92cdb51a1aa7dad6a5c463.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_f9dea99ba4da231b6e5676c32b765c80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_11cd98edd9540697db9a5c574922e103.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_9026c4ad183d42afb2320a6f0635a740.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_ba8e75dd440c82fec5a0ee78b9cb5c5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_2d8c3d2e353f1a9f6f84c1947890ac02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_d89558f3124f8ca1cecfefb9452bbfd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c3dcf52-5d0f-519b-a832-6173e69a6505/4c3dcf52-5d0f-519b-a832-6173e69a6505_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/cb/36cbc1dd5813e85e32d7926af0e451db/pa/EA32126_3bd24779a9f055a21661dba5bbd1d0e5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen CC 2.0 TDI BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'BlueMotion Tech',
 'year': 2014}
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA32126%27 HTTP/1.1" 200 None
2026-03-28 14:00:59 [auto1.es] INFO: Saving data for EA32126: {'created_time': 1774706459.084611, 'last_price_update_time': 1774706459.084623, 'auction_closing_time': 1774884524.0}
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EA32126') HTTP/1.1" 204 0
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a011710>
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_cf0efcdc4500a24cfcf1f23ac96de19b.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_cf0efcdc4500a24cfcf1f23ac96de19b.jpg saved to cache
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5cfbecb0-2039-5421-a812-e290ec86b875
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff169fcd1d0>
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_5a77c8920809b43d8b0052f526ff8c4d.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_5a77c8920809b43d8b0052f526ff8c4d.jpg saved to cache
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87f77a54-66d4-52d7-9166-30210f5e7653
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687314d0>
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_16623d0811676edf9a5c0804b8099f58.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_16623d0811676edf9a5c0804b8099f58.jpg saved to cache
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87f77a54-66d4-52d7-9166-30210f5e7653
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a027c50>
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_d1e42d0428fc8214f74947b618680658.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_d1e42d0428fc8214f74947b618680658.jpg saved to cache
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5cfbecb0-2039-5421-a812-e290ec86b875
2026-03-28 14:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_63c8d2ff330058bc9ac06052d6e9fdea.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_083dc8afe99444842301c4d92fc43b9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_dc93b03a1b64bd291f44bccc9c638d6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_344742bc7700b1b9f756261f1ed52e46.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_e742bf507c71e1b6b7271b3ada3e88b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_e742bf507c71e1b6b7271b3ada3e88b9.jpg not downloaded yet
2026-03-28 14:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16afc0c90>
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_6f0f327ab59d2f46435570dd491780fd.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_6f0f327ab59d2f46435570dd491780fd.jpg saved to cache
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2f98b8f-7c08-5680-8179-e3628f601f31
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a3aea50>
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_c2dc7813bcd09f81934e62039f73adaa.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_c2dc7813bcd09f81934e62039f73adaa.jpg saved to cache
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87f77a54-66d4-52d7-9166-30210f5e7653
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a04bb10>
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_7a6401b1e0e870fb8bd6750534cd3b79.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_7a6401b1e0e870fb8bd6750534cd3b79.jpg saved to cache
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2f98b8f-7c08-5680-8179-e3628f601f31
2026-03-28 14:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_48a521c11adefef791e6f4ef7afa4747.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS39016> (referer: https://www.auto1.com/v1/car-details-view/TS39016/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1685c15d0>
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_bd6c39d691ab935ed6699f0eaafc79ec.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_bd6c39d691ab935ed6699f0eaafc79ec.jpg saved to cache
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87f77a54-66d4-52d7-9166-30210f5e7653
2026-03-28 14:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_09b2956e965733d509cf4cdaf2f5af29.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_34b1c3359a3ceaf0b1313e57f55e4f3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_c4e753b6675ac210c7f5a52455221d96.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_c4e753b6675ac210c7f5a52455221d96.jpg not downloaded yet
2026-03-28 14:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_cab67b052d972e9d05c304a7ba9c5a67.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a259950>
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F34%252Fb734d163b502d6ddebe97ab5c370240d%252Fpa%252FDA78268_63c8d2ff330058bc9ac06052d6e9fdea.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_63c8d2ff330058bc9ac06052d6e9fdea.jpg saved to cache
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cfbecb0-2039-5421-a812-e290ec86b875
2026-03-28 14:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5cfbecb0-2039-5421-a812-e290ec86b875, skipping ID generation
2026-03-28 14:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cfbecb0-2039-5421-a812-e290ec86b875 with scrape type 1
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cfbecb0-2039-5421-a812-e290ec86b875 sending to next pipeline
2026-03-28 14:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5cfbecb0-2039-5421-a812-e290ec86b875, identifier: DA78268
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168525d50>
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_083dc8afe99444842301c4d92fc43b9c.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_083dc8afe99444842301c4d92fc43b9c.jpg saved to cache
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87f77a54-66d4-52d7-9166-30210f5e7653
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16857d890>
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_dc93b03a1b64bd291f44bccc9c638d6f.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_dc93b03a1b64bd291f44bccc9c638d6f.jpg saved to cache
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2f98b8f-7c08-5680-8179-e3628f601f31
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a033e90>
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_344742bc7700b1b9f756261f1ed52e46.jpg') HTTP/1.1" 204 0
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_344742bc7700b1b9f756261f1ed52e46.jpg saved to cache
2026-03-28 14:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2f98b8f-7c08-5680-8179-e3628f601f31
2026-03-28 14:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5cfbecb0-2039-5421-a812-e290ec86b875 with identifier: DA78268
2026-03-28 14:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5cfbecb0-2039-5421-a812-e290ec86b875 with identifier: DA78268
2026-03-28 14:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5cfbecb0-2039-5421-a812-e290ec86b875 with identifier: DA78268 to the API
2026-03-28 14:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_63c8d2ff330058bc9ac06052d6e9fdea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:48:08Z',
 'fuel_type': 'diesel',
 'id': '5cfbecb0-2039-5421-a812-e290ec86b875',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA78268',
 'listing': 'auction',
 'location': 'ES, Córdoba',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 228387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_63c8d2ff330058bc9ac06052d6e9fdea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_b5ce9ef12a9fc9938ed044dbb53796fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_cf0efcdc4500a24cfcf1f23ac96de19b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_d1e42d0428fc8214f74947b618680658.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_b7827473b2b642b5e626ee22803365eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_804912dbe14f13a31b753b7ea1e68c2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_456e11437d5098a101e78530e039a153.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_5cfd85d4a15d1726d8e96356a56dbfb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_227f44d8759d4b1144cab8982062057f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cfbecb0-2039-5421-a812-e290ec86b875/5cfbecb0-2039-5421-a812-e290ec86b875_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/34/b734d163b502d6ddebe97ab5c370240d/pa/DA78268_550168af334ec46580bf85d00ee01774.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA78268%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [auto1.es] INFO: Saving data for DA78268: {'created_time': 1774706460.221846, 'last_price_update_time': 1774706460.221857, 'auction_closing_time': 1774885688.0}
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DA78268') HTTP/1.1" 204 0
2026-03-28 14:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_e93659dfcc81c740ab980495746ad626.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_050296ce8a12509af7b733bd78ba02b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_deb6952e5d048824199eb116914b97ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_201a5a6ade0358f887c73d5a518f3374.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_e2043d040cbb8f23842c4e3df7167f3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a251a10>
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_48a521c11adefef791e6f4ef7afa4747.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_48a521c11adefef791e6f4ef7afa4747.jpg saved to cache
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa
2026-03-28 14:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01f84fba-8776-5cf9-be0c-c599bccda4f6 with identifier: TS39016
2026-03-28 14:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01f84fba-8776-5cf9-be0c-c599bccda4f6 with scrape type 1
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01f84fba-8776-5cf9-be0c-c599bccda4f6
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e35c985cb1c3deb802ae1ec1c32e34%252Fpa%252FTS39016_46514ffc0efb9cf733e4ddf464ab0ba9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_46514ffc0efb9cf733e4ddf464ab0ba9.jpg already downloaded
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e35c985cb1c3deb802ae1ec1c32e34%252Fpa%252FTS39016_0c102e3411023039f33a6f3777e2c7fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_0c102e3411023039f33a6f3777e2c7fa.jpg already downloaded
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e35c985cb1c3deb802ae1ec1c32e34%252Fpa%252FTS39016_5dd2e23bf97dbfed1a4f0d734b099d96.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_5dd2e23bf97dbfed1a4f0d734b099d96.jpg already downloaded
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e35c985cb1c3deb802ae1ec1c32e34%252Fpa%252FTS39016_54f71524d2800ab7da5b1ee66553bb35.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_54f71524d2800ab7da5b1ee66553bb35.jpg already downloaded
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e35c985cb1c3deb802ae1ec1c32e34%252Fpa%252FTS39016_1ab80c6aecc525b0a94e4c20fd76b5ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_1ab80c6aecc525b0a94e4c20fd76b5ec.jpg already downloaded
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e35c985cb1c3deb802ae1ec1c32e34%252Fpa%252FTS39016_b3a44e1c508ab4ec878767d61110b4dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_b3a44e1c508ab4ec878767d61110b4dc.jpg already downloaded
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e35c985cb1c3deb802ae1ec1c32e34%252Fpa%252FTS39016_03ab5470326f90feba4414799e185485.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_03ab5470326f90feba4414799e185485.jpg already downloaded
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e35c985cb1c3deb802ae1ec1c32e34%252Fpa%252FTS39016_19ca1a663eaa26b47122a72a72e90198.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_19ca1a663eaa26b47122a72a72e90198.jpg already downloaded
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e35c985cb1c3deb802ae1ec1c32e34%252Fpa%252FTS39016_ce777ec563d61da79c98fad897fecf1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_ce777ec563d61da79c98fad897fecf1b.jpg already downloaded
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e35c985cb1c3deb802ae1ec1c32e34%252Fpa%252FTS39016_55311c1cdeffbb814e7f42b751313600.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_55311c1cdeffbb814e7f42b751313600.jpg already downloaded
2026-03-28 14:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 01f84fba-8776-5cf9-be0c-c599bccda4f6, identifier: TS39016
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a16b390>
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_09b2956e965733d509cf4cdaf2f5af29.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_09b2956e965733d509cf4cdaf2f5af29.jpg saved to cache
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2f98b8f-7c08-5680-8179-e3628f601f31
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168785e50>
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_34b1c3359a3ceaf0b1313e57f55e4f3d.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_34b1c3359a3ceaf0b1313e57f55e4f3d.jpg saved to cache
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87f77a54-66d4-52d7-9166-30210f5e7653
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686295d0>
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_cab67b052d972e9d05c304a7ba9c5a67.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_cab67b052d972e9d05c304a7ba9c5a67.jpg saved to cache
2026-03-28 14:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87f77a54-66d4-52d7-9166-30210f5e7653
2026-03-28 14:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_80240b76cb71053ce5a5783c49e98038.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_6b149b893c2913aa582fa18ece94e160.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_e742bf507c71e1b6b7271b3ada3e88b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA52283> (referer: https://www.auto1.com/v1/car-details-view/PA52283/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 01f84fba-8776-5cf9-be0c-c599bccda4f6 with identifier: TS39016
2026-03-28 14:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 01f84fba-8776-5cf9-be0c-c599bccda4f6 with identifier: TS39016
2026-03-28 14:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 01f84fba-8776-5cf9-be0c-c599bccda4f6 with identifier: TS39016 to the API
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TS39016>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:57:39Z',
 'fuel_type': 'petrol',
 'id': '01f84fba-8776-5cf9-be0c-c599bccda4f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS39016',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 121374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_46514ffc0efb9cf733e4ddf464ab0ba9.jpg',
                'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_0c102e3411023039f33a6f3777e2c7fa.jpg',
                'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_5dd2e23bf97dbfed1a4f0d734b099d96.jpg',
                'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_54f71524d2800ab7da5b1ee66553bb35.jpg',
                'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_1ab80c6aecc525b0a94e4c20fd76b5ec.jpg',
                'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_b3a44e1c508ab4ec878767d61110b4dc.jpg',
                'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_03ab5470326f90feba4414799e185485.jpg',
                'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_19ca1a663eaa26b47122a72a72e90198.jpg',
                'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_ce777ec563d61da79c98fad897fecf1b.jpg',
                'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_55311c1cdeffbb814e7f42b751313600.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f84fba-8776-5cf9-be0c-c599bccda4f6/01f84fba-8776-5cf9-be0c-c599bccda4f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_46514ffc0efb9cf733e4ddf464ab0ba9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f84fba-8776-5cf9-be0c-c599bccda4f6/01f84fba-8776-5cf9-be0c-c599bccda4f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_0c102e3411023039f33a6f3777e2c7fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f84fba-8776-5cf9-be0c-c599bccda4f6/01f84fba-8776-5cf9-be0c-c599bccda4f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_5dd2e23bf97dbfed1a4f0d734b099d96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f84fba-8776-5cf9-be0c-c599bccda4f6/01f84fba-8776-5cf9-be0c-c599bccda4f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_54f71524d2800ab7da5b1ee66553bb35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f84fba-8776-5cf9-be0c-c599bccda4f6/01f84fba-8776-5cf9-be0c-c599bccda4f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_1ab80c6aecc525b0a94e4c20fd76b5ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f84fba-8776-5cf9-be0c-c599bccda4f6/01f84fba-8776-5cf9-be0c-c599bccda4f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_b3a44e1c508ab4ec878767d61110b4dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f84fba-8776-5cf9-be0c-c599bccda4f6/01f84fba-8776-5cf9-be0c-c599bccda4f6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_03ab5470326f90feba4414799e185485.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f84fba-8776-5cf9-be0c-c599bccda4f6/01f84fba-8776-5cf9-be0c-c599bccda4f6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_19ca1a663eaa26b47122a72a72e90198.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f84fba-8776-5cf9-be0c-c599bccda4f6/01f84fba-8776-5cf9-be0c-c599bccda4f6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_ce777ec563d61da79c98fad897fecf1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f84fba-8776-5cf9-be0c-c599bccda4f6/01f84fba-8776-5cf9-be0c-c599bccda4f6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e35c985cb1c3deb802ae1ec1c32e34/pa/TS39016_55311c1cdeffbb814e7f42b751313600.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-23',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 e-THP Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS39016%27 HTTP/1.1" 200 None
2026-03-28 14:01:01 [auto1.es] INFO: Saving data for TS39016: {'created_time': 1774706461.097381, 'last_price_update_time': 1774706461.097392, 'auction_closing_time': 1774886259.0}
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TS39016') HTTP/1.1" 204 0
2026-03-28 14:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE72749> (referer: https://www.auto1.com/v1/car-details-view/BE72749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL95591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS53569> (referer: https://www.auto1.com/v1/car-details-view/PS53569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168787a90>
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_e93659dfcc81c740ab980495746ad626.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_e93659dfcc81c740ab980495746ad626.jpg saved to cache
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2f98b8f-7c08-5680-8179-e3628f601f31
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a335d50>
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_050296ce8a12509af7b733bd78ba02b3.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_050296ce8a12509af7b733bd78ba02b3.jpg saved to cache
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16865dc90>
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_deb6952e5d048824199eb116914b97ee.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_deb6952e5d048824199eb116914b97ee.jpg saved to cache
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2f98b8f-7c08-5680-8179-e3628f601f31
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168562810>
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F4b%252F644b3bf50fac03b78bde3aa75c8b3622%252Fpa%252FAT82365_201a5a6ade0358f887c73d5a518f3374.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_201a5a6ade0358f887c73d5a518f3374.jpg saved to cache
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87f77a54-66d4-52d7-9166-30210f5e7653
2026-03-28 14:01:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87f77a54-66d4-52d7-9166-30210f5e7653, skipping ID generation
2026-03-28 14:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f77a54-66d4-52d7-9166-30210f5e7653 with scrape type 1
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87f77a54-66d4-52d7-9166-30210f5e7653 sending to next pipeline
2026-03-28 14:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 87f77a54-66d4-52d7-9166-30210f5e7653, identifier: AT82365
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a258c90>
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_e2043d040cbb8f23842c4e3df7167f3e.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_e2043d040cbb8f23842c4e3df7167f3e.jpg saved to cache
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa
2026-03-28 14:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 87f77a54-66d4-52d7-9166-30210f5e7653 with identifier: AT82365
2026-03-28 14:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 87f77a54-66d4-52d7-9166-30210f5e7653 with identifier: AT82365
2026-03-28 14:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 87f77a54-66d4-52d7-9166-30210f5e7653 with identifier: AT82365 to the API
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_201a5a6ade0358f887c73d5a518f3374.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:18:13Z',
 'fuel_type': 'diesel',
 'id': '87f77a54-66d4-52d7-9166-30210f5e7653',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT82365',
 'listing': 'auction',
 'location': 'ES, Viladecans,Barcelona',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 178300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_823b56535c1d772f6fbaa901ce44b071.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_c2dc7813bcd09f81934e62039f73adaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_efd1edf458843d96cb1a9733eb2f5257.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_16623d0811676edf9a5c0804b8099f58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_5a77c8920809b43d8b0052f526ff8c4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_bd6c39d691ab935ed6699f0eaafc79ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_083dc8afe99444842301c4d92fc43b9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_34b1c3359a3ceaf0b1313e57f55e4f3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_cab67b052d972e9d05c304a7ba9c5a67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87f77a54-66d4-52d7-9166-30210f5e7653/87f77a54-66d4-52d7-9166-30210f5e7653_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/4b/644b3bf50fac03b78bde3aa75c8b3622/pa/AT82365_201a5a6ade0358f887c73d5a518f3374.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 D-4D Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2014}
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT82365%27 HTTP/1.1" 200 None
2026-03-28 14:01:01 [auto1.es] INFO: Saving data for AT82365: {'created_time': 1774706461.84718, 'last_price_update_time': 1774706461.847192, 'auction_closing_time': 1774883893.0}
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AT82365') HTTP/1.1" 204 0
2026-03-28 14:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_cd8d3c7601f0650cf72ae86cbd202b27.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_053bd5fa22f4ebae10388f6d308c8d5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_bf4c27145a9c1be6e0a61f99845cab4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_2514e6705862d3aba5befef47cbfb9b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a100410>
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_80240b76cb71053ce5a5783c49e98038.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_80240b76cb71053ce5a5783c49e98038.jpg saved to cache
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168547b10>
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F78%252F7b789047558502aade3ffc640c142457%252Fpa%252FPJ13315_6b149b893c2913aa582fa18ece94e160.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_6b149b893c2913aa582fa18ece94e160.jpg saved to cache
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa
2026-03-28 14:01:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c430373b-6fdb-58ab-b1f4-7c443ed8dcaa, skipping ID generation
2026-03-28 14:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa with scrape type 1
2026-03-28 14:01:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c430373b-6fdb-58ab-b1f4-7c443ed8dcaa sending to next pipeline
2026-03-28 14:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c430373b-6fdb-58ab-b1f4-7c443ed8dcaa, identifier: PJ13315
2026-03-28 14:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a365890>
2026-03-28 14:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_e742bf507c71e1b6b7271b3ada3e88b9.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_e742bf507c71e1b6b7271b3ada3e88b9.jpg saved to cache
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2f98b8f-7c08-5680-8179-e3628f601f31
2026-03-28 14:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40d918f0-a69b-58da-a2e9-fb2c560ec41f with identifier: PA52283
2026-03-28 14:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d918f0-a69b-58da-a2e9-fb2c560ec41f with scrape type 1
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 40d918f0-a69b-58da-a2e9-fb2c560ec41f
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fc8%252F58c8096f3a14beb26da461a0df5ca81d%252Fpa%252FPA52283_f6d8a00a1e786af15da54cf8cde77230.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_f6d8a00a1e786af15da54cf8cde77230.jpg not downloaded yet
2026-03-28 14:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_c4e753b6675ac210c7f5a52455221d96.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c430373b-6fdb-58ab-b1f4-7c443ed8dcaa with identifier: PJ13315
2026-03-28 14:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c430373b-6fdb-58ab-b1f4-7c443ed8dcaa with identifier: PJ13315
2026-03-28 14:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c430373b-6fdb-58ab-b1f4-7c443ed8dcaa with identifier: PJ13315 to the API
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_6b149b893c2913aa582fa18ece94e160.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:46Z',
 'fuel_type': 'diesel',
 'id': 'c430373b-6fdb-58ab-b1f4-7c443ed8dcaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ13315',
 'listing': 'auction',
 'location': 'ES, Oiartzun',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 229906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_80240b76cb71053ce5a5783c49e98038.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_6b149b893c2913aa582fa18ece94e160.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_6881154705f676efab1a645328e71c07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_050296ce8a12509af7b733bd78ba02b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_e2043d040cbb8f23842c4e3df7167f3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_ff89ccab7819eec19289eab2da0a72b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_48a521c11adefef791e6f4ef7afa4747.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_3adc7d4c02bb0a9fa69a7a6157a70399.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_4e83d3244751475b5d09b2b1399bd7a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c430373b-6fdb-58ab-b1f4-7c443ed8dcaa/c430373b-6fdb-58ab-b1f4-7c443ed8dcaa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/78/7b789047558502aade3ffc640c142457/pa/PJ13315_3831d6ca7c9008df9623fc55d453fb2a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ13315%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [auto1.es] INFO: Saving data for PJ13315: {'created_time': 1774706462.583055, 'last_price_update_time': 1774706462.583069, 'auction_closing_time': 1774883266.0}
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PJ13315') HTTP/1.1" 204 0
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fc8%252F58c8096f3a14beb26da461a0df5ca81d%252Fpa%252FPA52283_a70c0055925c49debae2ab7edd7c7ce2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_a70c0055925c49debae2ab7edd7c7ce2.jpg not downloaded yet
2026-03-28 14:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA34349> (referer: https://www.auto1.com/v1/car-details-view/VA34349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LN12503> (referer: https://www.auto1.com/v1/car-details-view/LN12503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7b73b17-dd7a-5831-afff-fb521530837c with identifier: BE72749
2026-03-28 14:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7b73b17-dd7a-5831-afff-fb521530837c with scrape type 1
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7b73b17-dd7a-5831-afff-fb521530837c
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_8980587e548427a85d012bf8c74e6435.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_8980587e548427a85d012bf8c74e6435.jpg not downloaded yet
2026-03-28 14:01:02 [auto1.es] INFO: Channel: 24h | Page: 4 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db038509-04c5-512d-a0a3-907637df491c with identifier: PS53569
2026-03-28 14:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db038509-04c5-512d-a0a3-907637df491c with scrape type 1
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db038509-04c5-512d-a0a3-907637df491c
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fcf%252Ff2cfa48e7436431cd23a73c08e7cca6e%252Fpa%252FPS53569_ffd364069d4588c13c6fc3f4124a7c9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_ffd364069d4588c13c6fc3f4124a7c9c.jpg already downloaded
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fcf%252Ff2cfa48e7436431cd23a73c08e7cca6e%252Fpa%252FPS53569_c223529187d829415abbdc623b8df776.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_c223529187d829415abbdc623b8df776.jpg already downloaded
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fcf%252Ff2cfa48e7436431cd23a73c08e7cca6e%252Fpa%252FPS53569_34989f5ce308c7ec8a2bf569e6b3319e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_34989f5ce308c7ec8a2bf569e6b3319e.jpg already downloaded
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fcf%252Ff2cfa48e7436431cd23a73c08e7cca6e%252Fpa%252FPS53569_d35840f22728005bb6eb9d1e083161c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_d35840f22728005bb6eb9d1e083161c4.jpg already downloaded
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fcf%252Ff2cfa48e7436431cd23a73c08e7cca6e%252Fpa%252FPS53569_9562c0eeef1442f4ab8de4704a1c2087.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_9562c0eeef1442f4ab8de4704a1c2087.jpg already downloaded
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fcf%252Ff2cfa48e7436431cd23a73c08e7cca6e%252Fpa%252FPS53569_de716c3ab00628ee6be42eea72dde82b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_de716c3ab00628ee6be42eea72dde82b.jpg already downloaded
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fcf%252Ff2cfa48e7436431cd23a73c08e7cca6e%252Fpa%252FPS53569_77c3f76f263805f0299ca9b1499c46d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_77c3f76f263805f0299ca9b1499c46d7.jpg already downloaded
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fcf%252Ff2cfa48e7436431cd23a73c08e7cca6e%252Fpa%252FPS53569_4c22f8801e5a2b2d9b497bfbe8251919.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_4c22f8801e5a2b2d9b497bfbe8251919.jpg already downloaded
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fcf%252Ff2cfa48e7436431cd23a73c08e7cca6e%252Fpa%252FPS53569_d00c95ab1930215a83823b9135751005.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_d00c95ab1930215a83823b9135751005.jpg already downloaded
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fcf%252Ff2cfa48e7436431cd23a73c08e7cca6e%252Fpa%252FPS53569_b5c99ac1746430fbc171e0c13414f0b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_b5c99ac1746430fbc171e0c13414f0b4.jpg already downloaded
2026-03-28 14:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: db038509-04c5-512d-a0a3-907637df491c, identifier: PS53569
2026-03-28 14:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168632a50>
2026-03-28 14:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_cd8d3c7601f0650cf72ae86cbd202b27.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_cd8d3c7601f0650cf72ae86cbd202b27.jpg saved to cache
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684fd790>
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_053bd5fa22f4ebae10388f6d308c8d5f.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_053bd5fa22f4ebae10388f6d308c8d5f.jpg saved to cache
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a38e750>
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_bf4c27145a9c1be6e0a61f99845cab4e.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_bf4c27145a9c1be6e0a61f99845cab4e.jpg saved to cache
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16868ea90>
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_2514e6705862d3aba5befef47cbfb9b1.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_2514e6705862d3aba5befef47cbfb9b1.jpg saved to cache
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fc8%252F58c8096f3a14beb26da461a0df5ca81d%252Fpa%252FPA52283_4b57aef1872af3c33be046f0fc636281.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4b57aef1872af3c33be046f0fc636281.jpg not downloaded yet
2026-03-28 14:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: db038509-04c5-512d-a0a3-907637df491c with identifier: PS53569
2026-03-28 14:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: db038509-04c5-512d-a0a3-907637df491c with identifier: PS53569
2026-03-28 14:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: db038509-04c5-512d-a0a3-907637df491c with identifier: PS53569 to the API
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PS53569>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': 'Taxi',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:00:25Z',
 'fuel_type': 'diesel',
 'id': 'db038509-04c5-512d-a0a3-907637df491c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS53569',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 292619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_ffd364069d4588c13c6fc3f4124a7c9c.jpg',
                'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_c223529187d829415abbdc623b8df776.jpg',
                'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_34989f5ce308c7ec8a2bf569e6b3319e.jpg',
                'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_d35840f22728005bb6eb9d1e083161c4.jpg',
                'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_9562c0eeef1442f4ab8de4704a1c2087.jpg',
                'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_de716c3ab00628ee6be42eea72dde82b.jpg',
                'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_77c3f76f263805f0299ca9b1499c46d7.jpg',
                'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_4c22f8801e5a2b2d9b497bfbe8251919.jpg',
                'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_d00c95ab1930215a83823b9135751005.jpg',
                'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_b5c99ac1746430fbc171e0c13414f0b4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db038509-04c5-512d-a0a3-907637df491c/db038509-04c5-512d-a0a3-907637df491c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_ffd364069d4588c13c6fc3f4124a7c9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db038509-04c5-512d-a0a3-907637df491c/db038509-04c5-512d-a0a3-907637df491c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_c223529187d829415abbdc623b8df776.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db038509-04c5-512d-a0a3-907637df491c/db038509-04c5-512d-a0a3-907637df491c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_34989f5ce308c7ec8a2bf569e6b3319e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db038509-04c5-512d-a0a3-907637df491c/db038509-04c5-512d-a0a3-907637df491c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_d35840f22728005bb6eb9d1e083161c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db038509-04c5-512d-a0a3-907637df491c/db038509-04c5-512d-a0a3-907637df491c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_9562c0eeef1442f4ab8de4704a1c2087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db038509-04c5-512d-a0a3-907637df491c/db038509-04c5-512d-a0a3-907637df491c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_de716c3ab00628ee6be42eea72dde82b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db038509-04c5-512d-a0a3-907637df491c/db038509-04c5-512d-a0a3-907637df491c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_77c3f76f263805f0299ca9b1499c46d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db038509-04c5-512d-a0a3-907637df491c/db038509-04c5-512d-a0a3-907637df491c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_4c22f8801e5a2b2d9b497bfbe8251919.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db038509-04c5-512d-a0a3-907637df491c/db038509-04c5-512d-a0a3-907637df491c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_d00c95ab1930215a83823b9135751005.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db038509-04c5-512d-a0a3-907637df491c/db038509-04c5-512d-a0a3-907637df491c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/cf/f2cfa48e7436431cd23a73c08e7cca6e/pa/PS53569_b5c99ac1746430fbc171e0c13414f0b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Blue-HDi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2018}
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS53569%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [auto1.es] INFO: Saving data for PS53569: {'created_time': 1774706463.545412, 'last_price_update_time': 1774706463.545422, 'auction_closing_time': 1774882825.0}
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PS53569') HTTP/1.1" 204 0
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_fc6ae74efe9233c5de4ecb12a6a4b158.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_fc6ae74efe9233c5de4ecb12a6a4b158.jpg not downloaded yet
2026-03-28 14:01:03 [auto1.es] INFO: Found listing with ID: RF71791
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF71791%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [auto1.es] INFO: Scrape type for RF71791: 2
2026-03-28 14:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 706d79a0-2269-5629-8ecc-01eb0fbd6f12 with identifier: RF71791
2026-03-28 14:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 706d79a0-2269-5629-8ecc-01eb0fbd6f12 with scrape type 2
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 706d79a0-2269-5629-8ecc-01eb0fbd6f12 with scrape type 2
2026-03-28 14:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 706d79a0-2269-5629-8ecc-01eb0fbd6f12, identifier: RF71791
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0c1590>
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd5%252F74d5893eb6eab442b17515db69778080%252Fpa%252FKC85026_c4e753b6675ac210c7f5a52455221d96.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_c4e753b6675ac210c7f5a52455221d96.jpg saved to cache
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2f98b8f-7c08-5680-8179-e3628f601f31
2026-03-28 14:01:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2f98b8f-7c08-5680-8179-e3628f601f31, skipping ID generation
2026-03-28 14:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f98b8f-7c08-5680-8179-e3628f601f31 with scrape type 1
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2f98b8f-7c08-5680-8179-e3628f601f31 sending to next pipeline
2026-03-28 14:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a2f98b8f-7c08-5680-8179-e3628f601f31, identifier: KC85026
2026-03-28 14:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_7bbe2f5b5451cd3c2bb61d1b909d5311.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_dbaa715397b4c8634d0a6ebdf2bfa141.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fc8%252F58c8096f3a14beb26da461a0df5ca81d%252Fpa%252FPA52283_4fa26ec45613b9cdc2f9f2036d48021e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4fa26ec45613b9cdc2f9f2036d48021e.jpg not downloaded yet
2026-03-28 14:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 706d79a0-2269-5629-8ecc-01eb0fbd6f12 with identifier: RF71791
2026-03-28 14:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 706d79a0-2269-5629-8ecc-01eb0fbd6f12 with identifier: RF71791
2026-03-28 14:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 706d79a0-2269-5629-8ecc-01eb0fbd6f12 with identifier: RF71791 to the API
2026-03-28 14:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:20:34Z',
 'fuel_type': 'diesel',
 'id': '706d79a0-2269-5629-8ecc-01eb0fbd6f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF71791',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Nitro',
 'odometer': 155743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-23',
 'seller_name': None,
 'title': 'Dodge Nitro 2.8 CRD SXT',
 'transmission': 'automatic',
 'trim': 'SXT',
 'year': 2007}
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF71791%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [auto1.es] INFO: Saving data for RF71791: {'auction_closing_time': 1774884034.0, 'created_time': 1774015653.825621, 'last_price_update_time': 1774706464.19083}
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RF71791') HTTP/1.1" 204 0
2026-03-28 14:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB89966> (referer: https://www.auto1.com/v1/car-details-view/BB89966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a2f98b8f-7c08-5680-8179-e3628f601f31 with identifier: KC85026
2026-03-28 14:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a2f98b8f-7c08-5680-8179-e3628f601f31 with identifier: KC85026
2026-03-28 14:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a2f98b8f-7c08-5680-8179-e3628f601f31 with identifier: KC85026 to the API
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_c4e753b6675ac210c7f5a52455221d96.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:32:26Z',
 'fuel_type': 'petrol',
 'id': 'a2f98b8f-7c08-5680-8179-e3628f601f31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC85026',
 'listing': 'auction',
 'location': 'ES, Lleida',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 97153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_ce28bb3098fc08ab856fbfdd2b437d9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_7a6401b1e0e870fb8bd6750534cd3b79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_6f0f327ab59d2f46435570dd491780fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_344742bc7700b1b9f756261f1ed52e46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_dc93b03a1b64bd291f44bccc9c638d6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_09b2956e965733d509cf4cdaf2f5af29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_e93659dfcc81c740ab980495746ad626.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_deb6952e5d048824199eb116914b97ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_e742bf507c71e1b6b7271b3ada3e88b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f98b8f-7c08-5680-8179-e3628f601f31/a2f98b8f-7c08-5680-8179-e3628f601f31_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d5/74d5893eb6eab442b17515db69778080/pa/KC85026_c4e753b6675ac210c7f5a52455221d96.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Pulsar 1.2 N-Tec',
 'transmission': 'manual',
 'trim': 'N-Tec',
 'year': 2015}
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC85026%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [auto1.es] INFO: Saving data for KC85026: {'created_time': 1774706464.617621, 'last_price_update_time': 1774706464.617634, 'auction_closing_time': 1774884746.0}
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KC85026') HTTP/1.1" 204 0
2026-03-28 14:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6211c8bb-ee73-5f0e-98ce-d44099955b6c with identifier: VA34349
2026-03-28 14:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c with scrape type 1
2026-03-28 14:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_a4b055a0b43d6bb190339c0d5ae1b582.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_a4b055a0b43d6bb190339c0d5ae1b582.jpg not downloaded yet
2026-03-28 14:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce with identifier: LN12503
2026-03-28 14:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce with scrape type 1
2026-03-28 14:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fea%252F19ea0715d6533c65329884e83842f4c8%252Fpa%252FLN12503_cbfda01da3c07c1bd54a664e0f4d5a36.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_cbfda01da3c07c1bd54a664e0f4d5a36.jpg already downloaded
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fea%252F19ea0715d6533c65329884e83842f4c8%252Fpa%252FLN12503_f5cb68d2ca24f958d81e50bd71b0360a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_f5cb68d2ca24f958d81e50bd71b0360a.jpg already downloaded
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fea%252F19ea0715d6533c65329884e83842f4c8%252Fpa%252FLN12503_a0a4257d96b41f5af51f8cf1addd8f19.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_a0a4257d96b41f5af51f8cf1addd8f19.jpg already downloaded
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fea%252F19ea0715d6533c65329884e83842f4c8%252Fpa%252FLN12503_0cede67bbc6308300f44457ba70306aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_0cede67bbc6308300f44457ba70306aa.jpg already downloaded
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fea%252F19ea0715d6533c65329884e83842f4c8%252Fpa%252FLN12503_5638fb161dd550a6ab82e0b36e82854d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_5638fb161dd550a6ab82e0b36e82854d.jpg already downloaded
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fea%252F19ea0715d6533c65329884e83842f4c8%252Fpa%252FLN12503_6c936b945f6ee26d60278e06e26de257.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_6c936b945f6ee26d60278e06e26de257.jpg already downloaded
2026-03-28 14:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce, identifier: LN12503
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_78b5ee513a3cec78426e1ba4830b158d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_78b5ee513a3cec78426e1ba4830b158d.jpg not downloaded yet
2026-03-28 14:01:05 [auto1.es] INFO: Found listing with ID: GE54234
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE54234%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [auto1.es] INFO: Scrape type for GE54234: 1
2026-03-28 14:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce with identifier: LN12503
2026-03-28 14:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce with identifier: LN12503
2026-03-28 14:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce with identifier: LN12503 to the API
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LN12503>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:04:47Z',
 'fuel_type': 'diesel',
 'id': 'adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN12503',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 174772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_cbfda01da3c07c1bd54a664e0f4d5a36.jpg',
                'https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_f5cb68d2ca24f958d81e50bd71b0360a.jpg',
                'https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_a0a4257d96b41f5af51f8cf1addd8f19.jpg',
                'https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_0cede67bbc6308300f44457ba70306aa.jpg',
                'https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_5638fb161dd550a6ab82e0b36e82854d.jpg',
                'https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_6c936b945f6ee26d60278e06e26de257.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce/adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_cbfda01da3c07c1bd54a664e0f4d5a36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce/adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_f5cb68d2ca24f958d81e50bd71b0360a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce/adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_a0a4257d96b41f5af51f8cf1addd8f19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce/adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_0cede67bbc6308300f44457ba70306aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce/adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_5638fb161dd550a6ab82e0b36e82854d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce/adf70a2d-a8b4-5cec-a5bc-2f8c608dd9ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/ea/19ea0715d6533c65329884e83842f4c8/pa/LN12503_6c936b945f6ee26d60278e06e26de257.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 206 1.4 HDi XT',
 'transmission': 'manual',
 'trim': 'XT',
 'year': 2002}
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN12503%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [auto1.es] INFO: Saving data for LN12503: {'created_time': 1774706465.384533, 'last_price_update_time': 1774706465.384546, 'auction_closing_time': 1774883087.0}
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LN12503') HTTP/1.1" 204 0
2026-03-28 14:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_f6d8a00a1e786af15da54cf8cde77230.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fc8%252F58c8096f3a14beb26da461a0df5ca81d%252Fpa%252FPA52283_72eeb9808ff656d455a543fc733f22e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_72eeb9808ff656d455a543fc733f22e7.jpg not downloaded yet
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_4e1ce2d318d4a620a27f5bff49712afc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_4e1ce2d318d4a620a27f5bff49712afc.jpg not downloaded yet
2026-03-28 14:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU18953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_a70c0055925c49debae2ab7edd7c7ce2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_b77c5ab5e3599878a998736c36b8d27c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_b77c5ab5e3599878a998736c36b8d27c.jpg not downloaded yet
2026-03-28 14:01:05 [auto1.es] INFO: Found listing with ID: VN90638
2026-03-28 14:01:05 [auto1.es] INFO: Found listing with ID: UF54007
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF54007%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [auto1.es] INFO: Scrape type for UF54007: 1
2026-03-28 14:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff169fd8e90>
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_7bbe2f5b5451cd3c2bb61d1b909d5311.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_7bbe2f5b5451cd3c2bb61d1b909d5311.jpg saved to cache
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0afd10>
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F4b%252F264b2c5ef8379acd22ebc7bbab5b642e%252Fpa%252FRB15615_dbaa715397b4c8634d0a6ebdf2bfa141.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_dbaa715397b4c8634d0a6ebdf2bfa141.jpg saved to cache
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902
2026-03-28 14:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902, skipping ID generation
2026-03-28 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902 with scrape type 1
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902 sending to next pipeline
2026-03-28 14:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902, identifier: RB15615
2026-03-28 14:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae1c13e8-6272-525c-ba3c-63da0671653b with identifier: BB89966
2026-03-28 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae1c13e8-6272-525c-ba3c-63da0671653b with scrape type 1
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ae1c13e8-6272-525c-ba3c-63da0671653b
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fc4%252Fa7c468b7c6d4d4790f40099bc957d226%252Fpa%252FBB89966_d50478cc3b3642a6815a972bf91cf653.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d50478cc3b3642a6815a972bf91cf653.jpg not downloaded yet
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fc8%252F58c8096f3a14beb26da461a0df5ca81d%252Fpa%252FPA52283_4fe55631f9d3b25c2ba1c31d6695735a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4fe55631f9d3b25c2ba1c31d6695735a.jpg not downloaded yet
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_0d2f09ea5f060fc83a6d8aecf9e729e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_0d2f09ea5f060fc83a6d8aecf9e729e7.jpg not downloaded yet
2026-03-28 14:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902 with identifier: RB15615
2026-03-28 14:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902 with identifier: RB15615
2026-03-28 14:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b1b3400-e5fc-5d2c-ba1c-dc221f66b902 with identifier: RB15615 to the API
2026-03-28 14:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_dbaa715397b4c8634d0a6ebdf2bfa141.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 225,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:15:49Z',
 'fuel_type': 'diesel',
 'id': '4b1b3400-e5fc-5d2c-ba1c-dc221f66b902',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB15615',
 'listing': 'auction',
 'location': 'ES, Móstoles',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 30954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_7bbe2f5b5451cd3c2bb61d1b909d5311.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_dbaa715397b4c8634d0a6ebdf2bfa141.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_bf4c27145a9c1be6e0a61f99845cab4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_cd8d3c7601f0650cf72ae86cbd202b27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_2514e6705862d3aba5befef47cbfb9b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_053bd5fa22f4ebae10388f6d308c8d5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_423ab567ab87356b53d3805bb6641b07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_da5cf39025730cd739b8d643d3e6d8ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_d5b4a834e99ab6108f39f9cd1bc3551d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1b3400-e5fc-5d2c-ba1c-dc221f66b902/4b1b3400-e5fc-5d2c-ba1c-dc221f66b902_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/4b/264b2c5ef8379acd22ebc7bbab5b642e/pa/RB15615_db8e0a60f528cc55cbedbf5658aa2974.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-05-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 35 Trendline mittellang Hochdach '
          'FWD',
 'transmission': 'manual',
 'trim': 'Kasten 35 Trendline mittellang Hochdach FWD',
 'year': 2024}
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB15615%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [auto1.es] INFO: Saving data for RB15615: {'created_time': 1774706466.155301, 'last_price_update_time': 1774706466.15531, 'auction_closing_time': 1774883749.0}
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RB15615') HTTP/1.1" 204 0
2026-03-28 14:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4b57aef1872af3c33be046f0fc636281.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_966dbbafc940016db03bcfa15b27e139.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_966dbbafc940016db03bcfa15b27e139.jpg not downloaded yet
2026-03-28 14:01:06 [auto1.es] INFO: Found listing with ID: DH26781
2026-03-28 14:01:06 [auto1.es] INFO: Found listing with ID: XP71209
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP71209%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [auto1.es] INFO: Scrape type for XP71209: 1
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fc4%252Fa7c468b7c6d4d4790f40099bc957d226%252Fpa%252FBB89966_d7a9590ca32811bd4ad9dfbd413b7744.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d7a9590ca32811bd4ad9dfbd413b7744.jpg not downloaded yet
2026-03-28 14:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_fc6ae74efe9233c5de4ecb12a6a4b158.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_607513141d9d6577fbf8c00755d4dccc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_607513141d9d6577fbf8c00755d4dccc.jpg not downloaded yet
2026-03-28 14:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a2003d0>
2026-03-28 14:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d918f0-a69b-58da-a2e9-fb2c560ec41f/40d918f0-a69b-58da-a2e9-fb2c560ec41f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fc8%252F58c8096f3a14beb26da461a0df5ca81d%252Fpa%252FPA52283_f6d8a00a1e786af15da54cf8cde77230.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_f6d8a00a1e786af15da54cf8cde77230.jpg saved to cache
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40d918f0-a69b-58da-a2e9-fb2c560ec41f
2026-03-28 14:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16856b010>
2026-03-28 14:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d918f0-a69b-58da-a2e9-fb2c560ec41f/40d918f0-a69b-58da-a2e9-fb2c560ec41f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fc8%252F58c8096f3a14beb26da461a0df5ca81d%252Fpa%252FPA52283_a70c0055925c49debae2ab7edd7c7ce2.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_a70c0055925c49debae2ab7edd7c7ce2.jpg saved to cache
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40d918f0-a69b-58da-a2e9-fb2c560ec41f
2026-03-28 14:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_a4b055a0b43d6bb190339c0d5ae1b582.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_9bc61b6d64638877159cdcb55c7651c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_9bc61b6d64638877159cdcb55c7651c5.jpg not downloaded yet
2026-03-28 14:01:06 [auto1.es] INFO: Found listing with ID: AT12035
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT12035%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [auto1.es] INFO: Scrape type for AT12035: 2
2026-03-28 14:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60cfbdaf-a332-5ea2-8a02-c90ef4fba69e with identifier: AT12035
2026-03-28 14:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60cfbdaf-a332-5ea2-8a02-c90ef4fba69e with scrape type 2
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60cfbdaf-a332-5ea2-8a02-c90ef4fba69e with scrape type 2
2026-03-28 14:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 60cfbdaf-a332-5ea2-8a02-c90ef4fba69e, identifier: AT12035
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fc4%252Fa7c468b7c6d4d4790f40099bc957d226%252Fpa%252FBB89966_2937281b00ed2eec28d534accaba48e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_2937281b00ed2eec28d534accaba48e3.jpg not downloaded yet
2026-03-28 14:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 60cfbdaf-a332-5ea2-8a02-c90ef4fba69e with identifier: AT12035
2026-03-28 14:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 60cfbdaf-a332-5ea2-8a02-c90ef4fba69e with identifier: AT12035
2026-03-28 14:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 60cfbdaf-a332-5ea2-8a02-c90ef4fba69e with identifier: AT12035 to the API
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:30:18Z',
 'fuel_type': 'petrol',
 'id': '60cfbdaf-a332-5ea2-8a02-c90ef4fba69e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT12035',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 152643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Business",
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT12035%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [auto1.es] INFO: Saving data for AT12035: {'auction_closing_time': 1774884618.0, 'created_time': 1774037130.203405, 'last_price_update_time': 1774706466.875843}
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AT12035') HTTP/1.1" 204 0
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_a493f4b5dcca9d362dff7bd3db9d4996.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_a493f4b5dcca9d362dff7bd3db9d4996.jpg not downloaded yet
2026-03-28 14:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_78b5ee513a3cec78426e1ba4830b158d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_7f3c90c2fe3476dc033f9cf5ec7b71db.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_7f3c90c2fe3476dc033f9cf5ec7b71db.jpg not downloaded yet
2026-03-28 14:01:06 [auto1.es] INFO: Found listing with ID: CB66471
2026-03-28 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB66471%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [auto1.es] INFO: Scrape type for CB66471: 1
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fc4%252Fa7c468b7c6d4d4790f40099bc957d226%252Fpa%252FBB89966_0389f6ad13d94d9922bfbe0281b24a1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_0389f6ad13d94d9922bfbe0281b24a1e.jpg not downloaded yet
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX43091> (referer: https://www.auto1.com/v1/car-details-view/ZX43091/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686e8750>
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d918f0-a69b-58da-a2e9-fb2c560ec41f/40d918f0-a69b-58da-a2e9-fb2c560ec41f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fc8%252F58c8096f3a14beb26da461a0df5ca81d%252Fpa%252FPA52283_4b57aef1872af3c33be046f0fc636281.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4b57aef1872af3c33be046f0fc636281.jpg saved to cache
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40d918f0-a69b-58da-a2e9-fb2c560ec41f
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1685c4690>
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_fc6ae74efe9233c5de4ecb12a6a4b158.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_fc6ae74efe9233c5de4ecb12a6a4b158.jpg saved to cache
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7b73b17-dd7a-5831-afff-fb521530837c
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d50478cc3b3642a6815a972bf91cf653.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_dc5835de08d52cff75661b1201d4ed12.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_dc5835de08d52cff75661b1201d4ed12.jpg not downloaded yet
2026-03-28 14:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG29658> (referer: https://www.auto1.com/v1/car-details-view/HG29658/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a230dd0>
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_a4b055a0b43d6bb190339c0d5ae1b582.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_a4b055a0b43d6bb190339c0d5ae1b582.jpg saved to cache
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_0d2f09ea5f060fc83a6d8aecf9e729e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_fa6a34f19e19238f957338795717e8af.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_fa6a34f19e19238f957338795717e8af.jpg not downloaded yet
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: XJ81708
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ81708%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [auto1.es] INFO: Scrape type for XJ81708: 1
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fc4%252Fa7c468b7c6d4d4790f40099bc957d226%252Fpa%252FBB89966_b73a4dbd849fb4b976f6fd8d5a3f84c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_b73a4dbd849fb4b976f6fd8d5a3f84c0.jpg not downloaded yet
2026-03-28 14:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM37535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA73564/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX86510/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM52348> (referer: https://www.auto1.com/v1/car-details-view/VM52348/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_f7799971876dd910f9b5b3a743c7ccfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_f7799971876dd910f9b5b3a743c7ccfd.jpg not downloaded yet
2026-03-28 14:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687b0ad0>
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_78b5ee513a3cec78426e1ba4830b158d.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_78b5ee513a3cec78426e1ba4830b158d.jpg saved to cache
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7b73b17-dd7a-5831-afff-fb521530837c
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d7a9590ca32811bd4ad9dfbd413b7744.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_a19eec05d9fedf3fd409fa47b0ca7c26.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_a19eec05d9fedf3fd409fa47b0ca7c26.jpg not downloaded yet
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: BT51966
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: WU60183
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: LK89400
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: DV24306
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV24306%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [auto1.es] INFO: Scrape type for DV24306: 1
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fc4%252Fa7c468b7c6d4d4790f40099bc957d226%252Fpa%252FBB89966_d506250363f4e8fde577248948134a26.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d506250363f4e8fde577248948134a26.jpg not downloaded yet
2026-03-28 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606cf93e-550b-5e53-86cb-f3bc05cb276f with identifier: ZX43091
2026-03-28 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606cf93e-550b-5e53-86cb-f3bc05cb276f with scrape type 1
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 606cf93e-550b-5e53-86cb-f3bc05cb276f
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_c419e1554ab21b42d5e6eecec6a27756.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_c419e1554ab21b42d5e6eecec6a27756.jpg not downloaded yet
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_a7c6a3aa1c93f0fe7f09593c80ecc2ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_a7c6a3aa1c93f0fe7f09593c80ecc2ef.jpg not downloaded yet
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1a04d0>
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae1c13e8-6272-525c-ba3c-63da0671653b/ae1c13e8-6272-525c-ba3c-63da0671653b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fc4%252Fa7c468b7c6d4d4790f40099bc957d226%252Fpa%252FBB89966_d50478cc3b3642a6815a972bf91cf653.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d50478cc3b3642a6815a972bf91cf653.jpg saved to cache
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae1c13e8-6272-525c-ba3c-63da0671653b
2026-03-28 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7 with identifier: HG29658
2026-03-28 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7 with scrape type 1
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_ab64614716583e9696d43dab7b5c372e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_ab64614716583e9696d43dab7b5c372e.jpg not downloaded yet
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_a493f4b5dcca9d362dff7bd3db9d4996.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_9bc61b6d64638877159cdcb55c7651c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_faee75d35318a1f417ade097a683ad67.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_faee75d35318a1f417ade097a683ad67.jpg not downloaded yet
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: TV24981
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV24981%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [auto1.es] INFO: Scrape type for TV24981: 1
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_49d8abe63d458dfcb9a81f4544d1ac37.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_49d8abe63d458dfcb9a81f4544d1ac37.jpg not downloaded yet
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0619d0>
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_0d2f09ea5f060fc83a6d8aecf9e729e7.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_0d2f09ea5f060fc83a6d8aecf9e729e7.jpg saved to cache
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_2937281b00ed2eec28d534accaba48e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_af0ec0f1836b919f130042fe0bc77381.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_af0ec0f1836b919f130042fe0bc77381.jpg not downloaded yet
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_ced2292692fc66f39fe43e1a7005b781.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_ced2292692fc66f39fe43e1a7005b781.jpg not downloaded yet
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK07615> (referer: https://www.auto1.com/v1/car-details-view/RK07615/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ada84653-04cf-57b5-bde0-f01b811d8707 with identifier: VM52348
2026-03-28 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ada84653-04cf-57b5-bde0-f01b811d8707 with scrape type 1
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ada84653-04cf-57b5-bde0-f01b811d8707
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_49dcc7d9411f5c6c79334b94db6a2cc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_49dcc7d9411f5c6c79334b94db6a2cc8.jpg not downloaded yet
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_7f3c90c2fe3476dc033f9cf5ec7b71db.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_607513141d9d6577fbf8c00755d4dccc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: PC32522
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: HV31906
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV31906%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [auto1.es] INFO: Scrape type for HV31906: 1
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_559450ddc22984cfff4a15ce219731b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_559450ddc22984cfff4a15ce219731b0.jpg not downloaded yet
2026-03-28 14:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0f80d0>
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae1c13e8-6272-525c-ba3c-63da0671653b/ae1c13e8-6272-525c-ba3c-63da0671653b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fc4%252Fa7c468b7c6d4d4790f40099bc957d226%252Fpa%252FBB89966_d7a9590ca32811bd4ad9dfbd413b7744.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d7a9590ca32811bd4ad9dfbd413b7744.jpg saved to cache
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae1c13e8-6272-525c-ba3c-63da0671653b
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_0389f6ad13d94d9922bfbe0281b24a1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_dc5835de08d52cff75661b1201d4ed12.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_9e7bb2df9ad2ea4571c8048139ab62d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_9e7bb2df9ad2ea4571c8048139ab62d9.jpg not downloaded yet
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_cb662135079c3cd883048ecc87d08db5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_cb662135079c3cd883048ecc87d08db5.jpg not downloaded yet
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_31783b97c8b96ee283772dc3630c7e36.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_31783b97c8b96ee283772dc3630c7e36.jpg not downloaded yet
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168525cd0>
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_a493f4b5dcca9d362dff7bd3db9d4996.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_a493f4b5dcca9d362dff7bd3db9d4996.jpg saved to cache
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a03ae90>
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_9bc61b6d64638877159cdcb55c7651c5.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_9bc61b6d64638877159cdcb55c7651c5.jpg saved to cache
2026-03-28 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7b73b17-dd7a-5831-afff-fb521530837c
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: CP18304
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: YD38751
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: MF35221
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: LR44040
2026-03-28 14:01:07 [auto1.es] INFO: Found listing with ID: XZ62069
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ62069%27 HTTP/1.1" 200 None
2026-03-28 14:01:07 [auto1.es] INFO: Scrape type for XZ62069: 1
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_8e2814fc8574aaa90c0e2475eb783e2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_8e2814fc8574aaa90c0e2475eb783e2c.jpg not downloaded yet
2026-03-28 14:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_b73a4dbd849fb4b976f6fd8d5a3f84c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_c419e1554ab21b42d5e6eecec6a27756.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_df6a7995bbdc70b165103a8ce3e2c062.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_df6a7995bbdc70b165103a8ce3e2c062.jpg not downloaded yet
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_54bc891aa2d667c8648ab1a0adc0b1f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_54bc891aa2d667c8648ab1a0adc0b1f5.jpg not downloaded yet
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a38d610>
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae1c13e8-6272-525c-ba3c-63da0671653b/ae1c13e8-6272-525c-ba3c-63da0671653b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fc4%252Fa7c468b7c6d4d4790f40099bc957d226%252Fpa%252FBB89966_2937281b00ed2eec28d534accaba48e3.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_2937281b00ed2eec28d534accaba48e3.jpg saved to cache
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae1c13e8-6272-525c-ba3c-63da0671653b
2026-03-28 14:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c0ef87-257c-5b44-8e73-e14d114b963d with identifier: RK07615
2026-03-28 14:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c0ef87-257c-5b44-8e73-e14d114b963d with scrape type 1
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0c0ef87-257c-5b44-8e73-e14d114b963d
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_d802403840bf4179be483d45e4519a3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_d802403840bf4179be483d45e4519a3a.jpg not downloaded yet
2026-03-28 14:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_ab64614716583e9696d43dab7b5c372e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d506250363f4e8fde577248948134a26.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:08 [auto1.es] INFO: Found listing with ID: LV43298
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV43298%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [auto1.es] INFO: Scrape type for LV43298: 2
2026-03-28 14:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ef091a4-8008-559d-abef-e5f60b7e6e37 with identifier: LV43298
2026-03-28 14:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef091a4-8008-559d-abef-e5f60b7e6e37 with scrape type 2
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ef091a4-8008-559d-abef-e5f60b7e6e37 with scrape type 2
2026-03-28 14:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5ef091a4-8008-559d-abef-e5f60b7e6e37, identifier: LV43298
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_a26530ef3bfc06b5e1a0f4a50929a26e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_a26530ef3bfc06b5e1a0f4a50929a26e.jpg not downloaded yet
2026-03-28 14:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA80671> (referer: https://www.auto1.com/v1/car-details-view/EA80671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff17a017d50>
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_7f3c90c2fe3476dc033f9cf5ec7b71db.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_7f3c90c2fe3476dc033f9cf5ec7b71db.jpg saved to cache
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7b73b17-dd7a-5831-afff-fb521530837c
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168519590>
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_607513141d9d6577fbf8c00755d4dccc.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_607513141d9d6577fbf8c00755d4dccc.jpg saved to cache
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c3f5410>
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae1c13e8-6272-525c-ba3c-63da0671653b/ae1c13e8-6272-525c-ba3c-63da0671653b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fc4%252Fa7c468b7c6d4d4790f40099bc957d226%252Fpa%252FBB89966_0389f6ad13d94d9922bfbe0281b24a1e.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_0389f6ad13d94d9922bfbe0281b24a1e.jpg saved to cache
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae1c13e8-6272-525c-ba3c-63da0671653b
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168544f50>
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_dc5835de08d52cff75661b1201d4ed12.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_dc5835de08d52cff75661b1201d4ed12.jpg saved to cache
2026-03-28 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c
2026-03-28 14:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_faee75d35318a1f417ade097a683ad67.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_49d8abe63d458dfcb9a81f4544d1ac37.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5ef091a4-8008-559d-abef-e5f60b7e6e37 with identifier: LV43298
2026-03-28 14:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5ef091a4-8008-559d-abef-e5f60b7e6e37 with identifier: LV43298
2026-03-28 14:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5ef091a4-8008-559d-abef-e5f60b7e6e37 with identifier: LV43298 to the API
2026-03-28 14:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:50Z',
 'fuel_type': 'diesel',
 'id': '5ef091a4-8008-559d-abef-e5f60b7e6e37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV43298',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 107845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-04',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV43298%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [auto1.es] INFO: Saving data for LV43298: {'auction_closing_time': 1774885010.0, 'created_time': 1773432286.434778, 'last_price_update_time': 1774706469.209027}
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LV43298') HTTP/1.1" 204 0
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_904c711dd8cbff5d1f8ac81950b17461.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_904c711dd8cbff5d1f8ac81950b17461.jpg not downloaded yet
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_25b60fc5289a12f2ffc18b6ea9be64db.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_25b60fc5289a12f2ffc18b6ea9be64db.jpg not downloaded yet
2026-03-28 14:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_d783c73aaa044500027338ec47ae9249.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_d783c73aaa044500027338ec47ae9249.jpg not downloaded yet
2026-03-28 14:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_49dcc7d9411f5c6c79334b94db6a2cc8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:09 [auto1.es] INFO: Found listing with ID: AW26906
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW26906%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [auto1.es] INFO: Scrape type for AW26906: 1
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_02fbc47841ec0aaea8d393b844fd38d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_02fbc47841ec0aaea8d393b844fd38d9.jpg not downloaded yet
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a242390>
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae1c13e8-6272-525c-ba3c-63da0671653b/ae1c13e8-6272-525c-ba3c-63da0671653b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fc4%252Fa7c468b7c6d4d4790f40099bc957d226%252Fpa%252FBB89966_b73a4dbd849fb4b976f6fd8d5a3f84c0.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_b73a4dbd849fb4b976f6fd8d5a3f84c0.jpg saved to cache
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae1c13e8-6272-525c-ba3c-63da0671653b
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0a1b90>
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_c419e1554ab21b42d5e6eecec6a27756.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_c419e1554ab21b42d5e6eecec6a27756.jpg saved to cache
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 606cf93e-550b-5e53-86cb-f3bc05cb276f
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_6dc381c6ccb1887a12811307335089a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_6dc381c6ccb1887a12811307335089a4.jpg not downloaded yet
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_978a24ee99df7bd0ab3f399337fabe61.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_978a24ee99df7bd0ab3f399337fabe61.jpg not downloaded yet
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_fc0a15b6a1f2d7c39eaf184fba1c443e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_fc0a15b6a1f2d7c39eaf184fba1c443e.jpg not downloaded yet
2026-03-28 14:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM41258/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0d3350>
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_ab64614716583e9696d43dab7b5c372e.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_ab64614716583e9696d43dab7b5c372e.jpg saved to cache
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0ad410>
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae1c13e8-6272-525c-ba3c-63da0671653b/ae1c13e8-6272-525c-ba3c-63da0671653b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fc4%252Fa7c468b7c6d4d4790f40099bc957d226%252Fpa%252FBB89966_d506250363f4e8fde577248948134a26.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d506250363f4e8fde577248948134a26.jpg saved to cache
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae1c13e8-6272-525c-ba3c-63da0671653b
2026-03-28 14:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae1c13e8-6272-525c-ba3c-63da0671653b, skipping ID generation
2026-03-28 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae1c13e8-6272-525c-ba3c-63da0671653b with scrape type 1
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae1c13e8-6272-525c-ba3c-63da0671653b sending to next pipeline
2026-03-28 14:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ae1c13e8-6272-525c-ba3c-63da0671653b, identifier: BB89966
2026-03-28 14:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6b8f4d5-4fcc-5810-b879-f57f30b77bfd with identifier: EA80671
2026-03-28 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd with scrape type 1
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_66367e1da309d18313281cfad7580fc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_66367e1da309d18313281cfad7580fc3.jpg not downloaded yet
2026-03-28 14:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_cb662135079c3cd883048ecc87d08db5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_31783b97c8b96ee283772dc3630c7e36.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:09 [auto1.es] INFO: Found listing with ID: BF82684
2026-03-28 14:01:09 [auto1.es] INFO: Found listing with ID: LS22424
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS22424%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [auto1.es] INFO: Scrape type for LS22424: 2
2026-03-28 14:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 393dd323-0535-5433-a08e-855df4e81ae8 with identifier: LS22424
2026-03-28 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 393dd323-0535-5433-a08e-855df4e81ae8 with scrape type 2
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 393dd323-0535-5433-a08e-855df4e81ae8 with scrape type 2
2026-03-28 14:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 393dd323-0535-5433-a08e-855df4e81ae8, identifier: LS22424
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_0ed36568dde255f3881f5bf39d37135f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_0ed36568dde255f3881f5bf39d37135f.jpg not downloaded yet
2026-03-28 14:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE54234/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU18953> (referer: https://www.auto1.com/v1/car-details-view/GU18953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL95591> (referer: https://www.auto1.com/v1/car-details-view/XL95591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ae1c13e8-6272-525c-ba3c-63da0671653b with identifier: BB89966
2026-03-28 14:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ae1c13e8-6272-525c-ba3c-63da0671653b with identifier: BB89966
2026-03-28 14:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ae1c13e8-6272-525c-ba3c-63da0671653b with identifier: BB89966 to the API
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d506250363f4e8fde577248948134a26.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:04:45Z',
 'fuel_type': 'petrol',
 'id': 'ae1c13e8-6272-525c-ba3c-63da0671653b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB89966',
 'listing': 'auction',
 'location': 'ES, Alcobendas',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 135793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1c13e8-6272-525c-ba3c-63da0671653b/ae1c13e8-6272-525c-ba3c-63da0671653b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d50478cc3b3642a6815a972bf91cf653.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1c13e8-6272-525c-ba3c-63da0671653b/ae1c13e8-6272-525c-ba3c-63da0671653b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d7a9590ca32811bd4ad9dfbd413b7744.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1c13e8-6272-525c-ba3c-63da0671653b/ae1c13e8-6272-525c-ba3c-63da0671653b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_2937281b00ed2eec28d534accaba48e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1c13e8-6272-525c-ba3c-63da0671653b/ae1c13e8-6272-525c-ba3c-63da0671653b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_0389f6ad13d94d9922bfbe0281b24a1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1c13e8-6272-525c-ba3c-63da0671653b/ae1c13e8-6272-525c-ba3c-63da0671653b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_b73a4dbd849fb4b976f6fd8d5a3f84c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1c13e8-6272-525c-ba3c-63da0671653b/ae1c13e8-6272-525c-ba3c-63da0671653b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/c4/a7c468b7c6d4d4790f40099bc957d226/pa/BB89966_d506250363f4e8fde577248948134a26.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Smart forfour 1.5 Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2006}
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB89966%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [auto1.es] INFO: Saving data for BB89966: {'created_time': 1774706470.312083, 'last_price_update_time': 1774706470.312093, 'auction_closing_time': 1774883085.0}
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BB89966') HTTP/1.1" 204 0
2026-03-28 14:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_8e2814fc8574aaa90c0e2475eb783e2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 393dd323-0535-5433-a08e-855df4e81ae8 with identifier: LS22424
2026-03-28 14:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 393dd323-0535-5433-a08e-855df4e81ae8 with identifier: LS22424
2026-03-28 14:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 393dd323-0535-5433-a08e-855df4e81ae8 with identifier: LS22424 to the API
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:47:43Z',
 'fuel_type': 'hybrid',
 'id': '393dd323-0535-5433-a08e-855df4e81ae8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS22424',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 130825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-12',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2017}
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS22424%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [auto1.es] INFO: Saving data for LS22424: {'auction_closing_time': 1774885663.0, 'created_time': 1773128743.234298, 'last_price_update_time': 1774706470.755278}
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LS22424') HTTP/1.1" 204 0
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_2dade0b359e430032da80a713832aa1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_2dade0b359e430032da80a713832aa1b.jpg not downloaded yet
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_9f05bb640e73e894b5eb2f8fe4107b28.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_9f05bb640e73e894b5eb2f8fe4107b28.jpg not downloaded yet
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_f9023ac25d39e1e58c15382a56413f08.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_f9023ac25d39e1e58c15382a56413f08.jpg not downloaded yet
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_96e790a343c48987d32c5d68536381e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_96e790a343c48987d32c5d68536381e1.jpg not downloaded yet
2026-03-28 14:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684ff950>
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_faee75d35318a1f417ade097a683ad67.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_faee75d35318a1f417ade097a683ad67.jpg saved to cache
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7b73b17-dd7a-5831-afff-fb521530837c
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff169fd94d0>
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_49d8abe63d458dfcb9a81f4544d1ac37.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_49d8abe63d458dfcb9a81f4544d1ac37.jpg saved to cache
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 606cf93e-550b-5e53-86cb-f3bc05cb276f
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168602490>
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_49dcc7d9411f5c6c79334b94db6a2cc8.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_49dcc7d9411f5c6c79334b94db6a2cc8.jpg saved to cache
2026-03-28 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ada84653-04cf-57b5-bde0-f01b811d8707
2026-03-28 14:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_d802403840bf4179be483d45e4519a3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_df6a7995bbdc70b165103a8ce3e2c062.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_54bc891aa2d667c8648ab1a0adc0b1f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:11 [scrapy.extensions.logstats] INFO: Crawled 96 pages (at 96 pages/min), scraped 43 items (at 43 items/min)
2026-03-28 14:01:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: JN16141
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: RE29158
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: XM37259
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: DD08743
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD08743%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for DD08743: 1
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_cd4d8fc156bf2f528cf2e520164b70c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_cd4d8fc156bf2f528cf2e520164b70c6.jpg not downloaded yet
2026-03-28 14:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_a26530ef3bfc06b5e1a0f4a50929a26e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_01a2c44878cfbf00a76d5d19c5f6e1d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_01a2c44878cfbf00a76d5d19c5f6e1d2.jpg not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_bb48724f97672dd0377a9f3e3047617c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_bb48724f97672dd0377a9f3e3047617c.jpg not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_e9cc7299ec4ded7f56d6088210137f53.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_e9cc7299ec4ded7f56d6088210137f53.jpg not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_b590b83516e8f86a49a63be387e22dda.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_b590b83516e8f86a49a63be387e22dda.jpg not downloaded yet
2026-03-28 14:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV24981/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:11 [auto1.es] INFO: Channel: 24h | Page: 5 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a332750>
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_cb662135079c3cd883048ecc87d08db5.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_cb662135079c3cd883048ecc87d08db5.jpg saved to cache
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1903d0>
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_31783b97c8b96ee283772dc3630c7e36.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_31783b97c8b96ee283772dc3630c7e36.jpg saved to cache
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ada84653-04cf-57b5-bde0-f01b811d8707
2026-03-28 14:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 482bac9e-8792-586e-ba64-8ecd7a4ac47c with identifier: GU18953
2026-03-28 14:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c with scrape type 1
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_9611f70d8d7bcea33b0451331f2aa05f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_9611f70d8d7bcea33b0451331f2aa05f.jpg not downloaded yet
2026-03-28 14:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad with identifier: XL95591
2026-03-28 14:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad with scrape type 1
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F6e%252Fa66e077b66ce47a3862f1c5f37fa82f2%252Fpa%252FXL95591_bdfb77042c6e2d4375d31d9b6814079d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_bdfb77042c6e2d4375d31d9b6814079d.jpg not downloaded yet
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: MB84722
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: LJ76741
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: EJ15822
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ15822%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for EJ15822: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: MY16878
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: SR36141
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: PW93745
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW93745%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for PW93745: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: RW31062
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW31062%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for RW31062: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: UB86701
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: XP60269
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP60269%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for XP60269: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: KL17964
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: NM08693
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_4904c59d9f3886c9eeffe48abc2e99e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_4904c59d9f3886c9eeffe48abc2e99e1.jpg not downloaded yet
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff169fe7590>
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_8e2814fc8574aaa90c0e2475eb783e2c.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_8e2814fc8574aaa90c0e2475eb783e2c.jpg saved to cache
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 606cf93e-550b-5e53-86cb-f3bc05cb276f
2026-03-28 14:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_d783c73aaa044500027338ec47ae9249.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_7063d24ef101c6364c58cf2ddb952af5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_7063d24ef101c6364c58cf2ddb952af5.jpg not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_4dd5134f379e6ca06d7eac9225f1e591.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_4dd5134f379e6ca06d7eac9225f1e591.jpg not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_cf5a16e9521ffb2b76c8b1dfc5dc3eb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_cf5a16e9521ffb2b76c8b1dfc5dc3eb8.jpg not downloaded yet
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_f41f7510b87ad3c24253ba203660126d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_f41f7510b87ad3c24253ba203660126d.jpg not downloaded yet
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: MM24927
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: WG45325
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG45325%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for WG45325: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: MD68479
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD68479%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for MD68479: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: AZ60367
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: LJ63273
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ63273%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for LJ63273: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: EH03748
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: GF33961
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: LX05735
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX05735%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for LX05735: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: FX69665
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: NV64390
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: UH53722
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: UP08006
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP08006%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for UP08006: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: AP47288
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP47288%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for AP47288: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: EG51857
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG51857%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for EG51857: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: TS53334
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS53334%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for TS53334: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: HP31470
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: TW94946
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW94946%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for TW94946: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: KE70928
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE70928%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for KE70928: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: HX30017
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX30017%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for HX30017: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: PE66788
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: WA65207
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: SY19830
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY19830%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for SY19830: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: RR07700
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: RF07402
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF07402%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for RF07402: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: FR94321
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR94321%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for FR94321: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: UA24744
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA24744%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for UA24744: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: US29597
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: NJ67875
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ67875%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for NJ67875: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: XF82752
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: RK77233
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: YJ22884
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ22884%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for YJ22884: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: VV48329
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV48329%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for VV48329: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: NR06421
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: UE40961
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: KH51643
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH51643%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for KH51643: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: VK88655
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: LX19850
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: VY33491
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: MK70823
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK70823%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [auto1.es] INFO: Scrape type for MK70823: 0
2026-03-28 14:01:11 [auto1.es] INFO: Found listing with ID: WJ13987
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_4704bed224abc817ed2854265dc9d217.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_4704bed224abc817ed2854265dc9d217.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F6e%252Fa66e077b66ce47a3862f1c5f37fa82f2%252Fpa%252FXL95591_ac55e467594308e66743eb6c56bfe217.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_ac55e467594308e66743eb6c56bfe217.jpg not downloaded yet
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_66367e1da309d18313281cfad7580fc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_02fbc47841ec0aaea8d393b844fd38d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_6dc381c6ccb1887a12811307335089a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_25b60fc5289a12f2ffc18b6ea9be64db.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_fc0a15b6a1f2d7c39eaf184fba1c443e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_978a24ee99df7bd0ab3f399337fabe61.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_cf7d2347bef293d82c7a7a66fdc460e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_cf7d2347bef293d82c7a7a66fdc460e2.jpg not downloaded yet
2026-03-28 14:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168468a90>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_d802403840bf4179be483d45e4519a3a.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_d802403840bf4179be483d45e4519a3a.jpg saved to cache
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0c0ef87-257c-5b44-8e73-e14d114b963d
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff169fedc10>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_df6a7995bbdc70b165103a8ce3e2c062.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_df6a7995bbdc70b165103a8ce3e2c062.jpg saved to cache
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a03c090>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_54bc891aa2d667c8648ab1a0adc0b1f5.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_54bc891aa2d667c8648ab1a0adc0b1f5.jpg saved to cache
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ada84653-04cf-57b5-bde0-f01b811d8707
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168635010>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_a26530ef3bfc06b5e1a0f4a50929a26e.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_a26530ef3bfc06b5e1a0f4a50929a26e.jpg saved to cache
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 606cf93e-550b-5e53-86cb-f3bc05cb276f
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_0ed36568dde255f3881f5bf39d37135f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_705df80ec0b3bee7048320dff8189285.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_705df80ec0b3bee7048320dff8189285.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_0c72aa93c8414110ddfd4321ea67c7c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_0c72aa93c8414110ddfd4321ea67c7c4.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_38b219ebd0397bab46558075e442344d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_38b219ebd0397bab46558075e442344d.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_84fc475c3fb2f3c8f5f2c81f96efa745.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_84fc475c3fb2f3c8f5f2c81f96efa745.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_92edeb0669c7c89b4b6ce9b65b2e8cc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_92edeb0669c7c89b4b6ce9b65b2e8cc4.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F6e%252Fa66e077b66ce47a3862f1c5f37fa82f2%252Fpa%252FXL95591_cfe5ae37a911f0017310b9ab949c58b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_cfe5ae37a911f0017310b9ab949c58b3.jpg not downloaded yet
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB66471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a3265d0>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_d783c73aaa044500027338ec47ae9249.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_d783c73aaa044500027338ec47ae9249.jpg saved to cache
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0c0ef87-257c-5b44-8e73-e14d114b963d
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_7ecbcd3dd4e379c75f2b7470a53c1806.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_7ecbcd3dd4e379c75f2b7470a53c1806.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_14e99f6e1a63cda4f0989bb2ef195eca.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_14e99f6e1a63cda4f0989bb2ef195eca.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_1593356a9db7091035a0b85cf4d0882d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_1593356a9db7091035a0b85cf4d0882d.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_f790eed85464d578a36add93780f8561.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_f790eed85464d578a36add93780f8561.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F6e%252Fa66e077b66ce47a3862f1c5f37fa82f2%252Fpa%252FXL95591_eb96c2e5088de36f9f3f7f4adbf450a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_eb96c2e5088de36f9f3f7f4adbf450a5.jpg not downloaded yet
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX86510> (referer: https://www.auto1.com/v1/car-details-view/HX86510/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168786e90>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_66367e1da309d18313281cfad7580fc3.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_66367e1da309d18313281cfad7580fc3.jpg saved to cache
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a127610>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_02fbc47841ec0aaea8d393b844fd38d9.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_02fbc47841ec0aaea8d393b844fd38d9.jpg saved to cache
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 606cf93e-550b-5e53-86cb-f3bc05cb276f
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686eb390>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_6dc381c6ccb1887a12811307335089a4.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_6dc381c6ccb1887a12811307335089a4.jpg saved to cache
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a031f90>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_25b60fc5289a12f2ffc18b6ea9be64db.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_25b60fc5289a12f2ffc18b6ea9be64db.jpg saved to cache
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ada84653-04cf-57b5-bde0-f01b811d8707
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684b5290>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_fc0a15b6a1f2d7c39eaf184fba1c443e.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_fc0a15b6a1f2d7c39eaf184fba1c443e.jpg saved to cache
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0c0ef87-257c-5b44-8e73-e14d114b963d
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16879d110>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_978a24ee99df7bd0ab3f399337fabe61.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_978a24ee99df7bd0ab3f399337fabe61.jpg saved to cache
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ada84653-04cf-57b5-bde0-f01b811d8707
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_96e790a343c48987d32c5d68536381e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_cd4d8fc156bf2f528cf2e520164b70c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_904c711dd8cbff5d1f8ac81950b17461.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_9611f70d8d7bcea33b0451331f2aa05f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_bdfb77042c6e2d4375d31d9b6814079d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_b590b83516e8f86a49a63be387e22dda.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_4904c59d9f3886c9eeffe48abc2e99e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_ce3360aef285351176d0685672f5e859.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_ce3360aef285351176d0685672f5e859.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_b68bfdb2797d73bdd59e690c640ddac7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_b68bfdb2797d73bdd59e690c640ddac7.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_0290306745735263ae40ecfe317603c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_0290306745735263ae40ecfe317603c8.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F6e%252Fa66e077b66ce47a3862f1c5f37fa82f2%252Fpa%252FXL95591_236aa849f88a5a0cf60b5327374a80ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_236aa849f88a5a0cf60b5327374a80ae.jpg not downloaded yet
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687a1510>
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_0ed36568dde255f3881f5bf39d37135f.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_0ed36568dde255f3881f5bf39d37135f.jpg saved to cache
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 606cf93e-550b-5e53-86cb-f3bc05cb276f
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_9e7bb2df9ad2ea4571c8048139ab62d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_5703a15a18aaa98487091cc9a99ae417.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_5703a15a18aaa98487091cc9a99ae417.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_094e38efd69fdecffe351daed914a862.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_094e38efd69fdecffe351daed914a862.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_8015099d376d9c6a1c92541f6905c22d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_8015099d376d9c6a1c92541f6905c22d.jpg not downloaded yet
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F6e%252Fa66e077b66ce47a3862f1c5f37fa82f2%252Fpa%252FXL95591_e39b0f0b2c7c51ed29e070a0e5f954c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_e39b0f0b2c7c51ed29e070a0e5f954c4.jpg not downloaded yet
2026-03-28 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ62069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbff2e3e-abbe-57d5-90b4-35397d4ec74a with identifier: HX86510
2026-03-28 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbff2e3e-abbe-57d5-90b4-35397d4ec74a with scrape type 1
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbff2e3e-abbe-57d5-90b4-35397d4ec74a
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F70%252Fa970aec4cab1a1bc23510cec8ab69852%252Fpa%252FHX86510_c10a6bf6768f78bb84e4a3c58522c75a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_c10a6bf6768f78bb84e4a3c58522c75a.jpg already downloaded
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F70%252Fa970aec4cab1a1bc23510cec8ab69852%252Fpa%252FHX86510_550e8effd3e8e57a2a921a5055143ca3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_550e8effd3e8e57a2a921a5055143ca3.jpg already downloaded
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F70%252Fa970aec4cab1a1bc23510cec8ab69852%252Fpa%252FHX86510_17c54d093169020217da0d30f0607879.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_17c54d093169020217da0d30f0607879.jpg already downloaded
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F70%252Fa970aec4cab1a1bc23510cec8ab69852%252Fpa%252FHX86510_5d04e64214dd1c107204193fd69ae2c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_5d04e64214dd1c107204193fd69ae2c8.jpg already downloaded
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F70%252Fa970aec4cab1a1bc23510cec8ab69852%252Fpa%252FHX86510_1dea69e6a8e9044d231e39dff2e69747.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_1dea69e6a8e9044d231e39dff2e69747.jpg already downloaded
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F70%252Fa970aec4cab1a1bc23510cec8ab69852%252Fpa%252FHX86510_30a54e892ead00e1606cd5da5cf5d637.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_30a54e892ead00e1606cd5da5cf5d637.jpg already downloaded
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F70%252Fa970aec4cab1a1bc23510cec8ab69852%252Fpa%252FHX86510_a88d06dff1b27e36f8aefb1f2f6bf1e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_a88d06dff1b27e36f8aefb1f2f6bf1e1.jpg already downloaded
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F70%252Fa970aec4cab1a1bc23510cec8ab69852%252Fpa%252FHX86510_3d9fce0bd3666cbba6de8e81f7e82a84.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_3d9fce0bd3666cbba6de8e81f7e82a84.jpg already downloaded
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F70%252Fa970aec4cab1a1bc23510cec8ab69852%252Fpa%252FHX86510_7e66301b421eb0f95fbb70d4170e1407.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_7e66301b421eb0f95fbb70d4170e1407.jpg already downloaded
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F70%252Fa970aec4cab1a1bc23510cec8ab69852%252Fpa%252FHX86510_d58984a6e3c18b23b999311e75c8f674.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_d58984a6e3c18b23b999311e75c8f674.jpg already downloaded
2026-03-28 14:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bbff2e3e-abbe-57d5-90b4-35397d4ec74a, identifier: HX86510
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684f4f90>
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_96e790a343c48987d32c5d68536381e1.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_96e790a343c48987d32c5d68536381e1.jpg saved to cache
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16afec590>
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_cd4d8fc156bf2f528cf2e520164b70c6.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_cd4d8fc156bf2f528cf2e520164b70c6.jpg saved to cache
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 606cf93e-550b-5e53-86cb-f3bc05cb276f
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684ff850>
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_904c711dd8cbff5d1f8ac81950b17461.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_904c711dd8cbff5d1f8ac81950b17461.jpg saved to cache
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168476550>
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_9611f70d8d7bcea33b0451331f2aa05f.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_9611f70d8d7bcea33b0451331f2aa05f.jpg saved to cache
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0c0650>
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad/9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F6e%252Fa66e077b66ce47a3862f1c5f37fa82f2%252Fpa%252FXL95591_bdfb77042c6e2d4375d31d9b6814079d.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_bdfb77042c6e2d4375d31d9b6814079d.jpg saved to cache
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1d5890>
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_b590b83516e8f86a49a63be387e22dda.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_b590b83516e8f86a49a63be387e22dda.jpg saved to cache
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168474650>
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_4904c59d9f3886c9eeffe48abc2e99e1.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_4904c59d9f3886c9eeffe48abc2e99e1.jpg saved to cache
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 606cf93e-550b-5e53-86cb-f3bc05cb276f
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_530be931160a93558dafd37e3423e2ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_530be931160a93558dafd37e3423e2ad.jpg not downloaded yet
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_a99ca60ecd00cc5d2add56f9d068ab56.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_a99ca60ecd00cc5d2add56f9d068ab56.jpg not downloaded yet
2026-03-28 14:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bbff2e3e-abbe-57d5-90b4-35397d4ec74a with identifier: HX86510
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 14:01:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bbff2e3e-abbe-57d5-90b4-35397d4ec74a with identifier: HX86510
2026-03-28 14:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bbff2e3e-abbe-57d5-90b4-35397d4ec74a with identifier: HX86510 to the API
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HX86510>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:03Z',
 'fuel_type': 'gas',
 'id': 'bbff2e3e-abbe-57d5-90b4-35397d4ec74a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX86510',
 'listing': 'auction',
 'location': 'ES, Alcalá de Henares, Madrid',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 259969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_c10a6bf6768f78bb84e4a3c58522c75a.jpg',
                'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_550e8effd3e8e57a2a921a5055143ca3.jpg',
                'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_17c54d093169020217da0d30f0607879.jpg',
                'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_5d04e64214dd1c107204193fd69ae2c8.jpg',
                'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_1dea69e6a8e9044d231e39dff2e69747.jpg',
                'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_30a54e892ead00e1606cd5da5cf5d637.jpg',
                'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_a88d06dff1b27e36f8aefb1f2f6bf1e1.jpg',
                'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_3d9fce0bd3666cbba6de8e81f7e82a84.jpg',
                'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_7e66301b421eb0f95fbb70d4170e1407.jpg',
                'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_d58984a6e3c18b23b999311e75c8f674.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbff2e3e-abbe-57d5-90b4-35397d4ec74a/bbff2e3e-abbe-57d5-90b4-35397d4ec74a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_c10a6bf6768f78bb84e4a3c58522c75a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbff2e3e-abbe-57d5-90b4-35397d4ec74a/bbff2e3e-abbe-57d5-90b4-35397d4ec74a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_550e8effd3e8e57a2a921a5055143ca3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbff2e3e-abbe-57d5-90b4-35397d4ec74a/bbff2e3e-abbe-57d5-90b4-35397d4ec74a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_17c54d093169020217da0d30f0607879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbff2e3e-abbe-57d5-90b4-35397d4ec74a/bbff2e3e-abbe-57d5-90b4-35397d4ec74a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_5d04e64214dd1c107204193fd69ae2c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbff2e3e-abbe-57d5-90b4-35397d4ec74a/bbff2e3e-abbe-57d5-90b4-35397d4ec74a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_1dea69e6a8e9044d231e39dff2e69747.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbff2e3e-abbe-57d5-90b4-35397d4ec74a/bbff2e3e-abbe-57d5-90b4-35397d4ec74a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_30a54e892ead00e1606cd5da5cf5d637.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbff2e3e-abbe-57d5-90b4-35397d4ec74a/bbff2e3e-abbe-57d5-90b4-35397d4ec74a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_a88d06dff1b27e36f8aefb1f2f6bf1e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbff2e3e-abbe-57d5-90b4-35397d4ec74a/bbff2e3e-abbe-57d5-90b4-35397d4ec74a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_3d9fce0bd3666cbba6de8e81f7e82a84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbff2e3e-abbe-57d5-90b4-35397d4ec74a/bbff2e3e-abbe-57d5-90b4-35397d4ec74a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_7e66301b421eb0f95fbb70d4170e1407.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbff2e3e-abbe-57d5-90b4-35397d4ec74a/bbff2e3e-abbe-57d5-90b4-35397d4ec74a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/70/a970aec4cab1a1bc23510cec8ab69852/pa/HX86510_d58984a6e3c18b23b999311e75c8f674.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TGI Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2017}
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX86510%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [auto1.es] INFO: Saving data for HX86510: {'created_time': 1774706474.281387, 'last_price_update_time': 1774706474.281398, 'auction_closing_time': 1774883943.0}
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HX86510') HTTP/1.1" 204 0
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_f790eed85464d578a36add93780f8561.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_cfe5ae37a911f0017310b9ab949c58b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_eb96c2e5088de36f9f3f7f4adbf450a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_14e99f6e1a63cda4f0989bb2ef195eca.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_1593356a9db7091035a0b85cf4d0882d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_7ecbcd3dd4e379c75f2b7470a53c1806.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_ac55e467594308e66743eb6c56bfe217.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_92edeb0669c7c89b4b6ce9b65b2e8cc4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_197f140d5ec62ae6bc00951410fc7e94.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_197f140d5ec62ae6bc00951410fc7e94.jpg not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_1ea478480db9d232e0e4e1119b77b80c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_1ea478480db9d232e0e4e1119b77b80c.jpg not downloaded yet
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW26906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a25bed0>
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_9e7bb2df9ad2ea4571c8048139ab62d9.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_9e7bb2df9ad2ea4571c8048139ab62d9.jpg saved to cache
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_a75c9ab2595ad10314bbd55e3d352295.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_a75c9ab2595ad10314bbd55e3d352295.jpg not downloaded yet
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_869af871ff17488a2e29ce7a67faeb10.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_869af871ff17488a2e29ce7a67faeb10.jpg not downloaded yet
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686d6950>
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_f790eed85464d578a36add93780f8561.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_f790eed85464d578a36add93780f8561.jpg saved to cache
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1603d0>
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad/9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F6e%252Fa66e077b66ce47a3862f1c5f37fa82f2%252Fpa%252FXL95591_cfe5ae37a911f0017310b9ab949c58b3.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_cfe5ae37a911f0017310b9ab949c58b3.jpg saved to cache
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684cf210>
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad/9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F6e%252Fa66e077b66ce47a3862f1c5f37fa82f2%252Fpa%252FXL95591_eb96c2e5088de36f9f3f7f4adbf450a5.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_eb96c2e5088de36f9f3f7f4adbf450a5.jpg saved to cache
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1685ed810>
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_14e99f6e1a63cda4f0989bb2ef195eca.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_14e99f6e1a63cda4f0989bb2ef195eca.jpg saved to cache
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0c0ef87-257c-5b44-8e73-e14d114b963d
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1620d0>
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_1593356a9db7091035a0b85cf4d0882d.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_1593356a9db7091035a0b85cf4d0882d.jpg saved to cache
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686ff590>
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_7ecbcd3dd4e379c75f2b7470a53c1806.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_7ecbcd3dd4e379c75f2b7470a53c1806.jpg saved to cache
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ada84653-04cf-57b5-bde0-f01b811d8707
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684ccbd0>
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad/9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F6e%252Fa66e077b66ce47a3862f1c5f37fa82f2%252Fpa%252FXL95591_ac55e467594308e66743eb6c56bfe217.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_ac55e467594308e66743eb6c56bfe217.jpg saved to cache
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a162090>
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_92edeb0669c7c89b4b6ce9b65b2e8cc4.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_92edeb0669c7c89b4b6ce9b65b2e8cc4.jpg saved to cache
2026-03-28 14:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_38b219ebd0397bab46558075e442344d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_0c72aa93c8414110ddfd4321ea67c7c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_530be931160a93558dafd37e3423e2ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_094e38efd69fdecffe351daed914a862.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_a99ca60ecd00cc5d2add56f9d068ab56.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_84fc475c3fb2f3c8f5f2c81f96efa745.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_8015099d376d9c6a1c92541f6905c22d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_e39b0f0b2c7c51ed29e070a0e5f954c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_5703a15a18aaa98487091cc9a99ae417.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684df110>
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_38b219ebd0397bab46558075e442344d.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_38b219ebd0397bab46558075e442344d.jpg saved to cache
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0c0ef87-257c-5b44-8e73-e14d114b963d
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168601ed0>
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_0c72aa93c8414110ddfd4321ea67c7c4.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_0c72aa93c8414110ddfd4321ea67c7c4.jpg saved to cache
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ada84653-04cf-57b5-bde0-f01b811d8707
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168620f90>
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_530be931160a93558dafd37e3423e2ad.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_530be931160a93558dafd37e3423e2ad.jpg saved to cache
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684608d0>
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_094e38efd69fdecffe351daed914a862.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_094e38efd69fdecffe351daed914a862.jpg saved to cache
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168623c90>
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_a99ca60ecd00cc5d2add56f9d068ab56.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_a99ca60ecd00cc5d2add56f9d068ab56.jpg saved to cache
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168621ed0>
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_84fc475c3fb2f3c8f5f2c81f96efa745.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_84fc475c3fb2f3c8f5f2c81f96efa745.jpg saved to cache
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168600e50>
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_8015099d376d9c6a1c92541f6905c22d.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_8015099d376d9c6a1c92541f6905c22d.jpg saved to cache
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684632d0>
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad/9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F6e%252Fa66e077b66ce47a3862f1c5f37fa82f2%252Fpa%252FXL95591_e39b0f0b2c7c51ed29e070a0e5f954c4.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_e39b0f0b2c7c51ed29e070a0e5f954c4.jpg saved to cache
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_1ea478480db9d232e0e4e1119b77b80c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_236aa849f88a5a0cf60b5327374a80ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_197f140d5ec62ae6bc00951410fc7e94.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_869af871ff17488a2e29ce7a67faeb10.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_b68bfdb2797d73bdd59e690c640ddac7.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_a75c9ab2595ad10314bbd55e3d352295.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_0290306745735263ae40ecfe317603c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE54234> (referer: https://www.auto1.com/v1/car-details-view/GE54234/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686d8ad0>
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_5703a15a18aaa98487091cc9a99ae417.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_5703a15a18aaa98487091cc9a99ae417.jpg saved to cache
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0c0ef87-257c-5b44-8e73-e14d114b963d
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_ce3360aef285351176d0685672f5e859.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_705df80ec0b3bee7048320dff8189285.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_4704bed224abc817ed2854265dc9d217.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_f41f7510b87ad3c24253ba203660126d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_cf7d2347bef293d82c7a7a66fdc460e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16842a510>
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_1ea478480db9d232e0e4e1119b77b80c.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_1ea478480db9d232e0e4e1119b77b80c.jpg saved to cache
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a234110>
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad/9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F6e%252Fa66e077b66ce47a3862f1c5f37fa82f2%252Fpa%252FXL95591_236aa849f88a5a0cf60b5327374a80ae.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_236aa849f88a5a0cf60b5327374a80ae.jpg saved to cache
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad
2026-03-28 14:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad, skipping ID generation
2026-03-28 14:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad with scrape type 1
2026-03-28 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad sending to next pipeline
2026-03-28 14:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad, identifier: XL95591
2026-03-28 14:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad with identifier: XL95591
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 14:01:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad with identifier: XL95591
2026-03-28 14:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad with identifier: XL95591 to the API
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_236aa849f88a5a0cf60b5327374a80ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:04:33Z',
 'fuel_type': 'petrol',
 'id': '9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL95591',
 'listing': 'auction',
 'location': 'ES, Rivas-Vaciamadrid, Madrid',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 124800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad/9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_bdfb77042c6e2d4375d31d9b6814079d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad/9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_ac55e467594308e66743eb6c56bfe217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad/9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_cfe5ae37a911f0017310b9ab949c58b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad/9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_eb96c2e5088de36f9f3f7f4adbf450a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad/9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_236aa849f88a5a0cf60b5327374a80ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad/9aa5077e-e2e7-5e0a-b8dc-532a1d1fb3ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/6e/a66e077b66ce47a3862f1c5f37fa82f2/pa/XL95591_e39b0f0b2c7c51ed29e070a0e5f954c4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.2 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2012}
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL95591%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [auto1.es] INFO: Saving data for XL95591: {'created_time': 1774706476.281194, 'last_price_update_time': 1774706476.281205, 'auction_closing_time': 1774883073.0}
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XL95591') HTTP/1.1" 204 0
2026-03-28 14:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_f9023ac25d39e1e58c15382a56413f08.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a100250>
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_197f140d5ec62ae6bc00951410fc7e94.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_197f140d5ec62ae6bc00951410fc7e94.jpg saved to cache
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16842ac90>
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_869af871ff17488a2e29ce7a67faeb10.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_869af871ff17488a2e29ce7a67faeb10.jpg saved to cache
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c
2026-03-28 14:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_e9cc7299ec4ded7f56d6088210137f53.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_7063d24ef101c6364c58cf2ddb952af5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_01a2c44878cfbf00a76d5d19c5f6e1d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_cf5a16e9521ffb2b76c8b1dfc5dc3eb8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_9f05bb640e73e894b5eb2f8fe4107b28.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_bb48724f97672dd0377a9f3e3047617c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM41258> (referer: https://www.auto1.com/v1/car-details-view/JM41258/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_4dd5134f379e6ca06d7eac9225f1e591.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c89dc90>
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_b68bfdb2797d73bdd59e690c640ddac7.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_b68bfdb2797d73bdd59e690c640ddac7.jpg saved to cache
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a255590>
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_a75c9ab2595ad10314bbd55e3d352295.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_a75c9ab2595ad10314bbd55e3d352295.jpg saved to cache
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684c2450>
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_0290306745735263ae40ecfe317603c8.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_0290306745735263ae40ecfe317603c8.jpg saved to cache
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c
2026-03-28 14:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0482c1e-a3a8-52ae-8ecf-d40133250f69 with identifier: GE54234
2026-03-28 14:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0482c1e-a3a8-52ae-8ecf-d40133250f69 with scrape type 1
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0482c1e-a3a8-52ae-8ecf-d40133250f69
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30ee23bfa40fc5fe7cc2c268c461de%252Fpa%252FGE54234_15f706dc862ac4313e08b655487a9f4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_15f706dc862ac4313e08b655487a9f4a.jpg already downloaded
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30ee23bfa40fc5fe7cc2c268c461de%252Fpa%252FGE54234_e7de73635068e96d95c7560144001945.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_e7de73635068e96d95c7560144001945.jpg already downloaded
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30ee23bfa40fc5fe7cc2c268c461de%252Fpa%252FGE54234_942e657176627dd9f6ae9af4fe853f39.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_942e657176627dd9f6ae9af4fe853f39.jpg already downloaded
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30ee23bfa40fc5fe7cc2c268c461de%252Fpa%252FGE54234_0a48c1bea13c53b1b356618e58ee8856.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_0a48c1bea13c53b1b356618e58ee8856.jpg already downloaded
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30ee23bfa40fc5fe7cc2c268c461de%252Fpa%252FGE54234_c28cbf2732cbe735f1867274e565d711.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_c28cbf2732cbe735f1867274e565d711.jpg already downloaded
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30ee23bfa40fc5fe7cc2c268c461de%252Fpa%252FGE54234_46a67af32d9294ad181fcbab13d87ac8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_46a67af32d9294ad181fcbab13d87ac8.jpg already downloaded
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30ee23bfa40fc5fe7cc2c268c461de%252Fpa%252FGE54234_b3d0677a1093c875282e3f884f72277c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_b3d0677a1093c875282e3f884f72277c.jpg already downloaded
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30ee23bfa40fc5fe7cc2c268c461de%252Fpa%252FGE54234_17c59f2c00e28ef061f70cff4f4da20e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_17c59f2c00e28ef061f70cff4f4da20e.jpg already downloaded
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30ee23bfa40fc5fe7cc2c268c461de%252Fpa%252FGE54234_b5f2083b8ef976084447aac690c35f18.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_b5f2083b8ef976084447aac690c35f18.jpg already downloaded
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30ee23bfa40fc5fe7cc2c268c461de%252Fpa%252FGE54234_d02e659ea15b5fd0ebc9ec750d7ea845.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_d02e659ea15b5fd0ebc9ec750d7ea845.jpg already downloaded
2026-03-28 14:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0482c1e-a3a8-52ae-8ecf-d40133250f69, identifier: GE54234
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a34e7d0>
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_ce3360aef285351176d0685672f5e859.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_ce3360aef285351176d0685672f5e859.jpg saved to cache
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0c0ef87-257c-5b44-8e73-e14d114b963d
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168534690>
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_705df80ec0b3bee7048320dff8189285.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_705df80ec0b3bee7048320dff8189285.jpg saved to cache
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686d9350>
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F06%252Fe206f69997235890a8835a3f9f09d355%252Fpa%252FGU18953_4704bed224abc817ed2854265dc9d217.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_4704bed224abc817ed2854265dc9d217.jpg saved to cache
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c
2026-03-28 14:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 482bac9e-8792-586e-ba64-8ecd7a4ac47c, skipping ID generation
2026-03-28 14:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c with scrape type 1
2026-03-28 14:01:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 482bac9e-8792-586e-ba64-8ecd7a4ac47c sending to next pipeline
2026-03-28 14:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 482bac9e-8792-586e-ba64-8ecd7a4ac47c, identifier: GU18953
2026-03-28 14:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a25b890>
2026-03-28 14:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fec%252Fb7ece1a25f04cea86295ba04896e8400%252Fpa%252FEA80671_f41f7510b87ad3c24253ba203660126d.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_f41f7510b87ad3c24253ba203660126d.jpg saved to cache
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd
2026-03-28 14:01:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6b8f4d5-4fcc-5810-b879-f57f30b77bfd, skipping ID generation
2026-03-28 14:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd with scrape type 1
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6b8f4d5-4fcc-5810-b879-f57f30b77bfd sending to next pipeline
2026-03-28 14:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e6b8f4d5-4fcc-5810-b879-f57f30b77bfd, identifier: EA80671
2026-03-28 14:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a24cad0>
2026-03-28 14:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_cf7d2347bef293d82c7a7a66fdc460e2.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_cf7d2347bef293d82c7a7a66fdc460e2.jpg saved to cache
2026-03-28 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 606cf93e-550b-5e53-86cb-f3bc05cb276f
2026-03-28 14:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0482c1e-a3a8-52ae-8ecf-d40133250f69 with identifier: GE54234
2026-03-28 14:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0482c1e-a3a8-52ae-8ecf-d40133250f69 with identifier: GE54234
2026-03-28 14:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b0482c1e-a3a8-52ae-8ecf-d40133250f69 with identifier: GE54234 to the API
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GE54234>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:09:02Z',
 'fuel_type': 'diesel',
 'id': 'b0482c1e-a3a8-52ae-8ecf-d40133250f69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE54234',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 416961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_15f706dc862ac4313e08b655487a9f4a.jpg',
                'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_e7de73635068e96d95c7560144001945.jpg',
                'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_942e657176627dd9f6ae9af4fe853f39.jpg',
                'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_0a48c1bea13c53b1b356618e58ee8856.jpg',
                'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_c28cbf2732cbe735f1867274e565d711.jpg',
                'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_46a67af32d9294ad181fcbab13d87ac8.jpg',
                'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_b3d0677a1093c875282e3f884f72277c.jpg',
                'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_17c59f2c00e28ef061f70cff4f4da20e.jpg',
                'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_b5f2083b8ef976084447aac690c35f18.jpg',
                'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_d02e659ea15b5fd0ebc9ec750d7ea845.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0482c1e-a3a8-52ae-8ecf-d40133250f69/b0482c1e-a3a8-52ae-8ecf-d40133250f69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_15f706dc862ac4313e08b655487a9f4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0482c1e-a3a8-52ae-8ecf-d40133250f69/b0482c1e-a3a8-52ae-8ecf-d40133250f69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_e7de73635068e96d95c7560144001945.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0482c1e-a3a8-52ae-8ecf-d40133250f69/b0482c1e-a3a8-52ae-8ecf-d40133250f69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_942e657176627dd9f6ae9af4fe853f39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0482c1e-a3a8-52ae-8ecf-d40133250f69/b0482c1e-a3a8-52ae-8ecf-d40133250f69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_0a48c1bea13c53b1b356618e58ee8856.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0482c1e-a3a8-52ae-8ecf-d40133250f69/b0482c1e-a3a8-52ae-8ecf-d40133250f69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_c28cbf2732cbe735f1867274e565d711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0482c1e-a3a8-52ae-8ecf-d40133250f69/b0482c1e-a3a8-52ae-8ecf-d40133250f69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_46a67af32d9294ad181fcbab13d87ac8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0482c1e-a3a8-52ae-8ecf-d40133250f69/b0482c1e-a3a8-52ae-8ecf-d40133250f69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_b3d0677a1093c875282e3f884f72277c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0482c1e-a3a8-52ae-8ecf-d40133250f69/b0482c1e-a3a8-52ae-8ecf-d40133250f69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_17c59f2c00e28ef061f70cff4f4da20e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0482c1e-a3a8-52ae-8ecf-d40133250f69/b0482c1e-a3a8-52ae-8ecf-d40133250f69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_b5f2083b8ef976084447aac690c35f18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0482c1e-a3a8-52ae-8ecf-d40133250f69/b0482c1e-a3a8-52ae-8ecf-d40133250f69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30ee23bfa40fc5fe7cc2c268c461de/pa/GE54234_d02e659ea15b5fd0ebc9ec750d7ea845.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-08-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2013}
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE54234%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [auto1.es] INFO: Saving data for GE54234: {'created_time': 1774706477.621116, 'last_price_update_time': 1774706477.621126, 'auction_closing_time': 1774883342.0}
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GE54234') HTTP/1.1" 204 0
2026-03-28 14:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 482bac9e-8792-586e-ba64-8ecd7a4ac47c with identifier: GU18953
2026-03-28 14:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 482bac9e-8792-586e-ba64-8ecd7a4ac47c with identifier: GU18953
2026-03-28 14:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 482bac9e-8792-586e-ba64-8ecd7a4ac47c with identifier: GU18953 to the API
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_4704bed224abc817ed2854265dc9d217.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:26:39Z',
 'fuel_type': 'petrol',
 'id': '482bac9e-8792-586e-ba64-8ecd7a4ac47c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU18953',
 'listing': 'auction',
 'location': 'ES, Alcalá de Henares',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 104586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_9611f70d8d7bcea33b0451331f2aa05f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_4704bed224abc817ed2854265dc9d217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_92edeb0669c7c89b4b6ce9b65b2e8cc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_f790eed85464d578a36add93780f8561.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_0290306745735263ae40ecfe317603c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_8015099d376d9c6a1c92541f6905c22d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_a99ca60ecd00cc5d2add56f9d068ab56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_1ea478480db9d232e0e4e1119b77b80c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_a75c9ab2595ad10314bbd55e3d352295.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482bac9e-8792-586e-ba64-8ecd7a4ac47c/482bac9e-8792-586e-ba64-8ecd7a4ac47c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/06/e206f69997235890a8835a3f9f09d355/pa/GU18953_869af871ff17488a2e29ce7a67faeb10.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 THP Feel',
 'transmission': 'automatic',
 'trim': 'Feel',
 'year': 2016}
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU18953%27 HTTP/1.1" 200 None
2026-03-28 14:01:17 [auto1.es] INFO: Saving data for GU18953: {'created_time': 1774706477.989095, 'last_price_update_time': 1774706477.989107, 'auction_closing_time': 1774884399.0}
2026-03-28 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GU18953') HTTP/1.1" 204 0
2026-03-28 14:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e6b8f4d5-4fcc-5810-b879-f57f30b77bfd with identifier: EA80671
2026-03-28 14:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e6b8f4d5-4fcc-5810-b879-f57f30b77bfd with identifier: EA80671
2026-03-28 14:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e6b8f4d5-4fcc-5810-b879-f57f30b77bfd with identifier: EA80671 to the API
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_f41f7510b87ad3c24253ba203660126d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': 'Taxi',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:33:26Z',
 'fuel_type': 'gas',
 'id': 'e6b8f4d5-4fcc-5810-b879-f57f30b77bfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA80671',
 'listing': 'auction',
 'location': 'ES, Marbella',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 309689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_66367e1da309d18313281cfad7580fc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_96e790a343c48987d32c5d68536381e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_b590b83516e8f86a49a63be387e22dda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_f41f7510b87ad3c24253ba203660126d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_84fc475c3fb2f3c8f5f2c81f96efa745.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_1593356a9db7091035a0b85cf4d0882d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_b68bfdb2797d73bdd59e690c640ddac7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_094e38efd69fdecffe351daed914a862.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_530be931160a93558dafd37e3423e2ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6b8f4d5-4fcc-5810-b879-f57f30b77bfd/e6b8f4d5-4fcc-5810-b879-f57f30b77bfd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ec/b7ece1a25f04cea86295ba04896e8400/pa/EA80671_197f140d5ec62ae6bc00951410fc7e94.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA80671%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [auto1.es] INFO: Saving data for EA80671: {'created_time': 1774706478.483671, 'last_price_update_time': 1774706478.483681, 'auction_closing_time': 1774884806.0}
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EA80671') HTTP/1.1" 204 0
2026-03-28 14:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ62069> (referer: https://www.auto1.com/v1/car-details-view/XZ62069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW26906> (referer: https://www.auto1.com/v1/car-details-view/AW26906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_2dade0b359e430032da80a713832aa1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB66471> (referer: https://www.auto1.com/v1/car-details-view/CB66471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684c3b50>
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_f9023ac25d39e1e58c15382a56413f08.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_f9023ac25d39e1e58c15382a56413f08.jpg saved to cache
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0c0ef87-257c-5b44-8e73-e14d114b963d
2026-03-28 14:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0f8890>
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_e9cc7299ec4ded7f56d6088210137f53.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_e9cc7299ec4ded7f56d6088210137f53.jpg saved to cache
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0c0ef87-257c-5b44-8e73-e14d114b963d
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686a5410>
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_7063d24ef101c6364c58cf2ddb952af5.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_7063d24ef101c6364c58cf2ddb952af5.jpg saved to cache
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1685ece50>
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_01a2c44878cfbf00a76d5d19c5f6e1d2.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_01a2c44878cfbf00a76d5d19c5f6e1d2.jpg saved to cache
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c13f410>
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F22%252F0922ea0c0bb2905a10268ced7df1f29f%252Fpa%252FRK07615_cf5a16e9521ffb2b76c8b1dfc5dc3eb8.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_cf5a16e9521ffb2b76c8b1dfc5dc3eb8.jpg saved to cache
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0c0ef87-257c-5b44-8e73-e14d114b963d
2026-03-28 14:01:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0c0ef87-257c-5b44-8e73-e14d114b963d, skipping ID generation
2026-03-28 14:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c0ef87-257c-5b44-8e73-e14d114b963d with scrape type 1
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0c0ef87-257c-5b44-8e73-e14d114b963d sending to next pipeline
2026-03-28 14:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a0c0ef87-257c-5b44-8e73-e14d114b963d, identifier: RK07615
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a01cd90>
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_9f05bb640e73e894b5eb2f8fe4107b28.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_9f05bb640e73e894b5eb2f8fe4107b28.jpg saved to cache
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ada84653-04cf-57b5-bde0-f01b811d8707
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16863ec90>
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_bb48724f97672dd0377a9f3e3047617c.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_bb48724f97672dd0377a9f3e3047617c.jpg saved to cache
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ada84653-04cf-57b5-bde0-f01b811d8707
2026-03-28 14:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73704e00-4cf1-562b-b165-bfded9519bc4 with identifier: JM41258
2026-03-28 14:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73704e00-4cf1-562b-b165-bfded9519bc4 with scrape type 1
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 73704e00-4cf1-562b-b165-bfded9519bc4
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F1d%252F811df08e7e260d938bc2d637168bd6ec%252Fpa%252FJM41258_585f89effe4797a5380a49c110898bdc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_585f89effe4797a5380a49c110898bdc.jpg already downloaded
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F1d%252F811df08e7e260d938bc2d637168bd6ec%252Fpa%252FJM41258_33facd87e64be85fe9438a5448d3f323.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_33facd87e64be85fe9438a5448d3f323.jpg already downloaded
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F1d%252F811df08e7e260d938bc2d637168bd6ec%252Fpa%252FJM41258_260662d62da70ca476a5d6e72a2e69af.png%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_260662d62da70ca476a5d6e72a2e69af.png already downloaded
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F1d%252F811df08e7e260d938bc2d637168bd6ec%252Fpa%252FJM41258_6dbc557ddd5fd95e7eccca605d1f0d9c.png%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_6dbc557ddd5fd95e7eccca605d1f0d9c.png already downloaded
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F1d%252F811df08e7e260d938bc2d637168bd6ec%252Fpa%252FJM41258_5e98592fe9521ff92c9f6c2d4f13d3de.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_5e98592fe9521ff92c9f6c2d4f13d3de.jpg already downloaded
2026-03-28 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F1d%252F811df08e7e260d938bc2d637168bd6ec%252Fpa%252FJM41258_ab9b2363298898f091d21ee8fa09d6e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_ab9b2363298898f091d21ee8fa09d6e4.jpg already downloaded
2026-03-28 14:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73704e00-4cf1-562b-b165-bfded9519bc4, identifier: JM41258
2026-03-28 14:01:19 [auto1.es] INFO: Channel: 24h | Page: 6 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686a3750>
2026-03-28 14:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F7b%252F1b7bf8c61f924ecbe4f83c55c442bc55%252Fpa%252FVM52348_4dd5134f379e6ca06d7eac9225f1e591.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_4dd5134f379e6ca06d7eac9225f1e591.jpg saved to cache
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ada84653-04cf-57b5-bde0-f01b811d8707
2026-03-28 14:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ada84653-04cf-57b5-bde0-f01b811d8707, skipping ID generation
2026-03-28 14:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ada84653-04cf-57b5-bde0-f01b811d8707 with scrape type 1
2026-03-28 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ada84653-04cf-57b5-bde0-f01b811d8707 sending to next pipeline
2026-03-28 14:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ada84653-04cf-57b5-bde0-f01b811d8707, identifier: VM52348
2026-03-28 14:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_559450ddc22984cfff4a15ce219731b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV24981> (referer: https://www.auto1.com/v1/car-details-view/TV24981/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a0c0ef87-257c-5b44-8e73-e14d114b963d with identifier: RK07615
2026-03-28 14:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a0c0ef87-257c-5b44-8e73-e14d114b963d with identifier: RK07615
2026-03-28 14:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a0c0ef87-257c-5b44-8e73-e14d114b963d with identifier: RK07615 to the API
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_cf5a16e9521ffb2b76c8b1dfc5dc3eb8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:58Z',
 'fuel_type': 'diesel',
 'id': 'a0c0ef87-257c-5b44-8e73-e14d114b963d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK07615',
 'listing': 'auction',
 'location': 'ES, Basauri',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 185262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_d802403840bf4179be483d45e4519a3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_d783c73aaa044500027338ec47ae9249.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_fc0a15b6a1f2d7c39eaf184fba1c443e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_f9023ac25d39e1e58c15382a56413f08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_e9cc7299ec4ded7f56d6088210137f53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_cf5a16e9521ffb2b76c8b1dfc5dc3eb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_38b219ebd0397bab46558075e442344d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_14e99f6e1a63cda4f0989bb2ef195eca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_ce3360aef285351176d0685672f5e859.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c0ef87-257c-5b44-8e73-e14d114b963d/a0c0ef87-257c-5b44-8e73-e14d114b963d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/22/0922ea0c0bb2905a10268ced7df1f29f/pa/RK07615_5703a15a18aaa98487091cc9a99ae417.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Business Plus AWD',
 'transmission': 'automatic',
 'trim': 'Business Plus AWD',
 'year': 2020}
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK07615%27 HTTP/1.1" 200 None
2026-03-28 14:01:19 [auto1.es] INFO: Saving data for RK07615: {'created_time': 1774706479.616733, 'last_price_update_time': 1774706479.616743, 'auction_closing_time': 1774883158.0}
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RK07615') HTTP/1.1" 204 0
2026-03-28 14:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73704e00-4cf1-562b-b165-bfded9519bc4 with identifier: JM41258
2026-03-28 14:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73704e00-4cf1-562b-b165-bfded9519bc4 with identifier: JM41258
2026-03-28 14:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73704e00-4cf1-562b-b165-bfded9519bc4 with identifier: JM41258 to the API
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JM41258>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:45:49Z',
 'fuel_type': 'petrol',
 'id': '73704e00-4cf1-562b-b165-bfded9519bc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM41258',
 'listing': 'auction',
 'location': 'Tradein',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 340977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_585f89effe4797a5380a49c110898bdc.jpg',
                'https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_33facd87e64be85fe9438a5448d3f323.jpg',
                'https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_260662d62da70ca476a5d6e72a2e69af.png',
                'https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_6dbc557ddd5fd95e7eccca605d1f0d9c.png',
                'https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_5e98592fe9521ff92c9f6c2d4f13d3de.jpg',
                'https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_ab9b2363298898f091d21ee8fa09d6e4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73704e00-4cf1-562b-b165-bfded9519bc4/73704e00-4cf1-562b-b165-bfded9519bc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_585f89effe4797a5380a49c110898bdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73704e00-4cf1-562b-b165-bfded9519bc4/73704e00-4cf1-562b-b165-bfded9519bc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_33facd87e64be85fe9438a5448d3f323.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73704e00-4cf1-562b-b165-bfded9519bc4/73704e00-4cf1-562b-b165-bfded9519bc4_image_2.png',
             'Extension': 'png',
             'FileSizeInBytes': 19153,
             'Height': 360,
             'OriginUrl': 'https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_260662d62da70ca476a5d6e72a2e69af.png',
             'Width': 490},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73704e00-4cf1-562b-b165-bfded9519bc4/73704e00-4cf1-562b-b165-bfded9519bc4_image_3.png',
             'Extension': 'png',
             'FileSizeInBytes': 19153,
             'Height': 360,
             'OriginUrl': 'https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_6dbc557ddd5fd95e7eccca605d1f0d9c.png',
             'Width': 490},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73704e00-4cf1-562b-b165-bfded9519bc4/73704e00-4cf1-562b-b165-bfded9519bc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_5e98592fe9521ff92c9f6c2d4f13d3de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73704e00-4cf1-562b-b165-bfded9519bc4/73704e00-4cf1-562b-b165-bfded9519bc4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/1d/811df08e7e260d938bc2d637168bd6ec/pa/JM41258_ab9b2363298898f091d21ee8fa09d6e4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-06-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Megane 1.6 Authentique Confort',
 'transmission': 'manual',
 'trim': 'Authentique Confort',
 'year': 2006}
2026-03-28 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM41258%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Saving data for JM41258: {'created_time': 1774706480.000614, 'last_price_update_time': 1774706480.000626, 'auction_closing_time': 1774885549.0}
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JM41258') HTTP/1.1" 204 0
2026-03-28 14:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ada84653-04cf-57b5-bde0-f01b811d8707 with identifier: VM52348
2026-03-28 14:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ada84653-04cf-57b5-bde0-f01b811d8707 with identifier: VM52348
2026-03-28 14:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ada84653-04cf-57b5-bde0-f01b811d8707 with identifier: VM52348 to the API
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_4dd5134f379e6ca06d7eac9225f1e591.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:25:34Z',
 'fuel_type': 'diesel',
 'id': 'ada84653-04cf-57b5-bde0-f01b811d8707',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM52348',
 'listing': 'auction',
 'location': 'ES, Valladolid',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 240116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_49dcc7d9411f5c6c79334b94db6a2cc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_31783b97c8b96ee283772dc3630c7e36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_54bc891aa2d667c8648ab1a0adc0b1f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_25b60fc5289a12f2ffc18b6ea9be64db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_978a24ee99df7bd0ab3f399337fabe61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_9f05bb640e73e894b5eb2f8fe4107b28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_bb48724f97672dd0377a9f3e3047617c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_4dd5134f379e6ca06d7eac9225f1e591.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_0c72aa93c8414110ddfd4321ea67c7c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ada84653-04cf-57b5-bde0-f01b811d8707/ada84653-04cf-57b5-bde0-f01b811d8707_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/7b/1b7bf8c61f924ecbe4f83c55c442bc55/pa/VM52348_7ecbcd3dd4e379c75f2b7470a53c1806.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-31',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2016}
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM52348%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Saving data for VM52348: {'created_time': 1774706480.40871, 'last_price_update_time': 1774706480.408721, 'auction_closing_time': 1774884334.0}
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VM52348') HTTP/1.1" 204 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: CV66475
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV66475%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for CV66475: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: WV13003
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV13003%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for WV13003: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: RU20773
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU20773%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for RU20773: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: DX72954
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX72954%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for DX72954: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: VA33750
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA33750%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for VA33750: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: SR52978
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: BA23720
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA23720%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for BA23720: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: PL84711
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL84711%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for PL84711: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: AZ04928
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ04928%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for AZ04928: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: ZK54179
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK54179%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for ZK54179: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: JA60709
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA60709%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for JA60709: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: BK75900
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: EF82008
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: TX62344
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: CY52892
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY52892%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for CY52892: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: RW90517
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW90517%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for RW90517: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: KK87704
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK87704%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for KK87704: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: AF53027
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF53027%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for AF53027: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: NX17648
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX17648%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for NX17648: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: RX17538
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: PP42780
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: EK21860
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: EM88527
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: ML70720
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: XA25667
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA25667%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for XA25667: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: LH42756
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: YS26400
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: DL67174
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: VT22035
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: BM94316
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: NP14618
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: MS21138
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: EG18417
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: MH61134
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: SJ29812
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ29812%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [auto1.es] INFO: Scrape type for SJ29812: 0
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: YR47021
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: HD15587
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: RV46161
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: BE52894
2026-03-28 14:01:20 [auto1.es] INFO: Found listing with ID: VG10975
2026-03-28 14:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_a19eec05d9fedf3fd409fa47b0ca7c26.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_f7799971876dd910f9b5b3a743c7ccfd.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_af0ec0f1836b919f130042fe0bc77381.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_ced2292692fc66f39fe43e1a7005b781.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_a7c6a3aa1c93f0fe7f09593c80ecc2ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD08743/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c21dca98-71a4-5b1c-b917-3f63317cf371 with identifier: XZ62069
2026-03-28 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c21dca98-71a4-5b1c-b917-3f63317cf371 with scrape type 1
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c21dca98-71a4-5b1c-b917-3f63317cf371
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_3e55c2de5fc7e8fe05211943a84e73bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_3e55c2de5fc7e8fe05211943a84e73bf.jpg not downloaded yet
2026-03-28 14:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad31780b-ee56-5cc9-8a3d-e18f06f1b76d with identifier: AW26906
2026-03-28 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d with scrape type 1
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_55ca5f1800b52fc995d1c633f8ace168.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_55ca5f1800b52fc995d1c633f8ace168.jpg not downloaded yet
2026-03-28 14:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168473990>
2026-03-28 14:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_2dade0b359e430032da80a713832aa1b.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_2dade0b359e430032da80a713832aa1b.jpg saved to cache
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7
2026-03-28 14:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a73fd50c-54de-575c-86e5-124a93a28c2d with identifier: CB66471
2026-03-28 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a73fd50c-54de-575c-86e5-124a93a28c2d with scrape type 1
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a73fd50c-54de-575c-86e5-124a93a28c2d
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_cbed9d5db23ded21d77aa94bec27f4a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_cbed9d5db23ded21d77aa94bec27f4a2.jpg not downloaded yet
2026-03-28 14:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684b7650>
2026-03-28 14:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F15%252F9e15b3d2bdff24be44248450da64d291%252Fpa%252FZX43091_559450ddc22984cfff4a15ce219731b0.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_559450ddc22984cfff4a15ce219731b0.jpg saved to cache
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 606cf93e-550b-5e53-86cb-f3bc05cb276f
2026-03-28 14:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 606cf93e-550b-5e53-86cb-f3bc05cb276f, skipping ID generation
2026-03-28 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606cf93e-550b-5e53-86cb-f3bc05cb276f with scrape type 1
2026-03-28 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 606cf93e-550b-5e53-86cb-f3bc05cb276f sending to next pipeline
2026-03-28 14:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 606cf93e-550b-5e53-86cb-f3bc05cb276f, identifier: ZX43091
2026-03-28 14:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b395c3ef-2b70-5be4-ad00-5f967b128163 with identifier: TV24981
2026-03-28 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b395c3ef-2b70-5be4-ad00-5f967b128163 with scrape type 1
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b395c3ef-2b70-5be4-ad00-5f967b128163
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_277318ec00075308d789d854341784d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_277318ec00075308d789d854341784d0.jpg not downloaded yet
2026-03-28 14:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_fa6a34f19e19238f957338795717e8af.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_65e2345c2573e14931f2dceef3c8f11d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_65e2345c2573e14931f2dceef3c8f11d.jpg not downloaded yet
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_1b05dc182ff7c001a78798d80ea169c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_1b05dc182ff7c001a78798d80ea169c2.jpg not downloaded yet
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_238405fbbf8674a57e3ccd92af2677e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_238405fbbf8674a57e3ccd92af2677e9.jpg not downloaded yet
2026-03-28 14:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 606cf93e-550b-5e53-86cb-f3bc05cb276f with identifier: ZX43091
2026-03-28 14:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 606cf93e-550b-5e53-86cb-f3bc05cb276f with identifier: ZX43091
2026-03-28 14:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 606cf93e-550b-5e53-86cb-f3bc05cb276f with identifier: ZX43091 to the API
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_559450ddc22984cfff4a15ce219731b0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:17:27Z',
 'fuel_type': 'petrol',
 'id': '606cf93e-550b-5e53-86cb-f3bc05cb276f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX43091',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 62819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_c419e1554ab21b42d5e6eecec6a27756.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_49d8abe63d458dfcb9a81f4544d1ac37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_559450ddc22984cfff4a15ce219731b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_8e2814fc8574aaa90c0e2475eb783e2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_a26530ef3bfc06b5e1a0f4a50929a26e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_02fbc47841ec0aaea8d393b844fd38d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_0ed36568dde255f3881f5bf39d37135f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_cd4d8fc156bf2f528cf2e520164b70c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_4904c59d9f3886c9eeffe48abc2e99e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606cf93e-550b-5e53-86cb-f3bc05cb276f/606cf93e-550b-5e53-86cb-f3bc05cb276f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/15/9e15b3d2bdff24be44248450da64d291/pa/ZX43091_cf7d2347bef293d82c7a7a66fdc460e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2018}
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX43091%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [auto1.es] INFO: Saving data for ZX43091: {'created_time': 1774706481.668724, 'last_price_update_time': 1774706481.668738, 'auction_closing_time': 1774883847.0}
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZX43091') HTTP/1.1" 204 0
2026-03-28 14:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4fe55631f9d3b25c2ba1c31d6695735a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_966dbbafc940016db03bcfa15b27e139.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_f0ce202c1b2d1098e498c0adc57c08fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_f0ce202c1b2d1098e498c0adc57c08fb.jpg not downloaded yet
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a030190>
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_a19eec05d9fedf3fd409fa47b0ca7c26.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_a19eec05d9fedf3fd409fa47b0ca7c26.jpg saved to cache
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7b73b17-dd7a-5831-afff-fb521530837c
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a371dd0>
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_f7799971876dd910f9b5b3a743c7ccfd.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_f7799971876dd910f9b5b3a743c7ccfd.jpg saved to cache
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168532c10>
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_af0ec0f1836b919f130042fe0bc77381.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_af0ec0f1836b919f130042fe0bc77381.jpg saved to cache
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168518ad0>
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F06%252Fc10601694ffe6ea6768ee134572a8f00%252Fpa%252FHG29658_ced2292692fc66f39fe43e1a7005b781.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_ced2292692fc66f39fe43e1a7005b781.jpg saved to cache
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7
2026-03-28 14:01:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7, skipping ID generation
2026-03-28 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7 with scrape type 1
2026-03-28 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7 sending to next pipeline
2026-03-28 14:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7, identifier: HG29658
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168669590>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_a7c6a3aa1c93f0fe7f09593c80ecc2ef.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_a7c6a3aa1c93f0fe7f09593c80ecc2ef.jpg saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_b77c5ab5e3599878a998736c36b8d27c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_7f20587885baf68b0073459833de391a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_7f20587885baf68b0073459833de391a.jpg not downloaded yet
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_61a8d4ec50a7075e6e1e89b7cfd4bba9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_61a8d4ec50a7075e6e1e89b7cfd4bba9.jpg not downloaded yet
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_14c44822d49d440b308c5d8f21fb9a5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_14c44822d49d440b308c5d8f21fb9a5d.jpg not downloaded yet
2026-03-28 14:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7 with identifier: HG29658
2026-03-28 14:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7 with identifier: HG29658
2026-03-28 14:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7 with identifier: HG29658 to the API
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_ced2292692fc66f39fe43e1a7005b781.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:13:21Z',
 'fuel_type': 'diesel',
 'id': '9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG29658',
 'listing': 'auction',
 'location': 'ES, Alcobendas',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 241157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_ab64614716583e9696d43dab7b5c372e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_ced2292692fc66f39fe43e1a7005b781.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_cb662135079c3cd883048ecc87d08db5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_df6a7995bbdc70b165103a8ce3e2c062.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_904c711dd8cbff5d1f8ac81950b17461.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_6dc381c6ccb1887a12811307335089a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_2dade0b359e430032da80a713832aa1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_01a2c44878cfbf00a76d5d19c5f6e1d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_7063d24ef101c6364c58cf2ddb952af5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7/9f12568c-d1aa-5138-b3a3-5bacfdd1d6f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/06/c10601694ffe6ea6768ee134572a8f00/pa/HG29658_705df80ec0b3bee7048320dff8189285.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Land Rover Discovery 5 2.0 TD Sd4 SD4 HSE',
 'transmission': 'automatic',
 'trim': 'SD4 HSE',
 'year': 2017}
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG29658%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [auto1.es] INFO: Saving data for HG29658: {'created_time': 1774706482.477257, 'last_price_update_time': 1774706482.477266, 'auction_closing_time': 1774883601.0}
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HG29658') HTTP/1.1" 204 0
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_4e1ce2d318d4a620a27f5bff49712afc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_72eeb9808ff656d455a543fc733f22e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4fa26ec45613b9cdc2f9f2036d48021e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_554b592b7e84029aecb7c0d211dc5df1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_554b592b7e84029aecb7c0d211dc5df1.jpg not downloaded yet
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA73564> (referer: https://www.auto1.com/v1/car-details-view/EA73564/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV31906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0eff10>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_fa6a34f19e19238f957338795717e8af.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_fa6a34f19e19238f957338795717e8af.jpg saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7b73b17-dd7a-5831-afff-fb521530837c
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_8980587e548427a85d012bf8c74e6435.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_1aa752f9db20b805022225dca9a238c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_1aa752f9db20b805022225dca9a238c7.jpg not downloaded yet
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_b943fe07ee9e928b014962e52d39d75b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b943fe07ee9e928b014962e52d39d75b.jpg not downloaded yet
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_3f8dc92c7f00613017d8db5945a7c930.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_3f8dc92c7f00613017d8db5945a7c930.jpg not downloaded yet
2026-03-28 14:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM37535> (referer: https://www.auto1.com/v1/car-details-view/ZM37535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0ef190>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d918f0-a69b-58da-a2e9-fb2c560ec41f/40d918f0-a69b-58da-a2e9-fb2c560ec41f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fc8%252F58c8096f3a14beb26da461a0df5ca81d%252Fpa%252FPA52283_4fe55631f9d3b25c2ba1c31d6695735a.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4fe55631f9d3b25c2ba1c31d6695735a.jpg saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40d918f0-a69b-58da-a2e9-fb2c560ec41f
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687aa290>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_966dbbafc940016db03bcfa15b27e139.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_966dbbafc940016db03bcfa15b27e139.jpg saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7b73b17-dd7a-5831-afff-fb521530837c
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_cbed9d5db23ded21d77aa94bec27f4a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_26490b9395c97e1e48c8948c5c7554d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_26490b9395c97e1e48c8948c5c7554d4.jpg not downloaded yet
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ81708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a21a990>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_b77c5ab5e3599878a998736c36b8d27c.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_b77c5ab5e3599878a998736c36b8d27c.jpg saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7b73b17-dd7a-5831-afff-fb521530837c
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_55ca5f1800b52fc995d1c633f8ace168.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_277318ec00075308d789d854341784d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_2f5d3d4efc88796a729e19092d5d448e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_2f5d3d4efc88796a729e19092d5d448e.jpg not downloaded yet
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_42772e1960102ef5ed55d6d9c2b29b05.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_42772e1960102ef5ed55d6d9c2b29b05.jpg not downloaded yet
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_766d32ff5c7e3006d9b124e3164ea231.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_766d32ff5c7e3006d9b124e3164ea231.jpg not downloaded yet
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_238405fbbf8674a57e3ccd92af2677e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_1a8b0a8ee1920c7439e18bf7403de314.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_1a8b0a8ee1920c7439e18bf7403de314.jpg not downloaded yet
2026-03-28 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV24306/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16842b650>
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F87%252F74877bc9328f225f020049714b76e5e1%252Fpa%252FVA34349_4e1ce2d318d4a620a27f5bff49712afc.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_4e1ce2d318d4a620a27f5bff49712afc.jpg saved to cache
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c
2026-03-28 14:01:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6211c8bb-ee73-5f0e-98ce-d44099955b6c, skipping ID generation
2026-03-28 14:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c with scrape type 1
2026-03-28 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6211c8bb-ee73-5f0e-98ce-d44099955b6c sending to next pipeline
2026-03-28 14:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6211c8bb-ee73-5f0e-98ce-d44099955b6c, identifier: VA34349
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a115550>
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d918f0-a69b-58da-a2e9-fb2c560ec41f/40d918f0-a69b-58da-a2e9-fb2c560ec41f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fc8%252F58c8096f3a14beb26da461a0df5ca81d%252Fpa%252FPA52283_72eeb9808ff656d455a543fc733f22e7.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_72eeb9808ff656d455a543fc733f22e7.jpg saved to cache
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40d918f0-a69b-58da-a2e9-fb2c560ec41f
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16840d210>
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d918f0-a69b-58da-a2e9-fb2c560ec41f/40d918f0-a69b-58da-a2e9-fb2c560ec41f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fc8%252F58c8096f3a14beb26da461a0df5ca81d%252Fpa%252FPA52283_4fa26ec45613b9cdc2f9f2036d48021e.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4fa26ec45613b9cdc2f9f2036d48021e.jpg saved to cache
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40d918f0-a69b-58da-a2e9-fb2c560ec41f
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40d918f0-a69b-58da-a2e9-fb2c560ec41f, skipping ID generation
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d918f0-a69b-58da-a2e9-fb2c560ec41f with scrape type 1
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40d918f0-a69b-58da-a2e9-fb2c560ec41f sending to next pipeline
2026-03-28 14:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 40d918f0-a69b-58da-a2e9-fb2c560ec41f, identifier: PA52283
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2be64e7-3c09-59f2-bdc7-0670058494f0 with identifier: EA73564
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2be64e7-3c09-59f2-bdc7-0670058494f0 with scrape type 1
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f2be64e7-3c09-59f2-bdc7-0670058494f0
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F12%252F93122848141d0b18c7ef10c85502e20f%252Fpa%252FEA73564_0a6d0e1c27f4e707be5146c5a4fea453.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_0a6d0e1c27f4e707be5146c5a4fea453.jpg not downloaded yet
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16861d350>
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fef%252F40efd70b6781a0905eed01aa639d3270%252Fpa%252FBE72749_8980587e548427a85d012bf8c74e6435.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_8980587e548427a85d012bf8c74e6435.jpg saved to cache
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7b73b17-dd7a-5831-afff-fb521530837c
2026-03-28 14:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7b73b17-dd7a-5831-afff-fb521530837c, skipping ID generation
2026-03-28 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7b73b17-dd7a-5831-afff-fb521530837c with scrape type 1
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7b73b17-dd7a-5831-afff-fb521530837c sending to next pipeline
2026-03-28 14:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c7b73b17-dd7a-5831-afff-fb521530837c, identifier: BE72749
2026-03-28 14:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_f0ce202c1b2d1098e498c0adc57c08fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_2687a8fbc10504c362bc6dc5cad3e605.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_2687a8fbc10504c362bc6dc5cad3e605.jpg not downloaded yet
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_d5e14ff97402b781590b000b8481164f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_d5e14ff97402b781590b000b8481164f.jpg not downloaded yet
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_0d55aaf782b7e940e4a035a9393c14fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_0d55aaf782b7e940e4a035a9393c14fb.jpg not downloaded yet
2026-03-28 14:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6211c8bb-ee73-5f0e-98ce-d44099955b6c with identifier: VA34349
2026-03-28 14:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6211c8bb-ee73-5f0e-98ce-d44099955b6c with identifier: VA34349
2026-03-28 14:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6211c8bb-ee73-5f0e-98ce-d44099955b6c with identifier: VA34349 to the API
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_4e1ce2d318d4a620a27f5bff49712afc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:22Z',
 'fuel_type': 'diesel',
 'id': '6211c8bb-ee73-5f0e-98ce-d44099955b6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA34349',
 'listing': 'auction',
 'location': 'ES, Tarragona',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 216561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_a4b055a0b43d6bb190339c0d5ae1b582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_4e1ce2d318d4a620a27f5bff49712afc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_0d2f09ea5f060fc83a6d8aecf9e729e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_607513141d9d6577fbf8c00755d4dccc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_a493f4b5dcca9d362dff7bd3db9d4996.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_dc5835de08d52cff75661b1201d4ed12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_f7799971876dd910f9b5b3a743c7ccfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_a7c6a3aa1c93f0fe7f09593c80ecc2ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_af0ec0f1836b919f130042fe0bc77381.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6211c8bb-ee73-5f0e-98ce-d44099955b6c/6211c8bb-ee73-5f0e-98ce-d44099955b6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/87/74877bc9328f225f020049714b76e5e1/pa/VA34349_9e7bb2df9ad2ea4571c8048139ab62d9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI clean diesel Ultra Advanced edition',
 'transmission': 'manual',
 'trim': 'Ultra Advanced edition',
 'year': 2015}
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA34349%27 HTTP/1.1" 200 None
2026-03-28 14:01:24 [auto1.es] INFO: Saving data for VA34349: {'created_time': 1774706484.056317, 'last_price_update_time': 1774706484.056327, 'auction_closing_time': 1774885702.0}
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VA34349') HTTP/1.1" 204 0
2026-03-28 14:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 40d918f0-a69b-58da-a2e9-fb2c560ec41f with identifier: PA52283
2026-03-28 14:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 40d918f0-a69b-58da-a2e9-fb2c560ec41f with identifier: PA52283
2026-03-28 14:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 40d918f0-a69b-58da-a2e9-fb2c560ec41f with identifier: PA52283 to the API
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4fa26ec45613b9cdc2f9f2036d48021e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.8L',
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:51:28Z',
 'fuel_type': 'petrol',
 'id': '40d918f0-a69b-58da-a2e9-fb2c560ec41f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA52283',
 'listing': 'auction',
 'location': 'ES, Tarragona',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 266589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d918f0-a69b-58da-a2e9-fb2c560ec41f/40d918f0-a69b-58da-a2e9-fb2c560ec41f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_f6d8a00a1e786af15da54cf8cde77230.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d918f0-a69b-58da-a2e9-fb2c560ec41f/40d918f0-a69b-58da-a2e9-fb2c560ec41f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_a70c0055925c49debae2ab7edd7c7ce2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d918f0-a69b-58da-a2e9-fb2c560ec41f/40d918f0-a69b-58da-a2e9-fb2c560ec41f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4b57aef1872af3c33be046f0fc636281.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d918f0-a69b-58da-a2e9-fb2c560ec41f/40d918f0-a69b-58da-a2e9-fb2c560ec41f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4fa26ec45613b9cdc2f9f2036d48021e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d918f0-a69b-58da-a2e9-fb2c560ec41f/40d918f0-a69b-58da-a2e9-fb2c560ec41f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_72eeb9808ff656d455a543fc733f22e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d918f0-a69b-58da-a2e9-fb2c560ec41f/40d918f0-a69b-58da-a2e9-fb2c560ec41f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/c8/58c8096f3a14beb26da461a0df5ca81d/pa/PA52283_4fe55631f9d3b25c2ba1c31d6695735a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1998-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.8 V6',
 'transmission': 'manual',
 'trim': '',
 'year': 1998}
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA52283%27 HTTP/1.1" 200 None
2026-03-28 14:01:24 [auto1.es] INFO: Saving data for PA52283: {'created_time': 1774706484.484332, 'last_price_update_time': 1774706484.484343, 'auction_closing_time': 1774885888.0}
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PA52283') HTTP/1.1" 204 0
2026-03-28 14:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c7b73b17-dd7a-5831-afff-fb521530837c with identifier: BE72749
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 14:01:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c7b73b17-dd7a-5831-afff-fb521530837c with identifier: BE72749
2026-03-28 14:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c7b73b17-dd7a-5831-afff-fb521530837c with identifier: BE72749 to the API
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_8980587e548427a85d012bf8c74e6435.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 216,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:54Z',
 'fuel_type': 'diesel',
 'id': 'c7b73b17-dd7a-5831-afff-fb521530837c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE72749',
 'listing': 'auction',
 'location': 'ES, Rubí',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 212169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_8980587e548427a85d012bf8c74e6435.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_fc6ae74efe9233c5de4ecb12a6a4b158.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_78b5ee513a3cec78426e1ba4830b158d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_b77c5ab5e3599878a998736c36b8d27c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_966dbbafc940016db03bcfa15b27e139.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_9bc61b6d64638877159cdcb55c7651c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_7f3c90c2fe3476dc033f9cf5ec7b71db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_fa6a34f19e19238f957338795717e8af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_a19eec05d9fedf3fd409fa47b0ca7c26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b73b17-dd7a-5831-afff-fb521530837c/c7b73b17-dd7a-5831-afff-fb521530837c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ef/40efd70b6781a0905eed01aa639d3270/pa/BE72749_faee75d35318a1f417ade097a683ad67.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi XE',
 'transmission': 'automatic',
 'trim': 'XE',
 'year': 2009}
2026-03-28 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE72749%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [auto1.es] INFO: Saving data for BE72749: {'created_time': 1774706485.004617, 'last_price_update_time': 1774706485.004629, 'auction_closing_time': 1774883154.0}
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BE72749') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 542e0ac8-69b4-5a58-a264-0af8890ee37a with identifier: ZM37535
2026-03-28 14:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 542e0ac8-69b4-5a58-a264-0af8890ee37a with scrape type 1
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 542e0ac8-69b4-5a58-a264-0af8890ee37a
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_27d07b800b6927fabf34266e932ef063.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_27d07b800b6927fabf34266e932ef063.jpg not downloaded yet
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_14c44822d49d440b308c5d8f21fb9a5d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_8398b911df0e8e9b229f4c5cdfcbe58c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_8398b911df0e8e9b229f4c5cdfcbe58c.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F12%252F93122848141d0b18c7ef10c85502e20f%252Fpa%252FEA73564_3d4e3d45c776ad388b60e33870b5ff3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_3d4e3d45c776ad388b60e33870b5ff3c.jpg not downloaded yet
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_65e2345c2573e14931f2dceef3c8f11d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_554b592b7e84029aecb7c0d211dc5df1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_1b05dc182ff7c001a78798d80ea169c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_61a8d4ec50a7075e6e1e89b7cfd4bba9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_7f20587885baf68b0073459833de391a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_a35460bd96d1e5764361789cfa99547c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_a35460bd96d1e5764361789cfa99547c.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_b87b9fe024a5e08acbb3a35472d503a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b87b9fe024a5e08acbb3a35472d503a4.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_4e1116df69f5b5d903a633cb443fc442.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_4e1116df69f5b5d903a633cb443fc442.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_26f453eb33652443f1fe5bedc4f01f55.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_26f453eb33652443f1fe5bedc4f01f55.jpg not downloaded yet
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF54007/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a255d50>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_cbed9d5db23ded21d77aa94bec27f4a2.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_cbed9d5db23ded21d77aa94bec27f4a2.jpg saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a73fd50c-54de-575c-86e5-124a93a28c2d
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a003a90>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_55ca5f1800b52fc995d1c633f8ace168.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_55ca5f1800b52fc995d1c633f8ace168.jpg saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a243d50>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_277318ec00075308d789d854341784d0.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_277318ec00075308d789d854341784d0.jpg saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b395c3ef-2b70-5be4-ad00-5f967b128163
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684b9910>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_238405fbbf8674a57e3ccd92af2677e9.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_238405fbbf8674a57e3ccd92af2677e9.jpg saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a73fd50c-54de-575c-86e5-124a93a28c2d
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_3f8dc92c7f00613017d8db5945a7c930.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_e8dcbbbbb037ee6e66ed5b9ea0155e01.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_e8dcbbbbb037ee6e66ed5b9ea0155e01.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F12%252F93122848141d0b18c7ef10c85502e20f%252Fpa%252FEA73564_8670fcb828a84636449a11af4c70217b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_8670fcb828a84636449a11af4c70217b.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_d20b5c6ccf248166efbb0eb03d137766.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_d20b5c6ccf248166efbb0eb03d137766.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_b95b091aba9642be415a2f51b8d17ce0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b95b091aba9642be415a2f51b8d17ce0.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_1ee9f2dd0ed3d294afb55ec741980b6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_1ee9f2dd0ed3d294afb55ec741980b6a.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_18917af8a498b68ab23cb53e933f5531.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_18917af8a498b68ab23cb53e933f5531.jpg not downloaded yet
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16861d2d0>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_f0ce202c1b2d1098e498c0adc57c08fb.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_f0ce202c1b2d1098e498c0adc57c08fb.jpg saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b395c3ef-2b70-5be4-ad00-5f967b128163
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b943fe07ee9e928b014962e52d39d75b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_dca44d2331c23c0874a39d2948d13ed3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_dca44d2331c23c0874a39d2948d13ed3.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F12%252F93122848141d0b18c7ef10c85502e20f%252Fpa%252FEA73564_553f360a643bb84fbc9fa8fa42714ac5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_553f360a643bb84fbc9fa8fa42714ac5.jpg not downloaded yet
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a231c90>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_14c44822d49d440b308c5d8f21fb9a5d.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_14c44822d49d440b308c5d8f21fb9a5d.jpg saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a73fd50c-54de-575c-86e5-124a93a28c2d
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a331f50>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_65e2345c2573e14931f2dceef3c8f11d.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_65e2345c2573e14931f2dceef3c8f11d.jpg saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c21dca98-71a4-5b1c-b917-3f63317cf371
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168573190>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_554b592b7e84029aecb7c0d211dc5df1.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_554b592b7e84029aecb7c0d211dc5df1.jpg saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b395c3ef-2b70-5be4-ad00-5f967b128163
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1685bf110>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_1b05dc182ff7c001a78798d80ea169c2.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_1b05dc182ff7c001a78798d80ea169c2.jpg saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c4c2c90>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_61a8d4ec50a7075e6e1e89b7cfd4bba9.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_61a8d4ec50a7075e6e1e89b7cfd4bba9.jpg saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a342a10>
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_7f20587885baf68b0073459833de391a.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_7f20587885baf68b0073459833de391a.jpg saved to cache
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c21dca98-71a4-5b1c-b917-3f63317cf371
2026-03-28 14:01:25 [auto1.es] INFO: Channel: 24h | Page: 7 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_26490b9395c97e1e48c8948c5c7554d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_c92305198f561828fed4ccb92a84b152.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_c92305198f561828fed4ccb92a84b152.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_c8eef5e75fff2473da288c0c7bb57dc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_c8eef5e75fff2473da288c0c7bb57dc9.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_a1255c0701d426fdcc2f7d4293226c27.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_a1255c0701d426fdcc2f7d4293226c27.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_59778a6751416b1ced4ad6af5d501ad4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_59778a6751416b1ced4ad6af5d501ad4.jpg not downloaded yet
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_766d32ff5c7e3006d9b124e3164ea231.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_1aa752f9db20b805022225dca9a238c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_27d07b800b6927fabf34266e932ef063.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_d5e14ff97402b781590b000b8481164f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_42772e1960102ef5ed55d6d9c2b29b05.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_0d55aaf782b7e940e4a035a9393c14fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_b0072aef9ed495bafbd9083db19bba00.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_b0072aef9ed495bafbd9083db19bba00.jpg not downloaded yet
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F12%252F93122848141d0b18c7ef10c85502e20f%252Fpa%252FEA73564_475ce24740ad2893fadb34c514dae563.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_475ce24740ad2893fadb34c514dae563.jpg not downloaded yet
2026-03-28 14:01:25 [auto1.es] INFO: Found listing with ID: VC46387
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC46387%27 HTTP/1.1" 200 None
2026-03-28 14:01:25 [auto1.es] INFO: Scrape type for VC46387: 0
2026-03-28 14:01:25 [auto1.es] INFO: Found listing with ID: PT83214
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT83214%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for PT83214: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: JM22028
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM22028%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for JM22028: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: BE06656
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: BB43424
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: PP51748
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP51748%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for PP51748: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: UR52438
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: PS14149
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: KW41207
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW41207%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for KW41207: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: DZ14313
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ14313%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for DZ14313: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: GB85500
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: MM10114
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM10114%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for MM10114: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: HB49696
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: BD69274
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD69274%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for BD69274: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: ES13897
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES13897%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for ES13897: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: PD50482
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD50482%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for PD50482: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: FP09547
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: KU62533
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: JZ72773
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ72773%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for JZ72773: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: SX89883
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: KP23641
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: FN14601
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN14601%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for FN14601: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: ZT45272
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: EW17140
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW17140%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for EW17140: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: GP84876
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: FF19626
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF19626%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for FF19626: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: GG14536
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: XF41535
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF41535%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for XF41535: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: KK57262
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK57262%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for KK57262: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: PL51206
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: GZ44796
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: EU70316
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU70316%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for EU70316: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: PN86377
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: MF61460
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF61460%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for MF61460: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: JS10706
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS10706%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for JS10706: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: UG73300
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG73300%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for UG73300: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: CE73826
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: DW64016
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW64016%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [auto1.es] INFO: Scrape type for DW64016: 0
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: XB82673
2026-03-28 14:01:26 [auto1.es] INFO: Found listing with ID: NM22189
2026-03-28 14:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0d0350>
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_3f8dc92c7f00613017d8db5945a7c930.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_3f8dc92c7f00613017d8db5945a7c930.jpg saved to cache
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a73fd50c-54de-575c-86e5-124a93a28c2d
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_cf2decec708561f6d4afa55b6885f19e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_cf2decec708561f6d4afa55b6885f19e.jpg not downloaded yet
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_6787ef4da09315456e449c53a19cbe39.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_6787ef4da09315456e449c53a19cbe39.jpg not downloaded yet
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_e8e3fb831fbc09c8bd1da7dec2633b6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_e8e3fb831fbc09c8bd1da7dec2633b6a.jpg not downloaded yet
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_65a0a0872833e674700ec835bb24d22e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_65a0a0872833e674700ec835bb24d22e.jpg not downloaded yet
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1683d1690>
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_b943fe07ee9e928b014962e52d39d75b.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b943fe07ee9e928b014962e52d39d75b.jpg saved to cache
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d
2026-03-28 14:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_2687a8fbc10504c362bc6dc5cad3e605.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_9563b5e74f34a6a50bb9cc945be89919.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_9563b5e74f34a6a50bb9cc945be89919.jpg not downloaded yet
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F12%252F93122848141d0b18c7ef10c85502e20f%252Fpa%252FEA73564_4c4e9d8fa309254f9415b067a7dbe7a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_4c4e9d8fa309254f9415b067a7dbe7a3.jpg not downloaded yet
2026-03-28 14:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_1a8b0a8ee1920c7439e18bf7403de314.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_0a6d0e1c27f4e707be5146c5a4fea453.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_d9b1cbc9290b6dfc79a2ed1f02302f64.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_d9b1cbc9290b6dfc79a2ed1f02302f64.jpg not downloaded yet
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a266150>
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_26490b9395c97e1e48c8948c5c7554d4.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_26490b9395c97e1e48c8948c5c7554d4.jpg saved to cache
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b395c3ef-2b70-5be4-ad00-5f967b128163
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686d5ad0>
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_766d32ff5c7e3006d9b124e3164ea231.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_766d32ff5c7e3006d9b124e3164ea231.jpg saved to cache
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a73fd50c-54de-575c-86e5-124a93a28c2d
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16868c510>
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_1aa752f9db20b805022225dca9a238c7.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_1aa752f9db20b805022225dca9a238c7.jpg saved to cache
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c21dca98-71a4-5b1c-b917-3f63317cf371
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16841eb50>
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_27d07b800b6927fabf34266e932ef063.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_27d07b800b6927fabf34266e932ef063.jpg saved to cache
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 542e0ac8-69b4-5a58-a264-0af8890ee37a
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686ff410>
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_d5e14ff97402b781590b000b8481164f.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_d5e14ff97402b781590b000b8481164f.jpg saved to cache
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168471bd0>
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_42772e1960102ef5ed55d6d9c2b29b05.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_42772e1960102ef5ed55d6d9c2b29b05.jpg saved to cache
2026-03-28 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1a9ad0>
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_0d55aaf782b7e940e4a035a9393c14fb.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_0d55aaf782b7e940e4a035a9393c14fb.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a73fd50c-54de-575c-86e5-124a93a28c2d
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_18917af8a498b68ab23cb53e933f5531.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_3d4e3d45c776ad388b60e33870b5ff3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_8670fcb828a84636449a11af4c70217b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_8398b911df0e8e9b229f4c5cdfcbe58c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_553f360a643bb84fbc9fa8fa42714ac5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_ccdb911e8284919adee3060bfddb716c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_ccdb911e8284919adee3060bfddb716c.jpg not downloaded yet
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1788c02d0>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_2687a8fbc10504c362bc6dc5cad3e605.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_2687a8fbc10504c362bc6dc5cad3e605.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c21dca98-71a4-5b1c-b917-3f63317cf371
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687a1490>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_1a8b0a8ee1920c7439e18bf7403de314.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_1a8b0a8ee1920c7439e18bf7403de314.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b395c3ef-2b70-5be4-ad00-5f967b128163
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687b3d90>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2be64e7-3c09-59f2-bdc7-0670058494f0/f2be64e7-3c09-59f2-bdc7-0670058494f0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F12%252F93122848141d0b18c7ef10c85502e20f%252Fpa%252FEA73564_0a6d0e1c27f4e707be5146c5a4fea453.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_0a6d0e1c27f4e707be5146c5a4fea453.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2be64e7-3c09-59f2-bdc7-0670058494f0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_fb8011db6be3e15c312a7d35c82d7b30.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_fb8011db6be3e15c312a7d35c82d7b30.jpg not downloaded yet
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_4c4e9d8fa309254f9415b067a7dbe7a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b95b091aba9642be415a2f51b8d17ce0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_dca44d2331c23c0874a39d2948d13ed3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_65a0a0872833e674700ec835bb24d22e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_e8e3fb831fbc09c8bd1da7dec2633b6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_b1dd454af6a706428ff581fdc7470a6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_b1dd454af6a706428ff581fdc7470a6e.jpg not downloaded yet
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687a3fd0>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_18917af8a498b68ab23cb53e933f5531.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_18917af8a498b68ab23cb53e933f5531.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 542e0ac8-69b4-5a58-a264-0af8890ee37a
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c3eac50>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2be64e7-3c09-59f2-bdc7-0670058494f0/f2be64e7-3c09-59f2-bdc7-0670058494f0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F12%252F93122848141d0b18c7ef10c85502e20f%252Fpa%252FEA73564_3d4e3d45c776ad388b60e33870b5ff3c.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_3d4e3d45c776ad388b60e33870b5ff3c.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2be64e7-3c09-59f2-bdc7-0670058494f0
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a047710>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2be64e7-3c09-59f2-bdc7-0670058494f0/f2be64e7-3c09-59f2-bdc7-0670058494f0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F12%252F93122848141d0b18c7ef10c85502e20f%252Fpa%252FEA73564_8670fcb828a84636449a11af4c70217b.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_8670fcb828a84636449a11af4c70217b.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2be64e7-3c09-59f2-bdc7-0670058494f0
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16aff8110>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_8398b911df0e8e9b229f4c5cdfcbe58c.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_8398b911df0e8e9b229f4c5cdfcbe58c.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b395c3ef-2b70-5be4-ad00-5f967b128163
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a185710>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2be64e7-3c09-59f2-bdc7-0670058494f0/f2be64e7-3c09-59f2-bdc7-0670058494f0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F12%252F93122848141d0b18c7ef10c85502e20f%252Fpa%252FEA73564_553f360a643bb84fbc9fa8fa42714ac5.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_553f360a643bb84fbc9fa8fa42714ac5.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2be64e7-3c09-59f2-bdc7-0670058494f0
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_9563b5e74f34a6a50bb9cc945be89919.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_b62523683a712b9147967cb4d7244dad.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_b62523683a712b9147967cb4d7244dad.jpg not downloaded yet
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_1ee9f2dd0ed3d294afb55ec741980b6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_6787ef4da09315456e449c53a19cbe39.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV31906> (referer: https://www.auto1.com/v1/car-details-view/HV31906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c4cb8d0>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2be64e7-3c09-59f2-bdc7-0670058494f0/f2be64e7-3c09-59f2-bdc7-0670058494f0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F12%252F93122848141d0b18c7ef10c85502e20f%252Fpa%252FEA73564_4c4e9d8fa309254f9415b067a7dbe7a3.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_4c4e9d8fa309254f9415b067a7dbe7a3.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2be64e7-3c09-59f2-bdc7-0670058494f0
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168535890>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_b95b091aba9642be415a2f51b8d17ce0.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b95b091aba9642be415a2f51b8d17ce0.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1066d0>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_dca44d2331c23c0874a39d2948d13ed3.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_dca44d2331c23c0874a39d2948d13ed3.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b395c3ef-2b70-5be4-ad00-5f967b128163
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684cd890>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_65a0a0872833e674700ec835bb24d22e.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_65a0a0872833e674700ec835bb24d22e.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 542e0ac8-69b4-5a58-a264-0af8890ee37a
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a107ed0>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_e8e3fb831fbc09c8bd1da7dec2633b6a.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_e8e3fb831fbc09c8bd1da7dec2633b6a.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a73fd50c-54de-575c-86e5-124a93a28c2d
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_b0072aef9ed495bafbd9083db19bba00.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_475ce24740ad2893fadb34c514dae563.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_d9b1cbc9290b6dfc79a2ed1f02302f64.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_fb8011db6be3e15c312a7d35c82d7b30.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_cf2decec708561f6d4afa55b6885f19e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_ccdb911e8284919adee3060bfddb716c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD08743> (referer: https://www.auto1.com/v1/car-details-view/DD08743/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1ab210>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_9563b5e74f34a6a50bb9cc945be89919.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_9563b5e74f34a6a50bb9cc945be89919.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b395c3ef-2b70-5be4-ad00-5f967b128163
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686c4650>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_1ee9f2dd0ed3d294afb55ec741980b6a.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_1ee9f2dd0ed3d294afb55ec741980b6a.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a73fd50c-54de-575c-86e5-124a93a28c2d
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a202ad0>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_6787ef4da09315456e449c53a19cbe39.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_6787ef4da09315456e449c53a19cbe39.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d
2026-03-28 14:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7de609ff-ecae-547c-ad4a-af414575a76b with identifier: HV31906
2026-03-28 14:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7de609ff-ecae-547c-ad4a-af414575a76b with scrape type 1
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7de609ff-ecae-547c-ad4a-af414575a76b
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_9e44ebc1c4c2cbee1cd4ef2096576aa3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_9e44ebc1c4c2cbee1cd4ef2096576aa3.jpg not downloaded yet
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_226da7fcd6caa81dbf47ea72d70fed69.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_226da7fcd6caa81dbf47ea72d70fed69.jpg not downloaded yet
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_a1255c0701d426fdcc2f7d4293226c27.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686d6890>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_b0072aef9ed495bafbd9083db19bba00.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_b0072aef9ed495bafbd9083db19bba00.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b395c3ef-2b70-5be4-ad00-5f967b128163
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c13d010>
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2be64e7-3c09-59f2-bdc7-0670058494f0/f2be64e7-3c09-59f2-bdc7-0670058494f0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F12%252F93122848141d0b18c7ef10c85502e20f%252Fpa%252FEA73564_475ce24740ad2893fadb34c514dae563.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_475ce24740ad2893fadb34c514dae563.jpg saved to cache
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2be64e7-3c09-59f2-bdc7-0670058494f0
2026-03-28 14:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2be64e7-3c09-59f2-bdc7-0670058494f0, skipping ID generation
2026-03-28 14:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2be64e7-3c09-59f2-bdc7-0670058494f0 with scrape type 1
2026-03-28 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2be64e7-3c09-59f2-bdc7-0670058494f0 sending to next pipeline
2026-03-28 14:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f2be64e7-3c09-59f2-bdc7-0670058494f0, identifier: EA73564
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168712c10>
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_d9b1cbc9290b6dfc79a2ed1f02302f64.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_d9b1cbc9290b6dfc79a2ed1f02302f64.jpg saved to cache
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 542e0ac8-69b4-5a58-a264-0af8890ee37a
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168473b10>
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_fb8011db6be3e15c312a7d35c82d7b30.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_fb8011db6be3e15c312a7d35c82d7b30.jpg saved to cache
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 542e0ac8-69b4-5a58-a264-0af8890ee37a
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684cd550>
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_cf2decec708561f6d4afa55b6885f19e.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_cf2decec708561f6d4afa55b6885f19e.jpg saved to cache
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c21dca98-71a4-5b1c-b917-3f63317cf371
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686fc6d0>
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_ccdb911e8284919adee3060bfddb716c.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_ccdb911e8284919adee3060bfddb716c.jpg saved to cache
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 542e0ac8-69b4-5a58-a264-0af8890ee37a
2026-03-28 14:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a57a4e15-3e60-5c60-9bae-df030d2fe6b6 with identifier: DD08743
2026-03-28 14:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6 with scrape type 1
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_eaab3b9645a7851a27c1bc6a90859725.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_eaab3b9645a7851a27c1bc6a90859725.jpg not downloaded yet
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_56bf52168a2f6fd5c54d60bec623ce1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_56bf52168a2f6fd5c54d60bec623ce1b.jpg not downloaded yet
2026-03-28 14:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f2be64e7-3c09-59f2-bdc7-0670058494f0 with identifier: EA73564
2026-03-28 14:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f2be64e7-3c09-59f2-bdc7-0670058494f0 with identifier: EA73564
2026-03-28 14:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f2be64e7-3c09-59f2-bdc7-0670058494f0 with identifier: EA73564 to the API
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_475ce24740ad2893fadb34c514dae563.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:53Z',
 'fuel_type': 'diesel',
 'id': 'f2be64e7-3c09-59f2-bdc7-0670058494f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA73564',
 'listing': 'auction',
 'location': 'ES, Lugones',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 286676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2be64e7-3c09-59f2-bdc7-0670058494f0/f2be64e7-3c09-59f2-bdc7-0670058494f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_0a6d0e1c27f4e707be5146c5a4fea453.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2be64e7-3c09-59f2-bdc7-0670058494f0/f2be64e7-3c09-59f2-bdc7-0670058494f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_3d4e3d45c776ad388b60e33870b5ff3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2be64e7-3c09-59f2-bdc7-0670058494f0/f2be64e7-3c09-59f2-bdc7-0670058494f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_8670fcb828a84636449a11af4c70217b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2be64e7-3c09-59f2-bdc7-0670058494f0/f2be64e7-3c09-59f2-bdc7-0670058494f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_553f360a643bb84fbc9fa8fa42714ac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2be64e7-3c09-59f2-bdc7-0670058494f0/f2be64e7-3c09-59f2-bdc7-0670058494f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_475ce24740ad2893fadb34c514dae563.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2be64e7-3c09-59f2-bdc7-0670058494f0/f2be64e7-3c09-59f2-bdc7-0670058494f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/12/93122848141d0b18c7ef10c85502e20f/pa/EA73564_4c4e9d8fa309254f9415b067a7dbe7a3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1999-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.9 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 1999}
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA73564%27 HTTP/1.1" 200 None
2026-03-28 14:01:28 [auto1.es] INFO: Saving data for EA73564: {'created_time': 1774706488.975529, 'last_price_update_time': 1774706488.975541, 'auction_closing_time': 1774885313.0}
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EA73564') HTTP/1.1" 204 0
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_59778a6751416b1ced4ad6af5d501ad4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_c92305198f561828fed4ccb92a84b152.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_d7267a8e53a43c33afd1b1cc4a6893b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_d7267a8e53a43c33afd1b1cc4a6893b8.jpg not downloaded yet
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF54007> (referer: https://www.auto1.com/v1/car-details-view/UF54007/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_d20b5c6ccf248166efbb0eb03d137766.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_b1dd454af6a706428ff581fdc7470a6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_c8eef5e75fff2473da288c0c7bb57dc9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_b62523683a712b9147967cb4d7244dad.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_e8dcbbbbb037ee6e66ed5b9ea0155e01.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_897abebb5efb6d5460eaf4d6c5176c8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_897abebb5efb6d5460eaf4d6c5176c8b.jpg not downloaded yet
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_26f453eb33652443f1fe5bedc4f01f55.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_e15c1e0a8c684d50136c851cbe03faa6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_e15c1e0a8c684d50136c851cbe03faa6.jpg not downloaded yet
2026-03-28 14:01:29 [auto1.es] INFO: Channel: 24h | Page: 8 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a24f350>
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_a1255c0701d426fdcc2f7d4293226c27.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_a1255c0701d426fdcc2f7d4293226c27.jpg saved to cache
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a73fd50c-54de-575c-86e5-124a93a28c2d
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_0c251980b84322811a83f431c4164d9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_0c251980b84322811a83f431c4164d9f.jpg not downloaded yet
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_09025b76eb638fdcdcb370a45d667ff1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_09025b76eb638fdcdcb370a45d667ff1.jpg not downloaded yet
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: BA61536
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA61536%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for BA61536: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: UP09375
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP09375%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for UP09375: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: GE22021
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE22021%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for GE22021: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: FA09072
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA09072%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for FA09072: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: ZH42049
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH42049%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for ZH42049: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: LB38939
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB38939%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for LB38939: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: RV29319
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV29319%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for RV29319: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: US62634
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US62634%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for US62634: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: XN12672
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN12672%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for XN12672: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: YH49695
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: RW91373
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: RP67068
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP67068%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for RP67068: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: LG74328
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: RF85744
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF85744%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for RF85744: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: YX32704
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX32704%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for YX32704: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: ZG63896
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: XN94474
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN94474%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for XN94474: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: VU26922
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: AG57096
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: CM29770
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM29770%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for CM29770: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: PU80612
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: RX82713
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX82713%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for RX82713: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: AE71783
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE71783%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for AE71783: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: GH02704
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: GR51630
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR51630%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for GR51630: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: CM09391
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM09391%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for CM09391: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: DU59373
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU59373%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for DU59373: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: ZH62909
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: HZ84685
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ84685%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for HZ84685: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: GC12558
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: KD17519
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD17519%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for KD17519: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: UZ29384
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: KA03965
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA03965%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for KA03965: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: WN30367
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN30367%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for WN30367: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: FC18044
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC18044%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for FC18044: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: EE40480
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE40480%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for EE40480: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: ZU46399
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU46399%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [auto1.es] INFO: Scrape type for ZU46399: 0
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: KY80374
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: ZB60783
2026-03-28 14:01:29 [auto1.es] INFO: Found listing with ID: YZ74298
2026-03-28 14:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b87b9fe024a5e08acbb3a35472d503a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_9e44ebc1c4c2cbee1cd4ef2096576aa3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_eaab3b9645a7851a27c1bc6a90859725.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_a35460bd96d1e5764361789cfa99547c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_1d0a0033d92d1385f999a25eadb873d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_1d0a0033d92d1385f999a25eadb873d1.jpg not downloaded yet
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_e387476ee8f5050407f541a3764d3b12.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_e387476ee8f5050407f541a3764d3b12.jpg not downloaded yet
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_2f5d3d4efc88796a729e19092d5d448e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_56bf52168a2f6fd5c54d60bec623ce1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_4e1116df69f5b5d903a633cb443fc442.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_226da7fcd6caa81dbf47ea72d70fed69.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_b2d0975cbe97167e42c90378414c06b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_b2d0975cbe97167e42c90378414c06b9.jpg not downloaded yet
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686e9d10>
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_59778a6751416b1ced4ad6af5d501ad4.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_59778a6751416b1ced4ad6af5d501ad4.jpg saved to cache
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 542e0ac8-69b4-5a58-a264-0af8890ee37a
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0f1150>
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_c92305198f561828fed4ccb92a84b152.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_c92305198f561828fed4ccb92a84b152.jpg saved to cache
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c21dca98-71a4-5b1c-b917-3f63317cf371
2026-03-28 14:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0139334f-0e15-5fd0-987e-e83e30304e68 with identifier: UF54007
2026-03-28 14:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0139334f-0e15-5fd0-987e-e83e30304e68 with scrape type 1
2026-03-28 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0139334f-0e15-5fd0-987e-e83e30304e68
2026-03-28 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_01f5214be512d4af5a9de9a8575ba362.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_01f5214be512d4af5a9de9a8575ba362.jpg not downloaded yet
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a168050>
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_d20b5c6ccf248166efbb0eb03d137766.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_d20b5c6ccf248166efbb0eb03d137766.jpg saved to cache
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c21dca98-71a4-5b1c-b917-3f63317cf371
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0f3ed0>
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_b1dd454af6a706428ff581fdc7470a6e.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_b1dd454af6a706428ff581fdc7470a6e.jpg saved to cache
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 542e0ac8-69b4-5a58-a264-0af8890ee37a
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a17a610>
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_c8eef5e75fff2473da288c0c7bb57dc9.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_c8eef5e75fff2473da288c0c7bb57dc9.jpg saved to cache
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a16b590>
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_b62523683a712b9147967cb4d7244dad.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_b62523683a712b9147967cb4d7244dad.jpg saved to cache
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 542e0ac8-69b4-5a58-a264-0af8890ee37a
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686af450>
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fea%252Fcbea41415126b8f8cdba79fd14b7da53%252Fpa%252FTV24981_e8dcbbbbb037ee6e66ed5b9ea0155e01.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_e8dcbbbbb037ee6e66ed5b9ea0155e01.jpg saved to cache
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b395c3ef-2b70-5be4-ad00-5f967b128163
2026-03-28 14:01:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b395c3ef-2b70-5be4-ad00-5f967b128163, skipping ID generation
2026-03-28 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b395c3ef-2b70-5be4-ad00-5f967b128163 with scrape type 1
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b395c3ef-2b70-5be4-ad00-5f967b128163 sending to next pipeline
2026-03-28 14:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b395c3ef-2b70-5be4-ad00-5f967b128163, identifier: TV24981
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16db61e10>
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F36%252Fb336846a36ec26cec94bd5685d7c79e2%252Fpa%252FZM37535_26f453eb33652443f1fe5bedc4f01f55.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_26f453eb33652443f1fe5bedc4f01f55.jpg saved to cache
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 542e0ac8-69b4-5a58-a264-0af8890ee37a
2026-03-28 14:01:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 542e0ac8-69b4-5a58-a264-0af8890ee37a, skipping ID generation
2026-03-28 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 542e0ac8-69b4-5a58-a264-0af8890ee37a with scrape type 1
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 542e0ac8-69b4-5a58-a264-0af8890ee37a sending to next pipeline
2026-03-28 14:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 542e0ac8-69b4-5a58-a264-0af8890ee37a, identifier: ZM37535
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_69f2304c02b8ce9c4daaa914bfb3a945.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_69f2304c02b8ce9c4daaa914bfb3a945.jpg not downloaded yet
2026-03-28 14:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b395c3ef-2b70-5be4-ad00-5f967b128163 with identifier: TV24981
2026-03-28 14:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b395c3ef-2b70-5be4-ad00-5f967b128163 with identifier: TV24981
2026-03-28 14:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b395c3ef-2b70-5be4-ad00-5f967b128163 with identifier: TV24981 to the API
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_e8dcbbbbb037ee6e66ed5b9ea0155e01.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:32Z',
 'fuel_type': 'petrol',
 'id': 'b395c3ef-2b70-5be4-ad00-5f967b128163',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV24981',
 'listing': 'auction',
 'location': 'ES, Málaga',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 102552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_277318ec00075308d789d854341784d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_f0ce202c1b2d1098e498c0adc57c08fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_554b592b7e84029aecb7c0d211dc5df1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_26490b9395c97e1e48c8948c5c7554d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_1a8b0a8ee1920c7439e18bf7403de314.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_8398b911df0e8e9b229f4c5cdfcbe58c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_e8dcbbbbb037ee6e66ed5b9ea0155e01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_dca44d2331c23c0874a39d2948d13ed3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_b0072aef9ed495bafbd9083db19bba00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b395c3ef-2b70-5be4-ad00-5f967b128163/b395c3ef-2b70-5be4-ad00-5f967b128163_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ea/cbea41415126b8f8cdba79fd14b7da53/pa/TV24981_9563b5e74f34a6a50bb9cc945be89919.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Sport BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sport BlueMotion',
 'year': 2019}
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV24981%27 HTTP/1.1" 200 None
2026-03-28 14:01:31 [auto1.es] INFO: Saving data for TV24981: {'created_time': 1774706491.465254, 'last_price_update_time': 1774706491.465263, 'auction_closing_time': 1774883132.0}
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TV24981') HTTP/1.1" 204 0
2026-03-28 14:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 542e0ac8-69b4-5a58-a264-0af8890ee37a with identifier: ZM37535
2026-03-28 14:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 542e0ac8-69b4-5a58-a264-0af8890ee37a with identifier: ZM37535
2026-03-28 14:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 542e0ac8-69b4-5a58-a264-0af8890ee37a with identifier: ZM37535 to the API
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_26f453eb33652443f1fe5bedc4f01f55.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:51:56Z',
 'fuel_type': 'diesel',
 'id': '542e0ac8-69b4-5a58-a264-0af8890ee37a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM37535',
 'listing': 'auction',
 'location': 'ES, Alicante',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 89892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_27d07b800b6927fabf34266e932ef063.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_26f453eb33652443f1fe5bedc4f01f55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_18917af8a498b68ab23cb53e933f5531.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_59778a6751416b1ced4ad6af5d501ad4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_65a0a0872833e674700ec835bb24d22e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_d9b1cbc9290b6dfc79a2ed1f02302f64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_ccdb911e8284919adee3060bfddb716c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_fb8011db6be3e15c312a7d35c82d7b30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_b1dd454af6a706428ff581fdc7470a6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542e0ac8-69b4-5a58-a264-0af8890ee37a/542e0ac8-69b4-5a58-a264-0af8890ee37a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/36/b336846a36ec26cec94bd5685d7c79e2/pa/ZM37535_b62523683a712b9147967cb4d7244dad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 e-HDi Intensive',
 'transmission': 'manual',
 'trim': 'Intensive',
 'year': 2015}
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM37535%27 HTTP/1.1" 200 None
2026-03-28 14:01:31 [auto1.es] INFO: Saving data for ZM37535: {'created_time': 1774706491.957859, 'last_price_update_time': 1774706491.957869, 'auction_closing_time': 1774885916.0}
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZM37535') HTTP/1.1" 204 0
2026-03-28 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_897abebb5efb6d5460eaf4d6c5176c8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_585cda17b10e48bace1f0594ecae8278.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_585cda17b10e48bace1f0594ecae8278.jpg not downloaded yet
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_01010b6fa451e6594fd37cb22102e4b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_01010b6fa451e6594fd37cb22102e4b8.jpg not downloaded yet
2026-03-28 14:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ81708> (referer: https://www.auto1.com/v1/car-details-view/XJ81708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c3f83d0>
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F40%252Ff140cd8ad18063ab6870e8d304dd0580%252Fpa%252FAW26906_b87b9fe024a5e08acbb3a35472d503a4.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b87b9fe024a5e08acbb3a35472d503a4.jpg saved to cache
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d
2026-03-28 14:01:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad31780b-ee56-5cc9-8a3d-e18f06f1b76d, skipping ID generation
2026-03-28 14:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d with scrape type 1
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad31780b-ee56-5cc9-8a3d-e18f06f1b76d sending to next pipeline
2026-03-28 14:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ad31780b-ee56-5cc9-8a3d-e18f06f1b76d, identifier: AW26906
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c3b4fd0>
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_9e44ebc1c4c2cbee1cd4ef2096576aa3.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_9e44ebc1c4c2cbee1cd4ef2096576aa3.jpg saved to cache
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7de609ff-ecae-547c-ad4a-af414575a76b
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686eb090>
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_eaab3b9645a7851a27c1bc6a90859725.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_eaab3b9645a7851a27c1bc6a90859725.jpg saved to cache
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686fff10>
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_a35460bd96d1e5764361789cfa99547c.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_a35460bd96d1e5764361789cfa99547c.jpg saved to cache
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c21dca98-71a4-5b1c-b917-3f63317cf371
2026-03-28 14:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_d7267a8e53a43c33afd1b1cc4a6893b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_3e55c2de5fc7e8fe05211943a84e73bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_e15c1e0a8c684d50136c851cbe03faa6.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_969d986552b5a64cd4725579c7c5bc85.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_969d986552b5a64cd4725579c7c5bc85.jpg not downloaded yet
2026-03-28 14:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV24306> (referer: https://www.auto1.com/v1/car-details-view/DV24306/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ad31780b-ee56-5cc9-8a3d-e18f06f1b76d with identifier: AW26906
2026-03-28 14:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ad31780b-ee56-5cc9-8a3d-e18f06f1b76d with identifier: AW26906
2026-03-28 14:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ad31780b-ee56-5cc9-8a3d-e18f06f1b76d with identifier: AW26906 to the API
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b87b9fe024a5e08acbb3a35472d503a4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:31:22Z',
 'fuel_type': 'diesel',
 'id': 'ad31780b-ee56-5cc9-8a3d-e18f06f1b76d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW26906',
 'listing': 'auction',
 'location': 'ES, Zaragoza',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 216198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_55ca5f1800b52fc995d1c633f8ace168.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_1b05dc182ff7c001a78798d80ea169c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_61a8d4ec50a7075e6e1e89b7cfd4bba9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b943fe07ee9e928b014962e52d39d75b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_42772e1960102ef5ed55d6d9c2b29b05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_d5e14ff97402b781590b000b8481164f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b87b9fe024a5e08acbb3a35472d503a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_b95b091aba9642be415a2f51b8d17ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_c8eef5e75fff2473da288c0c7bb57dc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad31780b-ee56-5cc9-8a3d-e18f06f1b76d/ad31780b-ee56-5cc9-8a3d-e18f06f1b76d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/40/f140cd8ad18063ab6870e8d304dd0580/pa/AW26906_6787ef4da09315456e449c53a19cbe39.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 TDI Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW26906%27 HTTP/1.1" 200 None
2026-03-28 14:01:32 [auto1.es] INFO: Saving data for AW26906: {'created_time': 1774706492.674233, 'last_price_update_time': 1774706492.674243, 'auction_closing_time': 1774884682.0}
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AW26906') HTTP/1.1" 204 0
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686e8e50>
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_2f5d3d4efc88796a729e19092d5d448e.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_2f5d3d4efc88796a729e19092d5d448e.jpg saved to cache
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c21dca98-71a4-5b1c-b917-3f63317cf371
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686c68d0>
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_56bf52168a2f6fd5c54d60bec623ce1b.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_56bf52168a2f6fd5c54d60bec623ce1b.jpg saved to cache
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7de609ff-ecae-547c-ad4a-af414575a76b
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a105890>
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F18%252F03183aa617808ad2f33bc2d7addd798b%252Fpa%252FCB66471_4e1116df69f5b5d903a633cb443fc442.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_4e1116df69f5b5d903a633cb443fc442.jpg saved to cache
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a73fd50c-54de-575c-86e5-124a93a28c2d
2026-03-28 14:01:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a73fd50c-54de-575c-86e5-124a93a28c2d, skipping ID generation
2026-03-28 14:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a73fd50c-54de-575c-86e5-124a93a28c2d with scrape type 1
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a73fd50c-54de-575c-86e5-124a93a28c2d sending to next pipeline
2026-03-28 14:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a73fd50c-54de-575c-86e5-124a93a28c2d, identifier: CB66471
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a105a90>
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_226da7fcd6caa81dbf47ea72d70fed69.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_226da7fcd6caa81dbf47ea72d70fed69.jpg saved to cache
2026-03-28 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7de609ff-ecae-547c-ad4a-af414575a76b
2026-03-28 14:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_09025b76eb638fdcdcb370a45d667ff1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_0c251980b84322811a83f431c4164d9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_e18178dcaed3320372243a7dcfbc05e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_e18178dcaed3320372243a7dcfbc05e3.jpg not downloaded yet
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_cbf67d1d3ba6a86a23bd9c43b2e4cdd4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_cbf67d1d3ba6a86a23bd9c43b2e4cdd4.jpg not downloaded yet
2026-03-28 14:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a73fd50c-54de-575c-86e5-124a93a28c2d with identifier: CB66471
2026-03-28 14:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a73fd50c-54de-575c-86e5-124a93a28c2d with identifier: CB66471
2026-03-28 14:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a73fd50c-54de-575c-86e5-124a93a28c2d with identifier: CB66471 to the API
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_4e1116df69f5b5d903a633cb443fc442.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:32:31Z',
 'fuel_type': 'diesel',
 'id': 'a73fd50c-54de-575c-86e5-124a93a28c2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB66471',
 'listing': 'auction',
 'location': 'ES, Marbella',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 199304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_cbed9d5db23ded21d77aa94bec27f4a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_238405fbbf8674a57e3ccd92af2677e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_14c44822d49d440b308c5d8f21fb9a5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_3f8dc92c7f00613017d8db5945a7c930.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_766d32ff5c7e3006d9b124e3164ea231.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_0d55aaf782b7e940e4a035a9393c14fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_4e1116df69f5b5d903a633cb443fc442.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_1ee9f2dd0ed3d294afb55ec741980b6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_a1255c0701d426fdcc2f7d4293226c27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73fd50c-54de-575c-86e5-124a93a28c2d/a73fd50c-54de-575c-86e5-124a93a28c2d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/18/03183aa617808ad2f33bc2d7addd798b/pa/CB66471_e8e3fb831fbc09c8bd1da7dec2633b6a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB66471%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [auto1.es] INFO: Saving data for CB66471: {'created_time': 1774706493.399288, 'last_price_update_time': 1774706493.399308, 'auction_closing_time': 1774884751.0}
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CB66471') HTTP/1.1" 204 0
2026-03-28 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_1d0a0033d92d1385f999a25eadb873d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_dfa5f65b8d63f18b3655c3208d8392ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_dfa5f65b8d63f18b3655c3208d8392ef.jpg not downloaded yet
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a173ed0>
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_897abebb5efb6d5460eaf4d6c5176c8b.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_897abebb5efb6d5460eaf4d6c5176c8b.jpg saved to cache
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7de609ff-ecae-547c-ad4a-af414575a76b
2026-03-28 14:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ebdc753-acc1-580c-a518-60528b221c3e with identifier: XJ81708
2026-03-28 14:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ebdc753-acc1-580c-a518-60528b221c3e with scrape type 1
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6ebdc753-acc1-580c-a518-60528b221c3e
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fce%252Fcbce498db4f4b0ae6866d62e8cefc226%252Fpa%252FXJ81708_b2ddc9c7447d45ea9babe2156464ffc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_b2ddc9c7447d45ea9babe2156464ffc5.jpg not downloaded yet
2026-03-28 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_01f5214be512d4af5a9de9a8575ba362.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_e387476ee8f5050407f541a3764d3b12.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_e877326d55d1106b3b1933db86daea23.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_e877326d55d1106b3b1933db86daea23.jpg not downloaded yet
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_95fe9f060e17b79076034c98b5dd824b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_95fe9f060e17b79076034c98b5dd824b.jpg not downloaded yet
2026-03-28 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP71209/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168563110>
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_d7267a8e53a43c33afd1b1cc4a6893b8.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_d7267a8e53a43c33afd1b1cc4a6893b8.jpg saved to cache
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a3ac650>
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F59%252F575966ba07679c6d76aff03bab497f08%252Fpa%252FXZ62069_3e55c2de5fc7e8fe05211943a84e73bf.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_3e55c2de5fc7e8fe05211943a84e73bf.jpg saved to cache
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c21dca98-71a4-5b1c-b917-3f63317cf371
2026-03-28 14:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c21dca98-71a4-5b1c-b917-3f63317cf371, skipping ID generation
2026-03-28 14:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c21dca98-71a4-5b1c-b917-3f63317cf371 with scrape type 1
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c21dca98-71a4-5b1c-b917-3f63317cf371 sending to next pipeline
2026-03-28 14:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c21dca98-71a4-5b1c-b917-3f63317cf371, identifier: XZ62069
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168403bd0>
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_e15c1e0a8c684d50136c851cbe03faa6.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_e15c1e0a8c684d50136c851cbe03faa6.jpg saved to cache
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6
2026-03-28 14:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7cbd7f2-d94d-5878-82e9-c9504f0b4df5 with identifier: DV24306
2026-03-28 14:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7cbd7f2-d94d-5878-82e9-c9504f0b4df5 with scrape type 1
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c7cbd7f2-d94d-5878-82e9-c9504f0b4df5
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F54%252F225460a25fd95cf64d11382c7afa8be9%252Fpa%252FDV24306_fca54b0b258a2e552b17710252d9e2fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_fca54b0b258a2e552b17710252d9e2fb.jpg not downloaded yet
2026-03-28 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_b2d0975cbe97167e42c90378414c06b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_1dc8cacf2a098c81cba43f48309454b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_1dc8cacf2a098c81cba43f48309454b5.jpg not downloaded yet
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fce%252Fcbce498db4f4b0ae6866d62e8cefc226%252Fpa%252FXJ81708_93906f594a061d9bad484b8272ca7382.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_93906f594a061d9bad484b8272ca7382.jpg not downloaded yet
2026-03-28 14:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c21dca98-71a4-5b1c-b917-3f63317cf371 with identifier: XZ62069
2026-03-28 14:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c21dca98-71a4-5b1c-b917-3f63317cf371 with identifier: XZ62069
2026-03-28 14:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c21dca98-71a4-5b1c-b917-3f63317cf371 with identifier: XZ62069 to the API
2026-03-28 14:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_3e55c2de5fc7e8fe05211943a84e73bf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:14:37Z',
 'fuel_type': 'petrol',
 'id': 'c21dca98-71a4-5b1c-b917-3f63317cf371',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ62069',
 'listing': 'auction',
 'location': 'ES, Lucena',
 'make': 'Volkswagen',
 'model': 'Passat CC',
 'odometer': 227272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_3e55c2de5fc7e8fe05211943a84e73bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_65e2345c2573e14931f2dceef3c8f11d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_7f20587885baf68b0073459833de391a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_1aa752f9db20b805022225dca9a238c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_2f5d3d4efc88796a729e19092d5d448e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_2687a8fbc10504c362bc6dc5cad3e605.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_a35460bd96d1e5764361789cfa99547c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_d20b5c6ccf248166efbb0eb03d137766.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_c92305198f561828fed4ccb92a84b152.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c21dca98-71a4-5b1c-b917-3f63317cf371/c21dca98-71a4-5b1c-b917-3f63317cf371_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/59/575966ba07679c6d76aff03bab497f08/pa/XZ62069_cf2decec708561f6d4afa55b6885f19e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Passat CC 1.8 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ62069%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [auto1.es] INFO: Saving data for XZ62069: {'created_time': 1774706494.197416, 'last_price_update_time': 1774706494.197426, 'auction_closing_time': 1774883677.0}
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ62069') HTTP/1.1" 204 0
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a04a550>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_09025b76eb638fdcdcb370a45d667ff1.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_09025b76eb638fdcdcb370a45d667ff1.jpg saved to cache
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16865f790>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_0c251980b84322811a83f431c4164d9f.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_0c251980b84322811a83f431c4164d9f.jpg saved to cache
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7de609ff-ecae-547c-ad4a-af414575a76b
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_01010b6fa451e6594fd37cb22102e4b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_69f2304c02b8ce9c4daaa914bfb3a945.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_b206e5437bd704d84cc55f03f86fbe42.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_b206e5437bd704d84cc55f03f86fbe42.jpg not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F54%252F225460a25fd95cf64d11382c7afa8be9%252Fpa%252FDV24306_31c026f7e05abdfb4b230ee6921c677d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_31c026f7e05abdfb4b230ee6921c677d.jpg not downloaded yet
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_969d986552b5a64cd4725579c7c5bc85.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_585cda17b10e48bace1f0594ecae8278.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_591ff9b730b5eaf123f342a2e7091dfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_591ff9b730b5eaf123f342a2e7091dfa.jpg not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fce%252Fcbce498db4f4b0ae6866d62e8cefc226%252Fpa%252FXJ81708_24ddbf9b25da14c88a0a3499c7d09ed4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_24ddbf9b25da14c88a0a3499c7d09ed4.jpg not downloaded yet
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c3b6c90>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_1d0a0033d92d1385f999a25eadb873d1.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_1d0a0033d92d1385f999a25eadb873d1.jpg saved to cache
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7de609ff-ecae-547c-ad4a-af414575a76b
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a184f50>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_01f5214be512d4af5a9de9a8575ba362.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_01f5214be512d4af5a9de9a8575ba362.jpg saved to cache
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0139334f-0e15-5fd0-987e-e83e30304e68
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a3ace10>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_e387476ee8f5050407f541a3764d3b12.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_e387476ee8f5050407f541a3764d3b12.jpg saved to cache
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_d0fb95c831213da3204f02a209cf7d0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_d0fb95c831213da3204f02a209cf7d0b.jpg not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F54%252F225460a25fd95cf64d11382c7afa8be9%252Fpa%252FDV24306_d42d2fbc4f82aff46addeb7685e7c6c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_d42d2fbc4f82aff46addeb7685e7c6c9.jpg not downloaded yet
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0f1350>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_b2d0975cbe97167e42c90378414c06b9.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_b2d0975cbe97167e42c90378414c06b9.jpg saved to cache
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7de609ff-ecae-547c-ad4a-af414575a76b
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_cbf67d1d3ba6a86a23bd9c43b2e4cdd4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_dfa5f65b8d63f18b3655c3208d8392ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fce%252Fcbce498db4f4b0ae6866d62e8cefc226%252Fpa%252FXJ81708_678b6016f5e4b3439f3dbeea896d8db4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_678b6016f5e4b3439f3dbeea896d8db4.jpg not downloaded yet
2026-03-28 14:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_b2ddc9c7447d45ea9babe2156464ffc5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_e18178dcaed3320372243a7dcfbc05e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_81e15887f9f9b84dd0636a108932f890.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_81e15887f9f9b84dd0636a108932f890.jpg not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F54%252F225460a25fd95cf64d11382c7afa8be9%252Fpa%252FDV24306_c5e2c3a16c79af7086da6acdd62263b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_c5e2c3a16c79af7086da6acdd62263b8.jpg not downloaded yet
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16872f610>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_01010b6fa451e6594fd37cb22102e4b8.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_01010b6fa451e6594fd37cb22102e4b8.jpg saved to cache
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0139334f-0e15-5fd0-987e-e83e30304e68
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a03b150>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_69f2304c02b8ce9c4daaa914bfb3a945.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_69f2304c02b8ce9c4daaa914bfb3a945.jpg saved to cache
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a32cd90>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_969d986552b5a64cd4725579c7c5bc85.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_969d986552b5a64cd4725579c7c5bc85.jpg saved to cache
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684012d0>
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_585cda17b10e48bace1f0594ecae8278.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_585cda17b10e48bace1f0594ecae8278.jpg saved to cache
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7de609ff-ecae-547c-ad4a-af414575a76b
2026-03-28 14:01:34 [auto1.es] INFO: Channel: 24h | Page: 9 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_fca54b0b258a2e552b17710252d9e2fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fce%252Fcbce498db4f4b0ae6866d62e8cefc226%252Fpa%252FXJ81708_1910021d4434a2ee32bf917df415c859.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_1910021d4434a2ee32bf917df415c859.jpg not downloaded yet
2026-03-28 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_95fe9f060e17b79076034c98b5dd824b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_f953b3d3c7d929ac63919cc5d23199b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_f953b3d3c7d929ac63919cc5d23199b7.jpg not downloaded yet
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F54%252F225460a25fd95cf64d11382c7afa8be9%252Fpa%252FDV24306_15a05f062fbf96e50cc6c7b9495de882.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_15a05f062fbf96e50cc6c7b9495de882.jpg not downloaded yet
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: YK64988
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: YJ21148
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: YC05678
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC05678%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [auto1.es] INFO: Scrape type for YC05678: 0
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: XN99288
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: XJ10709
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ10709%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [auto1.es] INFO: Scrape type for XJ10709: 0
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: XA46112
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: WZ01367
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: WY32728
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: WG12182
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG12182%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [auto1.es] INFO: Scrape type for WG12182: 0
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: WB05226
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: UG63824
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG63824%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [auto1.es] INFO: Scrape type for UG63824: 0
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: VV17373
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV17373%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [auto1.es] INFO: Scrape type for VV17373: 0
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: VN92825
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: VJ45850
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ45850%27 HTTP/1.1" 200 None
2026-03-28 14:01:34 [auto1.es] INFO: Scrape type for VJ45850: 0
2026-03-28 14:01:34 [auto1.es] INFO: Found listing with ID: VE30170
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE30170%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [auto1.es] INFO: Scrape type for VE30170: 0
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: ZF31827
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: US42967
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: UB14006
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB14006%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [auto1.es] INFO: Scrape type for UB14006: 0
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: TG79405
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: TE76337
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: TA28107
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA28107%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [auto1.es] INFO: Scrape type for TA28107: 0
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: SZ88467
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ88467%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [auto1.es] INFO: Scrape type for SZ88467: 0
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: ST22726
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: SP63286
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: RY07165
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: NV56765
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: NN81936
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: MY70573
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: MN37580
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN37580%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [auto1.es] INFO: Scrape type for MN37580: 0
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: MK40110
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: MH26986
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: MD02288
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: LY48125
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY48125%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [auto1.es] INFO: Scrape type for LY48125: 0
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: LB98236
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: KS49101
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS49101%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [auto1.es] INFO: Scrape type for KS49101: 0
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: BP62909
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP62909%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [auto1.es] INFO: Scrape type for BP62909: 0
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: WX65667
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX65667%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [auto1.es] INFO: Scrape type for WX65667: 0
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: KH66285
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH66285%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [auto1.es] INFO: Scrape type for KH66285: 0
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: KG64862
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG64862%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [auto1.es] INFO: Scrape type for KG64862: 0
2026-03-28 14:01:35 [auto1.es] INFO: Found listing with ID: JH20520
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH20520%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [auto1.es] INFO: Scrape type for JH20520: 0
2026-03-28 14:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_e877326d55d1106b3b1933db86daea23.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_1dc8cacf2a098c81cba43f48309454b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_31c026f7e05abdfb4b230ee6921c677d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_93906f594a061d9bad484b8272ca7382.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fce%252Fcbce498db4f4b0ae6866d62e8cefc226%252Fpa%252FXJ81708_ae4e747583639be5ac79cd6fd67f3113.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_ae4e747583639be5ac79cd6fd67f3113.jpg not downloaded yet
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a3788d0>
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_cbf67d1d3ba6a86a23bd9c43b2e4cdd4.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_cbf67d1d3ba6a86a23bd9c43b2e4cdd4.jpg saved to cache
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0139334f-0e15-5fd0-987e-e83e30304e68
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0add50>
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_dfa5f65b8d63f18b3655c3208d8392ef.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_dfa5f65b8d63f18b3655c3208d8392ef.jpg saved to cache
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686c5e10>
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebdc753-acc1-580c-a518-60528b221c3e/6ebdc753-acc1-580c-a518-60528b221c3e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fce%252Fcbce498db4f4b0ae6866d62e8cefc226%252Fpa%252FXJ81708_b2ddc9c7447d45ea9babe2156464ffc5.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_b2ddc9c7447d45ea9babe2156464ffc5.jpg saved to cache
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ebdc753-acc1-580c-a518-60528b221c3e
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0ae610>
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_e18178dcaed3320372243a7dcfbc05e3.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_e18178dcaed3320372243a7dcfbc05e3.jpg saved to cache
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7de609ff-ecae-547c-ad4a-af414575a76b
2026-03-28 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_b206e5437bd704d84cc55f03f86fbe42.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_d4e2fa2a4dd661d9b608f1e3c2fc8237.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_d4e2fa2a4dd661d9b608f1e3c2fc8237.jpg not downloaded yet
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F54%252F225460a25fd95cf64d11382c7afa8be9%252Fpa%252FDV24306_a1fa63d31d041d94c50e7dbc08d50ce9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_a1fa63d31d041d94c50e7dbc08d50ce9.jpg not downloaded yet
2026-03-28 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_24ddbf9b25da14c88a0a3499c7d09ed4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_591ff9b730b5eaf123f342a2e7091dfa.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c13cfd0>
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cbd7f2-d94d-5878-82e9-c9504f0b4df5/c7cbd7f2-d94d-5878-82e9-c9504f0b4df5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F54%252F225460a25fd95cf64d11382c7afa8be9%252Fpa%252FDV24306_fca54b0b258a2e552b17710252d9e2fb.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_fca54b0b258a2e552b17710252d9e2fb.jpg saved to cache
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7cbd7f2-d94d-5878-82e9-c9504f0b4df5
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684fe210>
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_95fe9f060e17b79076034c98b5dd824b.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_95fe9f060e17b79076034c98b5dd824b.jpg saved to cache
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0139334f-0e15-5fd0-987e-e83e30304e68
2026-03-28 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_d42d2fbc4f82aff46addeb7685e7c6c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_bd08f891c8f231c16b6f207e64a23ccd.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_bd08f891c8f231c16b6f207e64a23ccd.jpg not downloaded yet
2026-03-28 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_678b6016f5e4b3439f3dbeea896d8db4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_d0fb95c831213da3204f02a209cf7d0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16854ef90>
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F38%252F0138f3db92c3a895198395521e95ced0%252Fpa%252FHV31906_e877326d55d1106b3b1933db86daea23.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_e877326d55d1106b3b1933db86daea23.jpg saved to cache
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7de609ff-ecae-547c-ad4a-af414575a76b
2026-03-28 14:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7de609ff-ecae-547c-ad4a-af414575a76b, skipping ID generation
2026-03-28 14:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7de609ff-ecae-547c-ad4a-af414575a76b with scrape type 1
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7de609ff-ecae-547c-ad4a-af414575a76b sending to next pipeline
2026-03-28 14:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7de609ff-ecae-547c-ad4a-af414575a76b, identifier: HV31906
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c13d290>
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_1dc8cacf2a098c81cba43f48309454b5.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_1dc8cacf2a098c81cba43f48309454b5.jpg saved to cache
2026-03-28 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1c5250>
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cbd7f2-d94d-5878-82e9-c9504f0b4df5/c7cbd7f2-d94d-5878-82e9-c9504f0b4df5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F54%252F225460a25fd95cf64d11382c7afa8be9%252Fpa%252FDV24306_31c026f7e05abdfb4b230ee6921c677d.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_31c026f7e05abdfb4b230ee6921c677d.jpg saved to cache
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7cbd7f2-d94d-5878-82e9-c9504f0b4df5
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686c4d90>
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebdc753-acc1-580c-a518-60528b221c3e/6ebdc753-acc1-580c-a518-60528b221c3e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fce%252Fcbce498db4f4b0ae6866d62e8cefc226%252Fpa%252FXJ81708_93906f594a061d9bad484b8272ca7382.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_93906f594a061d9bad484b8272ca7382.jpg saved to cache
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ebdc753-acc1-580c-a518-60528b221c3e
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_1910021d4434a2ee32bf917df415c859.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_81e15887f9f9b84dd0636a108932f890.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_c5e2c3a16c79af7086da6acdd62263b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7de609ff-ecae-547c-ad4a-af414575a76b with identifier: HV31906
2026-03-28 14:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7de609ff-ecae-547c-ad4a-af414575a76b with identifier: HV31906
2026-03-28 14:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7de609ff-ecae-547c-ad4a-af414575a76b with identifier: HV31906 to the API
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_e877326d55d1106b3b1933db86daea23.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:18:38Z',
 'fuel_type': 'diesel',
 'id': '7de609ff-ecae-547c-ad4a-af414575a76b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV31906',
 'listing': 'auction',
 'location': 'ES, Colmenar Viejo',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 167859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_9e44ebc1c4c2cbee1cd4ef2096576aa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_226da7fcd6caa81dbf47ea72d70fed69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_56bf52168a2f6fd5c54d60bec623ce1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_897abebb5efb6d5460eaf4d6c5176c8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_0c251980b84322811a83f431c4164d9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_1d0a0033d92d1385f999a25eadb873d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_b2d0975cbe97167e42c90378414c06b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_585cda17b10e48bace1f0594ecae8278.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_e18178dcaed3320372243a7dcfbc05e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de609ff-ecae-547c-ad4a-af414575a76b/7de609ff-ecae-547c-ad4a-af414575a76b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/38/0138f3db92c3a895198395521e95ced0/pa/HV31906_e877326d55d1106b3b1933db86daea23.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2016}
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV31906%27 HTTP/1.1" 200 None
2026-03-28 14:01:36 [auto1.es] INFO: Saving data for HV31906: {'created_time': 1774706496.461798, 'last_price_update_time': 1774706496.461808, 'auction_closing_time': 1774883918.0}
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HV31906') HTTP/1.1" 204 0
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a128f50>
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_b206e5437bd704d84cc55f03f86fbe42.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_b206e5437bd704d84cc55f03f86fbe42.jpg saved to cache
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0139334f-0e15-5fd0-987e-e83e30304e68
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_f953b3d3c7d929ac63919cc5d23199b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0f8110>
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebdc753-acc1-580c-a518-60528b221c3e/6ebdc753-acc1-580c-a518-60528b221c3e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fce%252Fcbce498db4f4b0ae6866d62e8cefc226%252Fpa%252FXJ81708_24ddbf9b25da14c88a0a3499c7d09ed4.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_24ddbf9b25da14c88a0a3499c7d09ed4.jpg saved to cache
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ebdc753-acc1-580c-a518-60528b221c3e
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16872e3d0>
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F53%252F6153f708984d81896a3388f5af8a2147%252Fpa%252FDD08743_591ff9b730b5eaf123f342a2e7091dfa.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_591ff9b730b5eaf123f342a2e7091dfa.jpg saved to cache
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6
2026-03-28 14:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a57a4e15-3e60-5c60-9bae-df030d2fe6b6, skipping ID generation
2026-03-28 14:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6 with scrape type 1
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a57a4e15-3e60-5c60-9bae-df030d2fe6b6 sending to next pipeline
2026-03-28 14:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a57a4e15-3e60-5c60-9bae-df030d2fe6b6, identifier: DD08743
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a34f010>
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cbd7f2-d94d-5878-82e9-c9504f0b4df5/c7cbd7f2-d94d-5878-82e9-c9504f0b4df5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F54%252F225460a25fd95cf64d11382c7afa8be9%252Fpa%252FDV24306_d42d2fbc4f82aff46addeb7685e7c6c9.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_d42d2fbc4f82aff46addeb7685e7c6c9.jpg saved to cache
2026-03-28 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7cbd7f2-d94d-5878-82e9-c9504f0b4df5
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_d4e2fa2a4dd661d9b608f1e3c2fc8237.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_ae4e747583639be5ac79cd6fd67f3113.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_15a05f062fbf96e50cc6c7b9495de882.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a57a4e15-3e60-5c60-9bae-df030d2fe6b6 with identifier: DD08743
2026-03-28 14:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a57a4e15-3e60-5c60-9bae-df030d2fe6b6 with identifier: DD08743
2026-03-28 14:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a57a4e15-3e60-5c60-9bae-df030d2fe6b6 with identifier: DD08743 to the API
2026-03-28 14:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_591ff9b730b5eaf123f342a2e7091dfa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:47:36Z',
 'fuel_type': 'diesel',
 'id': 'a57a4e15-3e60-5c60-9bae-df030d2fe6b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD08743',
 'listing': 'auction',
 'location': 'ES, Oiartzun',
 'make': 'Volkswagen',
 'model': 'Passat Alltrack',
 'odometer': 185932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_eaab3b9645a7851a27c1bc6a90859725.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_d7267a8e53a43c33afd1b1cc4a6893b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_e15c1e0a8c684d50136c851cbe03faa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_09025b76eb638fdcdcb370a45d667ff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_e387476ee8f5050407f541a3764d3b12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_69f2304c02b8ce9c4daaa914bfb3a945.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_969d986552b5a64cd4725579c7c5bc85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_dfa5f65b8d63f18b3655c3208d8392ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_1dc8cacf2a098c81cba43f48309454b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a57a4e15-3e60-5c60-9bae-df030d2fe6b6/a57a4e15-3e60-5c60-9bae-df030d2fe6b6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/53/6153f708984d81896a3388f5af8a2147/pa/DD08743_591ff9b730b5eaf123f342a2e7091dfa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat Alltrack 2.0 TDI 4Motion',
 'transmission': 'automatic',
 'trim': '4Motion',
 'year': 2021}
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD08743%27 HTTP/1.1" 200 None
2026-03-28 14:01:37 [auto1.es] INFO: Saving data for DD08743: {'created_time': 1774706497.344527, 'last_price_update_time': 1774706497.34454, 'auction_closing_time': 1774885656.0}
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DD08743') HTTP/1.1" 204 0
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1687b0a90>
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebdc753-acc1-580c-a518-60528b221c3e/6ebdc753-acc1-580c-a518-60528b221c3e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fce%252Fcbce498db4f4b0ae6866d62e8cefc226%252Fpa%252FXJ81708_678b6016f5e4b3439f3dbeea896d8db4.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_678b6016f5e4b3439f3dbeea896d8db4.jpg saved to cache
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ebdc753-acc1-580c-a518-60528b221c3e
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16c5e5ad0>
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_d0fb95c831213da3204f02a209cf7d0b.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_d0fb95c831213da3204f02a209cf7d0b.jpg saved to cache
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0139334f-0e15-5fd0-987e-e83e30304e68
2026-03-28 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_a1fa63d31d041d94c50e7dbc08d50ce9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168768110>
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebdc753-acc1-580c-a518-60528b221c3e/6ebdc753-acc1-580c-a518-60528b221c3e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fce%252Fcbce498db4f4b0ae6866d62e8cefc226%252Fpa%252FXJ81708_1910021d4434a2ee32bf917df415c859.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_1910021d4434a2ee32bf917df415c859.jpg saved to cache
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ebdc753-acc1-580c-a518-60528b221c3e
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168611550>
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_81e15887f9f9b84dd0636a108932f890.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_81e15887f9f9b84dd0636a108932f890.jpg saved to cache
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0139334f-0e15-5fd0-987e-e83e30304e68
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1684c6cd0>
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cbd7f2-d94d-5878-82e9-c9504f0b4df5/c7cbd7f2-d94d-5878-82e9-c9504f0b4df5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F54%252F225460a25fd95cf64d11382c7afa8be9%252Fpa%252FDV24306_c5e2c3a16c79af7086da6acdd62263b8.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_c5e2c3a16c79af7086da6acdd62263b8.jpg saved to cache
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7cbd7f2-d94d-5878-82e9-c9504f0b4df5
2026-03-28 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_bd08f891c8f231c16b6f207e64a23ccd.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a117850>
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_f953b3d3c7d929ac63919cc5d23199b7.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_f953b3d3c7d929ac63919cc5d23199b7.jpg saved to cache
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0139334f-0e15-5fd0-987e-e83e30304e68
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a0a2350>
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_d4e2fa2a4dd661d9b608f1e3c2fc8237.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_d4e2fa2a4dd661d9b608f1e3c2fc8237.jpg saved to cache
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0139334f-0e15-5fd0-987e-e83e30304e68
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff168754a10>
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebdc753-acc1-580c-a518-60528b221c3e/6ebdc753-acc1-580c-a518-60528b221c3e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fce%252Fcbce498db4f4b0ae6866d62e8cefc226%252Fpa%252FXJ81708_ae4e747583639be5ac79cd6fd67f3113.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_ae4e747583639be5ac79cd6fd67f3113.jpg saved to cache
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ebdc753-acc1-580c-a518-60528b221c3e
2026-03-28 14:01:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ebdc753-acc1-580c-a518-60528b221c3e, skipping ID generation
2026-03-28 14:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ebdc753-acc1-580c-a518-60528b221c3e with scrape type 1
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ebdc753-acc1-580c-a518-60528b221c3e sending to next pipeline
2026-03-28 14:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6ebdc753-acc1-580c-a518-60528b221c3e, identifier: XJ81708
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a1a1fd0>
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cbd7f2-d94d-5878-82e9-c9504f0b4df5/c7cbd7f2-d94d-5878-82e9-c9504f0b4df5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F54%252F225460a25fd95cf64d11382c7afa8be9%252Fpa%252FDV24306_15a05f062fbf96e50cc6c7b9495de882.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_15a05f062fbf96e50cc6c7b9495de882.jpg saved to cache
2026-03-28 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7cbd7f2-d94d-5878-82e9-c9504f0b4df5
2026-03-28 14:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6ebdc753-acc1-580c-a518-60528b221c3e with identifier: XJ81708
2026-03-28 14:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6ebdc753-acc1-580c-a518-60528b221c3e with identifier: XJ81708
2026-03-28 14:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6ebdc753-acc1-580c-a518-60528b221c3e with identifier: XJ81708 to the API
2026-03-28 14:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_ae4e747583639be5ac79cd6fd67f3113.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:13:56Z',
 'fuel_type': 'diesel',
 'id': '6ebdc753-acc1-580c-a518-60528b221c3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ81708',
 'listing': 'auction',
 'location': 'ES, Ciudad Real',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 245531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebdc753-acc1-580c-a518-60528b221c3e/6ebdc753-acc1-580c-a518-60528b221c3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_b2ddc9c7447d45ea9babe2156464ffc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebdc753-acc1-580c-a518-60528b221c3e/6ebdc753-acc1-580c-a518-60528b221c3e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_93906f594a061d9bad484b8272ca7382.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebdc753-acc1-580c-a518-60528b221c3e/6ebdc753-acc1-580c-a518-60528b221c3e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_24ddbf9b25da14c88a0a3499c7d09ed4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebdc753-acc1-580c-a518-60528b221c3e/6ebdc753-acc1-580c-a518-60528b221c3e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_678b6016f5e4b3439f3dbeea896d8db4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebdc753-acc1-580c-a518-60528b221c3e/6ebdc753-acc1-580c-a518-60528b221c3e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_1910021d4434a2ee32bf917df415c859.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebdc753-acc1-580c-a518-60528b221c3e/6ebdc753-acc1-580c-a518-60528b221c3e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/ce/cbce498db4f4b0ae6866d62e8cefc226/pa/XJ81708_ae4e747583639be5ac79cd6fd67f3113.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Privilege Luxe',
 'transmission': 'manual',
 'trim': 'Privilege Luxe',
 'year': 2004}
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ81708%27 HTTP/1.1" 200 None
2026-03-28 14:01:38 [auto1.es] INFO: Saving data for XJ81708: {'created_time': 1774706498.216606, 'last_price_update_time': 1774706498.216618, 'auction_closing_time': 1774883636.0}
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XJ81708') HTTP/1.1" 204 0
2026-03-28 14:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff16a12ced0>
2026-03-28 14:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cbd7f2-d94d-5878-82e9-c9504f0b4df5/c7cbd7f2-d94d-5878-82e9-c9504f0b4df5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F54%252F225460a25fd95cf64d11382c7afa8be9%252Fpa%252FDV24306_a1fa63d31d041d94c50e7dbc08d50ce9.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_a1fa63d31d041d94c50e7dbc08d50ce9.jpg saved to cache
2026-03-28 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7cbd7f2-d94d-5878-82e9-c9504f0b4df5
2026-03-28 14:01:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7cbd7f2-d94d-5878-82e9-c9504f0b4df5, skipping ID generation
2026-03-28 14:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7cbd7f2-d94d-5878-82e9-c9504f0b4df5 with scrape type 1
2026-03-28 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7cbd7f2-d94d-5878-82e9-c9504f0b4df5 sending to next pipeline
2026-03-28 14:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c7cbd7f2-d94d-5878-82e9-c9504f0b4df5, identifier: DV24306
2026-03-28 14:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c7cbd7f2-d94d-5878-82e9-c9504f0b4df5 with identifier: DV24306
2026-03-28 14:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c7cbd7f2-d94d-5878-82e9-c9504f0b4df5 with identifier: DV24306
2026-03-28 14:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c7cbd7f2-d94d-5878-82e9-c9504f0b4df5 with identifier: DV24306 to the API
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_a1fa63d31d041d94c50e7dbc08d50ce9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:19:56Z',
 'fuel_type': 'diesel',
 'id': 'c7cbd7f2-d94d-5878-82e9-c9504f0b4df5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV24306',
 'listing': 'auction',
 'location': 'ES, Pamplona',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 293424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cbd7f2-d94d-5878-82e9-c9504f0b4df5/c7cbd7f2-d94d-5878-82e9-c9504f0b4df5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_fca54b0b258a2e552b17710252d9e2fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cbd7f2-d94d-5878-82e9-c9504f0b4df5/c7cbd7f2-d94d-5878-82e9-c9504f0b4df5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_31c026f7e05abdfb4b230ee6921c677d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cbd7f2-d94d-5878-82e9-c9504f0b4df5/c7cbd7f2-d94d-5878-82e9-c9504f0b4df5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_d42d2fbc4f82aff46addeb7685e7c6c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cbd7f2-d94d-5878-82e9-c9504f0b4df5/c7cbd7f2-d94d-5878-82e9-c9504f0b4df5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_c5e2c3a16c79af7086da6acdd62263b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cbd7f2-d94d-5878-82e9-c9504f0b4df5/c7cbd7f2-d94d-5878-82e9-c9504f0b4df5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_15a05f062fbf96e50cc6c7b9495de882.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cbd7f2-d94d-5878-82e9-c9504f0b4df5/c7cbd7f2-d94d-5878-82e9-c9504f0b4df5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/54/225460a25fd95cf64d11382c7afa8be9/pa/DV24306_a1fa63d31d041d94c50e7dbc08d50ce9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 CRDi Concept",
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2012}
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV24306%27 HTTP/1.1" 200 None
2026-03-28 14:01:38 [auto1.es] INFO: Saving data for DV24306: {'created_time': 1774706498.731071, 'last_price_update_time': 1774706498.731085, 'auction_closing_time': 1774883996.0}
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DV24306') HTTP/1.1" 204 0
2026-03-28 14:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff1686f68d0>
2026-03-28 14:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F81%252Fc3814394b3061751d45b791e736cd5c8%252Fpa%252FUF54007_bd08f891c8f231c16b6f207e64a23ccd.jpg') HTTP/1.1" 204 0
2026-03-28 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_bd08f891c8f231c16b6f207e64a23ccd.jpg saved to cache
2026-03-28 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0139334f-0e15-5fd0-987e-e83e30304e68
2026-03-28 14:01:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0139334f-0e15-5fd0-987e-e83e30304e68, skipping ID generation
2026-03-28 14:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0139334f-0e15-5fd0-987e-e83e30304e68 with scrape type 1
2026-03-28 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0139334f-0e15-5fd0-987e-e83e30304e68 sending to next pipeline
2026-03-28 14:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0139334f-0e15-5fd0-987e-e83e30304e68, identifier: UF54007
2026-03-28 14:01:38 [auto1.es] INFO: Channel: 24h | Page: 10 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP71209> (referer: https://www.auto1.com/v1/car-details-view/XP71209/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0139334f-0e15-5fd0-987e-e83e30304e68 with identifier: UF54007
2026-03-28 14:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0139334f-0e15-5fd0-987e-e83e30304e68 with identifier: UF54007
2026-03-28 14:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0139334f-0e15-5fd0-987e-e83e30304e68 with identifier: UF54007 to the API
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_bd08f891c8f231c16b6f207e64a23ccd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:51:17Z',
 'fuel_type': 'petrol',
 'id': '0139334f-0e15-5fd0-987e-e83e30304e68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF54007',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 88257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_01f5214be512d4af5a9de9a8575ba362.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_01010b6fa451e6594fd37cb22102e4b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_cbf67d1d3ba6a86a23bd9c43b2e4cdd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_95fe9f060e17b79076034c98b5dd824b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_b206e5437bd704d84cc55f03f86fbe42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_d0fb95c831213da3204f02a209cf7d0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_81e15887f9f9b84dd0636a108932f890.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_f953b3d3c7d929ac63919cc5d23199b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_d4e2fa2a4dd661d9b608f1e3c2fc8237.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0139334f-0e15-5fd0-987e-e83e30304e68/0139334f-0e15-5fd0-987e-e83e30304e68_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/81/c3814394b3061751d45b791e736cd5c8/pa/UF54007_bd08f891c8f231c16b6f207e64a23ccd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2020}
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF54007%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Saving data for UF54007: {'created_time': 1774706499.30404, 'last_price_update_time': 1774706499.304049, 'auction_closing_time': 1774885877.0}
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UF54007') HTTP/1.1" 204 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: JG48293
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: HY05176
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: HS16783
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS16783%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for HS16783: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: GU63395
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: GG14242
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG14242%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for GG14242: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: FF03006
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: FE10852
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE10852%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for FE10852: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: FD45689
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD45689%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for FD45689: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: ZC89924
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: EB04007
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB04007%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for EB04007: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: GG25367
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: DP25407
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP25407%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for DP25407: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: DK84530
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: DA34645
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA34645%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for DA34645: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: CY99272
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY99272%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for CY99272: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: CJ82848
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ82848%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for CJ82848: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: CC07404
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: ET28977
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: BZ61067
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ61067%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for BZ61067: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: BP46886
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP46886%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for BP46886: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: BJ99702
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: BE81339
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: AZ69629
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ69629%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for AZ69629: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: AU19829
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU19829%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for AU19829: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: XB68205
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB68205%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for XB68205: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: FG81447
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: VV50506
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: VV40051
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV40051%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for VV40051: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: NZ10183
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: EY94585
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: ZM37392
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: YV41467
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: VZ90970
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ90970%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for VZ90970: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: MR39300
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR39300%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for MR39300: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: JR92140
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR92140%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for JR92140: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: HK98944
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: HD07972
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD07972%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for HD07972: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: GX01105
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX01105%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [auto1.es] INFO: Scrape type for GX01105: 0
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: CW13778
2026-03-28 14:01:39 [auto1.es] INFO: Found listing with ID: VG01013
2026-03-28 14:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4af68fae-05b0-5fa6-adf0-75a4b2821d7e with identifier: XP71209
2026-03-28 14:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4af68fae-05b0-5fa6-adf0-75a4b2821d7e with scrape type 1
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4af68fae-05b0-5fa6-adf0-75a4b2821d7e
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Faa%252Fd2aa98a37465aa6c5050bc0175266169%252Fpa%252FXP71209_37be78985102233a99dfd23455cd1bca.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_37be78985102233a99dfd23455cd1bca.jpg already downloaded
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Faa%252Fd2aa98a37465aa6c5050bc0175266169%252Fpa%252FXP71209_10801a3ec3b8cde5e1d32d70ad595bac.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_10801a3ec3b8cde5e1d32d70ad595bac.jpg already downloaded
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Faa%252Fd2aa98a37465aa6c5050bc0175266169%252Fpa%252FXP71209_494c9b7c8cce53a1c1c85d83d9426e77.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_494c9b7c8cce53a1c1c85d83d9426e77.jpg already downloaded
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Faa%252Fd2aa98a37465aa6c5050bc0175266169%252Fpa%252FXP71209_56802b579ee40c2317d5137f34699465.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_56802b579ee40c2317d5137f34699465.jpg already downloaded
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Faa%252Fd2aa98a37465aa6c5050bc0175266169%252Fpa%252FXP71209_b170a372b08cbd2af2e96ab7203f61f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_b170a372b08cbd2af2e96ab7203f61f6.jpg already downloaded
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Faa%252Fd2aa98a37465aa6c5050bc0175266169%252Fpa%252FXP71209_021e0ab652ffa4fe69c4cc9dc694954e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_021e0ab652ffa4fe69c4cc9dc694954e.jpg already downloaded
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Faa%252Fd2aa98a37465aa6c5050bc0175266169%252Fpa%252FXP71209_49836885c7a3559e9bd09bf2f628d158.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_49836885c7a3559e9bd09bf2f628d158.jpg already downloaded
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Faa%252Fd2aa98a37465aa6c5050bc0175266169%252Fpa%252FXP71209_e9879dbed91af608bf6f5d0625f45cd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_e9879dbed91af608bf6f5d0625f45cd2.jpg already downloaded
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Faa%252Fd2aa98a37465aa6c5050bc0175266169%252Fpa%252FXP71209_e24b8e15f21945516a58052e731a2ada.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_e24b8e15f21945516a58052e731a2ada.jpg already downloaded
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252Faa%252Fd2aa98a37465aa6c5050bc0175266169%252Fpa%252FXP71209_0f549d024469bd9134d301f558d38f2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_0f549d024469bd9134d301f558d38f2c.jpg already downloaded
2026-03-28 14:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4af68fae-05b0-5fa6-adf0-75a4b2821d7e, identifier: XP71209
2026-03-28 14:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4af68fae-05b0-5fa6-adf0-75a4b2821d7e with identifier: XP71209
2026-03-28 14:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4af68fae-05b0-5fa6-adf0-75a4b2821d7e with identifier: XP71209
2026-03-28 14:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4af68fae-05b0-5fa6-adf0-75a4b2821d7e with identifier: XP71209 to the API
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XP71209>
{'auction_title': '',
 'c_o_2_emission_value': 226,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '4.0L',
 'engine_horse_power': 420,
 'expiration_date': '2026-03-30T15:03:49Z',
 'fuel_type': 'petrol',
 'id': '4af68fae-05b0-5fa6-adf0-75a4b2821d7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP71209',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 117342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_37be78985102233a99dfd23455cd1bca.jpg',
                'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_10801a3ec3b8cde5e1d32d70ad595bac.jpg',
                'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_494c9b7c8cce53a1c1c85d83d9426e77.jpg',
                'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_56802b579ee40c2317d5137f34699465.jpg',
                'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_b170a372b08cbd2af2e96ab7203f61f6.jpg',
                'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_021e0ab652ffa4fe69c4cc9dc694954e.jpg',
                'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_49836885c7a3559e9bd09bf2f628d158.jpg',
                'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_e9879dbed91af608bf6f5d0625f45cd2.jpg',
                'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_e24b8e15f21945516a58052e731a2ada.jpg',
                'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_0f549d024469bd9134d301f558d38f2c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af68fae-05b0-5fa6-adf0-75a4b2821d7e/4af68fae-05b0-5fa6-adf0-75a4b2821d7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_37be78985102233a99dfd23455cd1bca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af68fae-05b0-5fa6-adf0-75a4b2821d7e/4af68fae-05b0-5fa6-adf0-75a4b2821d7e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_10801a3ec3b8cde5e1d32d70ad595bac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af68fae-05b0-5fa6-adf0-75a4b2821d7e/4af68fae-05b0-5fa6-adf0-75a4b2821d7e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_494c9b7c8cce53a1c1c85d83d9426e77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af68fae-05b0-5fa6-adf0-75a4b2821d7e/4af68fae-05b0-5fa6-adf0-75a4b2821d7e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_56802b579ee40c2317d5137f34699465.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af68fae-05b0-5fa6-adf0-75a4b2821d7e/4af68fae-05b0-5fa6-adf0-75a4b2821d7e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_b170a372b08cbd2af2e96ab7203f61f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af68fae-05b0-5fa6-adf0-75a4b2821d7e/4af68fae-05b0-5fa6-adf0-75a4b2821d7e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_021e0ab652ffa4fe69c4cc9dc694954e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af68fae-05b0-5fa6-adf0-75a4b2821d7e/4af68fae-05b0-5fa6-adf0-75a4b2821d7e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_49836885c7a3559e9bd09bf2f628d158.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af68fae-05b0-5fa6-adf0-75a4b2821d7e/4af68fae-05b0-5fa6-adf0-75a4b2821d7e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_e9879dbed91af608bf6f5d0625f45cd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af68fae-05b0-5fa6-adf0-75a4b2821d7e/4af68fae-05b0-5fa6-adf0-75a4b2821d7e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_e24b8e15f21945516a58052e731a2ada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af68fae-05b0-5fa6-adf0-75a4b2821d7e/4af68fae-05b0-5fa6-adf0-75a4b2821d7e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/aa/d2aa98a37465aa6c5050bc0175266169/pa/XP71209_0f549d024469bd9134d301f558d38f2c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi S6 4.0 V8 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP71209%27 HTTP/1.1" 200 None
2026-03-28 14:01:40 [auto1.es] INFO: Saving data for XP71209: {'created_time': 1774706500.32145, 'last_price_update_time': 1774706500.321458, 'auction_closing_time': 1774883029.0}
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XP71209') HTTP/1.1" 204 0
2026-03-28 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:41 [auto1.es] INFO: Channel: 24h | Page: 11 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: MB17982
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: FK59567
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: UP38742
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: EP70954
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: CR30335
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR30335%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for CR30335: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: WJ83814
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: XW01779
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW01779%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for XW01779: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: LA45475
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA45475%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for LA45475: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: KU66562
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU66562%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for KU66562: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: RU59463
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: DG65204
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG65204%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for DG65204: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: BA49361
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA49361%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for BA49361: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: ZY46738
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY46738%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for ZY46738: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: JZ17995
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ17995%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for JZ17995: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: YW58225
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW58225%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for YW58225: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: ND95475
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: FJ32938
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: LZ97772
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: NW02170
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: TW11063
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW11063%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for TW11063: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: BR53004
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: TD39535
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD39535%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for TD39535: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: AS54337
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: CV75612
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: TR12651
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: XS66014
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: RP64804
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP64804%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for RP64804: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: SZ95909
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: LW26471
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW26471%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for LW26471: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: HJ68220
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: ZZ18743
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: UF55082
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF55082%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for UF55082: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: RP55294
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP55294%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for RP55294: 0
2026-03-28 14:01:41 [auto1.es] INFO: Found listing with ID: ZR84162
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR84162%27 HTTP/1.1" 200 None
2026-03-28 14:01:41 [auto1.es] INFO: Scrape type for ZR84162: 2
2026-03-28 14:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24034835-59bc-520f-a412-4ba51f4aa468 with identifier: ZR84162
2026-03-28 14:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24034835-59bc-520f-a412-4ba51f4aa468 with scrape type 2
2026-03-28 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24034835-59bc-520f-a412-4ba51f4aa468 with scrape type 2
2026-03-28 14:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 24034835-59bc-520f-a412-4ba51f4aa468, identifier: ZR84162
2026-03-28 14:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 24034835-59bc-520f-a412-4ba51f4aa468 with identifier: ZR84162
2026-03-28 14:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 24034835-59bc-520f-a412-4ba51f4aa468 with identifier: ZR84162
2026-03-28 14:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 24034835-59bc-520f-a412-4ba51f4aa468 with identifier: ZR84162 to the API
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:39Z',
 'fuel_type': 'diesel',
 'id': '24034835-59bc-520f-a412-4ba51f4aa468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR84162',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 251021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-17',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 HDi Sport Pack',
 'transmission': 'manual',
 'trim': 'Sport Pack',
 'year': 2011}
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR84162%27 HTTP/1.1" 200 None
2026-03-28 14:01:42 [auto1.es] INFO: Saving data for ZR84162: {'auction_closing_time': 1774714539.0, 'created_time': 1773900240.400958, 'last_price_update_time': 1774706502.074355}
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZR84162') HTTP/1.1" 204 0
2026-03-28 14:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:42 [auto1.es] INFO: Found listing with ID: YG81758
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG81758%27 HTTP/1.1" 200 None
2026-03-28 14:01:42 [auto1.es] INFO: Scrape type for YG81758: 0
2026-03-28 14:01:42 [auto1.es] INFO: Found listing with ID: XZ87449
2026-03-28 14:01:42 [auto1.es] INFO: Found listing with ID: VL98218
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL98218%27 HTTP/1.1" 200 None
2026-03-28 14:01:42 [auto1.es] INFO: Scrape type for VL98218: 2
2026-03-28 14:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e81e74d9-00a2-5946-80bd-bc3b55a4e872 with identifier: VL98218
2026-03-28 14:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e81e74d9-00a2-5946-80bd-bc3b55a4e872 with scrape type 2
2026-03-28 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e81e74d9-00a2-5946-80bd-bc3b55a4e872 with scrape type 2
2026-03-28 14:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e81e74d9-00a2-5946-80bd-bc3b55a4e872, identifier: VL98218
2026-03-28 14:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e81e74d9-00a2-5946-80bd-bc3b55a4e872 with identifier: VL98218
2026-03-28 14:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e81e74d9-00a2-5946-80bd-bc3b55a4e872 with identifier: VL98218
2026-03-28 14:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e81e74d9-00a2-5946-80bd-bc3b55a4e872 with identifier: VL98218 to the API
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:25Z',
 'fuel_type': 'diesel',
 'id': 'e81e74d9-00a2-5946-80bd-bc3b55a4e872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL98218',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 103114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-09',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2017}
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL98218%27 HTTP/1.1" 200 None
2026-03-28 14:01:42 [auto1.es] INFO: Saving data for VL98218: {'auction_closing_time': 1774713805.0, 'created_time': 1774296068.656179, 'last_price_update_time': 1774706502.730233}
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VL98218') HTTP/1.1" 204 0
2026-03-28 14:01:42 [auto1.es] INFO: Found listing with ID: PF61621
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF61621%27 HTTP/1.1" 200 None
2026-03-28 14:01:42 [auto1.es] INFO: Scrape type for PF61621: 0
2026-03-28 14:01:42 [auto1.es] INFO: Found listing with ID: BE62587
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE62587%27 HTTP/1.1" 200 None
2026-03-28 14:01:42 [auto1.es] INFO: Scrape type for BE62587: 0
2026-03-28 14:01:42 [auto1.es] INFO: Found listing with ID: SN94812
2026-03-28 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:43 [auto1.es] INFO: Channel: 24h | Page: 12 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:43 [auto1.es] INFO: Found listing with ID: TS75802
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS75802%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [auto1.es] INFO: Scrape type for TS75802: 0
2026-03-28 14:01:43 [auto1.es] INFO: Found listing with ID: TE16269
2026-03-28 14:01:43 [auto1.es] INFO: Found listing with ID: VH11492
2026-03-28 14:01:43 [auto1.es] INFO: Found listing with ID: XT74556
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT74556%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [auto1.es] INFO: Scrape type for XT74556: 0
2026-03-28 14:01:43 [auto1.es] INFO: Found listing with ID: RK33204
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK33204%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [auto1.es] INFO: Scrape type for RK33204: 0
2026-03-28 14:01:43 [auto1.es] INFO: Found listing with ID: HU25614
2026-03-28 14:01:43 [auto1.es] INFO: Found listing with ID: FC36055
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC36055%27 HTTP/1.1" 200 None
2026-03-28 14:01:43 [auto1.es] INFO: Scrape type for FC36055: 2
2026-03-28 14:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af4df1bf-cd82-5336-a359-4026935d256e with identifier: FC36055
2026-03-28 14:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af4df1bf-cd82-5336-a359-4026935d256e with scrape type 2
2026-03-28 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af4df1bf-cd82-5336-a359-4026935d256e with scrape type 2
2026-03-28 14:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af4df1bf-cd82-5336-a359-4026935d256e, identifier: FC36055
2026-03-28 14:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af4df1bf-cd82-5336-a359-4026935d256e with identifier: FC36055
2026-03-28 14:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af4df1bf-cd82-5336-a359-4026935d256e with identifier: FC36055
2026-03-28 14:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af4df1bf-cd82-5336-a359-4026935d256e with identifier: FC36055 to the API
2026-03-28 14:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:17Z',
 'fuel_type': 'petrol',
 'id': 'af4df1bf-cd82-5336-a359-4026935d256e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC36055',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 102858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-30',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC36055%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Saving data for FC36055: {'auction_closing_time': 1774716377.0, 'created_time': 1774522827.558714, 'last_price_update_time': 1774706504.143838}
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FC36055') HTTP/1.1" 204 0
2026-03-28 14:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: UV92160
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: JX70017
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX70017%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for JX70017: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: ES45064
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: WH26152
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH26152%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for WH26152: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: NF35716
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: VU00284
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU00284%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for VU00284: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: BL83097
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: UB71741
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB71741%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for UB71741: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: KK78857
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK78857%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for KK78857: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: MW97614
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW97614%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for MW97614: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: YS92814
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: SN05978
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN05978%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for SN05978: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: AX08596
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: XC60196
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: ZG18454
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: JD79732
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JD79732%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for JD79732: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: ED57476
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED57476%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for ED57476: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: DK89612
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: WW09022
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: GC12859
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: KF74515
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF74515%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for KF74515: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: EE62782
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: YT10361
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: MZ62170
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: XE30764
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE30764%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for XE30764: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: SB32545
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB32545%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for SB32545: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: DT02195
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT02195%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for DT02195: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: RH33829
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH33829%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for RH33829: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: RC06010
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC06010%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for RC06010: 0
2026-03-28 14:01:44 [auto1.es] INFO: Found listing with ID: HA27882
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA27882%27 HTTP/1.1" 200 None
2026-03-28 14:01:44 [auto1.es] INFO: Scrape type for HA27882: 2
2026-03-28 14:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 914e1aba-0e9d-5acc-a1ef-f52f3ff8b29f with identifier: HA27882
2026-03-28 14:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 914e1aba-0e9d-5acc-a1ef-f52f3ff8b29f with scrape type 2
2026-03-28 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 914e1aba-0e9d-5acc-a1ef-f52f3ff8b29f with scrape type 2
2026-03-28 14:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 914e1aba-0e9d-5acc-a1ef-f52f3ff8b29f, identifier: HA27882
2026-03-28 14:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 914e1aba-0e9d-5acc-a1ef-f52f3ff8b29f with identifier: HA27882
2026-03-28 14:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 914e1aba-0e9d-5acc-a1ef-f52f3ff8b29f with identifier: HA27882
2026-03-28 14:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 914e1aba-0e9d-5acc-a1ef-f52f3ff8b29f with identifier: HA27882 to the API
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 109,
 'expiration_date': '2026-03-28T16:24:18Z',
 'fuel_type': 'gas',
 'id': '914e1aba-0e9d-5acc-a1ef-f52f3ff8b29f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA27882',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 144264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seller_name': None,
 'title': 'Dacia Dokker 1.6 SCe Benzin / LPG Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2021}
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA27882%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [auto1.es] INFO: Saving data for HA27882: {'auction_closing_time': 1774715058.0, 'created_time': 1774296328.575634, 'last_price_update_time': 1774706505.012379}
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HA27882') HTTP/1.1" 204 0
2026-03-28 14:01:45 [auto1.es] INFO: Found listing with ID: HU12913
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU12913%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [auto1.es] INFO: Scrape type for HU12913: 0
2026-03-28 14:01:45 [auto1.es] INFO: Found listing with ID: ZN02005
2026-03-28 14:01:45 [auto1.es] INFO: Found listing with ID: FG15461
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG15461%27 HTTP/1.1" 200 None
2026-03-28 14:01:45 [auto1.es] INFO: Scrape type for FG15461: 0
2026-03-28 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:46 [auto1.es] INFO: Channel: 24h | Page: 13 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: CK76032
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CK76032%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for CK76032: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: MN42055
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN42055%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for MN42055: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: UD00521
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD00521%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for UD00521: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: AJ03756
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: YY10601
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY10601%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for YY10601: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: SN13846
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN13846%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for SN13846: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: UZ91236
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ91236%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for UZ91236: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: GB32148
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: SJ07079
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: HR31272
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR31272%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for HR31272: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: JK63504
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK63504%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for JK63504: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: DE75422
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE75422%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for DE75422: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: GJ16527
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ16527%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for GJ16527: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: RN59573
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: MS33551
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: ZX65175
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX65175%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for ZX65175: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: DW68520
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: JM60139
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: HA89182
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: CB84377
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB84377%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for CB84377: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: CV84892
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV84892%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for CV84892: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: XW18745
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW18745%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for XW18745: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: ZS64271
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: XF30199
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: FD66244
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: FT05886
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT05886%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for FT05886: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: PX41006
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX41006%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for PX41006: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: EK90431
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK90431%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for EK90431: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: XH71672
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: GF68019
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF68019%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for GF68019: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: CV42772
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV42772%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for CV42772: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: KK76277
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK76277%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for KK76277: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: MJ67844
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: YK01379
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK01379%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for YK01379: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: YC35747
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC35747%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for YC35747: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: VU50837
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU50837%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for VU50837: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: TF90504
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: SE93661
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE93661%27 HTTP/1.1" 200 None
2026-03-28 14:01:46 [auto1.es] INFO: Scrape type for SE93661: 0
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: GH75768
2026-03-28 14:01:46 [auto1.es] INFO: Found listing with ID: CT45338
2026-03-28 14:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:49 [auto1.es] INFO: Channel: 24h | Page: 14 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: ZZ88385
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: MJ28673
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ28673%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for MJ28673: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: VL89620
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL89620%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for VL89620: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: XU17862
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU17862%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for XU17862: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: BF43819
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF43819%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for BF43819: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: KB84639
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: KK74689
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: HL23580
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL23580%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for HL23580: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: FZ71320
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: JV15285
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JV15285%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for JV15285: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: GJ99683
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ99683%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for GJ99683: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: YZ57313
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: HA25095
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: LG37212
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG37212%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for LG37212: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: YK71465
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: NJ00425
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ00425%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for NJ00425: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: HZ04358
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ04358%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for HZ04358: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: NR06015
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR06015%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for NR06015: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: NB92875
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: JR86606
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR86606%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for JR86606: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: XU82709
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: ME40836
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME40836%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for ME40836: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: PL46605
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL46605%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for PL46605: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: KS53137
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS53137%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for KS53137: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: VY63133
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: LU70143
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: CR84391
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR84391%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for CR84391: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: TR46498
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR46498%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for TR46498: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: AZ98699
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: RE19681
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: CG55928
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG55928%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for CG55928: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: DC47971
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: ZZ18199
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: LW73612
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: MT83706
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: FT39942
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT39942%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for FT39942: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: TL79249
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL79249%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for TL79249: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: NW09077
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: MD28950
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD28950%27 HTTP/1.1" 200 None
2026-03-28 14:01:49 [auto1.es] INFO: Scrape type for MD28950: 0
2026-03-28 14:01:49 [auto1.es] INFO: Found listing with ID: XN80961
2026-03-28 14:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:50 [auto1.es] INFO: Channel: 24h | Page: 15 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:50 [auto1.es] INFO: Found listing with ID: YT02265
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT02265%27 HTTP/1.1" 200 None
2026-03-28 14:01:50 [auto1.es] INFO: Scrape type for YT02265: 0
2026-03-28 14:01:50 [auto1.es] INFO: Found listing with ID: PU95944
2026-03-28 14:01:50 [auto1.es] INFO: Found listing with ID: BD22709
2026-03-28 14:01:50 [auto1.es] INFO: Found listing with ID: BK80752
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK80752%27 HTTP/1.1" 200 None
2026-03-28 14:01:50 [auto1.es] INFO: Scrape type for BK80752: 0
2026-03-28 14:01:50 [auto1.es] INFO: Found listing with ID: JE80773
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE80773%27 HTTP/1.1" 200 None
2026-03-28 14:01:50 [auto1.es] INFO: Scrape type for JE80773: 0
2026-03-28 14:01:50 [auto1.es] INFO: Found listing with ID: TT52004
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT52004%27 HTTP/1.1" 200 None
2026-03-28 14:01:50 [auto1.es] INFO: Scrape type for TT52004: 2
2026-03-28 14:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50866e84-e8bf-55bd-a4f1-1f0d5e247767 with identifier: TT52004
2026-03-28 14:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50866e84-e8bf-55bd-a4f1-1f0d5e247767 with scrape type 2
2026-03-28 14:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50866e84-e8bf-55bd-a4f1-1f0d5e247767 with scrape type 2
2026-03-28 14:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50866e84-e8bf-55bd-a4f1-1f0d5e247767, identifier: TT52004
2026-03-28 14:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50866e84-e8bf-55bd-a4f1-1f0d5e247767 with identifier: TT52004
2026-03-28 14:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50866e84-e8bf-55bd-a4f1-1f0d5e247767 with identifier: TT52004
2026-03-28 14:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 50866e84-e8bf-55bd-a4f1-1f0d5e247767 with identifier: TT52004 to the API
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:57:21Z',
 'fuel_type': 'diesel',
 'id': '50866e84-e8bf-55bd-a4f1-1f0d5e247767',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT52004',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 145497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-22',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style Copa',
 'transmission': 'manual',
 'trim': 'Style Copa',
 'year': 2011}
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT52004%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Saving data for TT52004: {'auction_closing_time': 1774717041.0, 'created_time': 1774522880.249056, 'last_price_update_time': 1774706511.249707}
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TT52004') HTTP/1.1" 204 0
2026-03-28 14:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: GW48537
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW48537%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for GW48537: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: KL24436
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL24436%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for KL24436: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: JP19432
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP19432%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for JP19432: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: XG96311
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: TV58646
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV58646%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for TV58646: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: CS77743
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: RW68168
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: KM60868
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: DL91172
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL91172%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for DL91172: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: NY08728
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY08728%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for NY08728: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: CH99472
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH99472%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for CH99472: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: AS02547
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS02547%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for AS02547: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: FZ98481
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: YK45669
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: EM05471
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: PM27944
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM27944%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for PM27944: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: NA38669
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: EJ11744
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ11744%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for EJ11744: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: EE23918
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE23918%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for EE23918: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: LL51979
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: EW80297
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: YL07915
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: DD22164
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD22164%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for DD22164: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: GV40212
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV40212%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for GV40212: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: TV69131
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: AR64085
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR64085%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for AR64085: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: HS39015
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS39015%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for HS39015: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: UA50937
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA50937%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for UA50937: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: VF83817
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: VY65813
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY65813%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for VY65813: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: LS09862
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: WH92663
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH92663%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for WH92663: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: ZZ49032
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ49032%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for ZZ49032: 0
2026-03-28 14:01:51 [auto1.es] INFO: Found listing with ID: FL34452
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL34452%27 HTTP/1.1" 200 None
2026-03-28 14:01:51 [auto1.es] INFO: Scrape type for FL34452: 0
2026-03-28 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:52 [auto1.es] INFO: Channel: 24h | Page: 16 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: DS30814
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS30814%27 HTTP/1.1" 200 None
2026-03-28 14:01:52 [auto1.es] INFO: Scrape type for DS30814: 0
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: WB36611
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB36611%27 HTTP/1.1" 200 None
2026-03-28 14:01:52 [auto1.es] INFO: Scrape type for WB36611: 0
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: RY26799
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: FC07978
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC07978%27 HTTP/1.1" 200 None
2026-03-28 14:01:52 [auto1.es] INFO: Scrape type for FC07978: 0
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: UB97521
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: KY65056
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: SJ54538
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ54538%27 HTTP/1.1" 200 None
2026-03-28 14:01:52 [auto1.es] INFO: Scrape type for SJ54538: 0
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: BG90226
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: GZ75005
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ75005%27 HTTP/1.1" 200 None
2026-03-28 14:01:52 [auto1.es] INFO: Scrape type for GZ75005: 0
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: BN23460
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: NW38370
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: AV31208
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: MR84623
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: BK60003
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK60003%27 HTTP/1.1" 200 None
2026-03-28 14:01:52 [auto1.es] INFO: Scrape type for BK60003: 0
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: JP53710
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP53710%27 HTTP/1.1" 200 None
2026-03-28 14:01:52 [auto1.es] INFO: Scrape type for JP53710: 0
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: LZ41727
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: ZK36200
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: LV38775
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: ZM37153
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: DJ31563
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ31563%27 HTTP/1.1" 200 None
2026-03-28 14:01:52 [auto1.es] INFO: Scrape type for DJ31563: 0
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: KN17188
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: CD82527
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: EX33598
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX33598%27 HTTP/1.1" 200 None
2026-03-28 14:01:52 [auto1.es] INFO: Scrape type for EX33598: 0
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: MN90156
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: FN32638
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: ZR72253
2026-03-28 14:01:52 [auto1.es] INFO: Found listing with ID: ZD67493
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD67493%27 HTTP/1.1" 200 None
2026-03-28 14:01:52 [auto1.es] INFO: Scrape type for ZD67493: 2
2026-03-28 14:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4c339e0-327b-516e-82e9-e9a88a03abf9 with identifier: ZD67493
2026-03-28 14:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4c339e0-327b-516e-82e9-e9a88a03abf9 with scrape type 2
2026-03-28 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4c339e0-327b-516e-82e9-e9a88a03abf9 with scrape type 2
2026-03-28 14:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c4c339e0-327b-516e-82e9-e9a88a03abf9, identifier: ZD67493
2026-03-28 14:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c4c339e0-327b-516e-82e9-e9a88a03abf9 with identifier: ZD67493
2026-03-28 14:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c4c339e0-327b-516e-82e9-e9a88a03abf9 with identifier: ZD67493
2026-03-28 14:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c4c339e0-327b-516e-82e9-e9a88a03abf9 with identifier: ZD67493 to the API
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:59:12Z',
 'fuel_type': 'diesel',
 'id': 'c4c339e0-327b-516e-82e9-e9a88a03abf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD67493',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 131841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Kombi BlueMotion',
 'transmission': 'manual',
 'trim': 'Kombi BlueMotion',
 'year': 2019}
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD67493%27 HTTP/1.1" 200 None
2026-03-28 14:01:53 [auto1.es] INFO: Saving data for ZD67493: {'auction_closing_time': 1774717152.0, 'created_time': 1774522889.622869, 'last_price_update_time': 1774706513.361114}
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZD67493') HTTP/1.1" 204 0
2026-03-28 14:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:53 [auto1.es] INFO: Found listing with ID: AS98814
2026-03-28 14:01:53 [auto1.es] INFO: Found listing with ID: BK97783
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK97783%27 HTTP/1.1" 200 None
2026-03-28 14:01:53 [auto1.es] INFO: Scrape type for BK97783: 0
2026-03-28 14:01:53 [auto1.es] INFO: Found listing with ID: KK12600
2026-03-28 14:01:53 [auto1.es] INFO: Found listing with ID: JG89903
2026-03-28 14:01:53 [auto1.es] INFO: Found listing with ID: PK49923
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK49923%27 HTTP/1.1" 200 None
2026-03-28 14:01:53 [auto1.es] INFO: Scrape type for PK49923: 0
2026-03-28 14:01:53 [auto1.es] INFO: Found listing with ID: LM83979
2026-03-28 14:01:53 [auto1.es] INFO: Found listing with ID: GK87335
2026-03-28 14:01:53 [auto1.es] INFO: Found listing with ID: HV65502
2026-03-28 14:01:53 [auto1.es] INFO: Found listing with ID: EM52584
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM52584%27 HTTP/1.1" 200 None
2026-03-28 14:01:53 [auto1.es] INFO: Scrape type for EM52584: 0
2026-03-28 14:01:53 [auto1.es] INFO: Found listing with ID: WV15930
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV15930%27 HTTP/1.1" 200 None
2026-03-28 14:01:53 [auto1.es] INFO: Scrape type for WV15930: 2
2026-03-28 14:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16be78e2-7288-546a-9daa-07a134d03947 with identifier: WV15930
2026-03-28 14:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16be78e2-7288-546a-9daa-07a134d03947 with scrape type 2
2026-03-28 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16be78e2-7288-546a-9daa-07a134d03947 with scrape type 2
2026-03-28 14:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 16be78e2-7288-546a-9daa-07a134d03947, identifier: WV15930
2026-03-28 14:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 16be78e2-7288-546a-9daa-07a134d03947 with identifier: WV15930
2026-03-28 14:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 16be78e2-7288-546a-9daa-07a134d03947 with identifier: WV15930
2026-03-28 14:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 16be78e2-7288-546a-9daa-07a134d03947 with identifier: WV15930 to the API
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:02:33Z',
 'fuel_type': 'petrol',
 'id': '16be78e2-7288-546a-9daa-07a134d03947',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV15930',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 173208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-26',
 'seller_name': None,
 'title': 'Renault Megane 1.2 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2014}
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV15930%27 HTTP/1.1" 200 None
2026-03-28 14:01:53 [auto1.es] INFO: Saving data for WV15930: {'auction_closing_time': 1774713753.0, 'created_time': 1773900745.46718, 'last_price_update_time': 1774706513.952413}
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WV15930') HTTP/1.1" 204 0
2026-03-28 14:01:53 [auto1.es] INFO: Found listing with ID: RJ73355
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ73355%27 HTTP/1.1" 200 None
2026-03-28 14:01:53 [auto1.es] INFO: Scrape type for RJ73355: 0
2026-03-28 14:01:53 [auto1.es] INFO: Found listing with ID: MX84470
2026-03-28 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX84470%27 HTTP/1.1" 200 None
2026-03-28 14:01:54 [auto1.es] INFO: Scrape type for MX84470: 0
2026-03-28 14:01:54 [auto1.es] INFO: Found listing with ID: JL97970
2026-03-28 14:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:55 [auto1.es] INFO: Channel: 24h | Page: 17 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: ZM34932
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: TR33339
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: WJ21268
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ21268%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for WJ21268: 0
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: HC75906
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC75906%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for HC75906: 0
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: FW26627
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: WZ74914
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: BY70112
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY70112%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for BY70112: 0
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: TV99660
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV99660%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for TV99660: 0
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: UF76170
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: GU11117
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: XE21936
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: XS40822
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: AN90905
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: AF12628
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF12628%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for AF12628: 0
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: RE01246
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: SP11103
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: ME86804
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: WC91216
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: DL38940
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL38940%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for DL38940: 0
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: EE29510
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: ED08036
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED08036%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for ED08036: 0
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: SZ63462
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ63462%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for SZ63462: 2
2026-03-28 14:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09e9a3bd-3d18-5d60-92b9-b8b9ec9aa403 with identifier: SZ63462
2026-03-28 14:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e9a3bd-3d18-5d60-92b9-b8b9ec9aa403 with scrape type 2
2026-03-28 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09e9a3bd-3d18-5d60-92b9-b8b9ec9aa403 with scrape type 2
2026-03-28 14:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 09e9a3bd-3d18-5d60-92b9-b8b9ec9aa403, identifier: SZ63462
2026-03-28 14:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 09e9a3bd-3d18-5d60-92b9-b8b9ec9aa403 with identifier: SZ63462
2026-03-28 14:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 09e9a3bd-3d18-5d60-92b9-b8b9ec9aa403 with identifier: SZ63462
2026-03-28 14:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 09e9a3bd-3d18-5d60-92b9-b8b9ec9aa403 with identifier: SZ63462 to the API
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:39:31Z',
 'fuel_type': 'diesel',
 'id': '09e9a3bd-3d18-5d60-92b9-b8b9ec9aa403',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ63462',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 193809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-26',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ63462%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Saving data for SZ63462: {'auction_closing_time': 1774715971.0, 'created_time': 1774436458.429391, 'last_price_update_time': 1774706515.60315}
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SZ63462') HTTP/1.1" 204 0
2026-03-28 14:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: RU33051
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: VL31670
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL31670%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for VL31670: 0
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: LL79483
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: UX89995
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: KB87901
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB87901%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for KB87901: 0
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: WB10025
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: AK86639
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: UB42787
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB42787%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for UB42787: 0
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: MB13391
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB13391%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for MB13391: 0
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: YU77194
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: TU71868
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: XT49013
2026-03-28 14:01:55 [auto1.es] INFO: Found listing with ID: TX70336
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX70336%27 HTTP/1.1" 200 None
2026-03-28 14:01:55 [auto1.es] INFO: Scrape type for TX70336: 2
2026-03-28 14:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 106a3838-ca6b-5014-bb42-1821c2e55c78 with identifier: TX70336
2026-03-28 14:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 106a3838-ca6b-5014-bb42-1821c2e55c78 with scrape type 2
2026-03-28 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 106a3838-ca6b-5014-bb42-1821c2e55c78 with scrape type 2
2026-03-28 14:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 106a3838-ca6b-5014-bb42-1821c2e55c78, identifier: TX70336
2026-03-28 14:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 106a3838-ca6b-5014-bb42-1821c2e55c78 with identifier: TX70336
2026-03-28 14:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 106a3838-ca6b-5014-bb42-1821c2e55c78 with identifier: TX70336
2026-03-28 14:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 106a3838-ca6b-5014-bb42-1821c2e55c78 with identifier: TX70336 to the API
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:01:51Z',
 'fuel_type': 'diesel',
 'id': '106a3838-ca6b-5014-bb42-1821c2e55c78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX70336',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 222309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-24',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX70336%27 HTTP/1.1" 200 None
2026-03-28 14:01:56 [auto1.es] INFO: Saving data for TX70336: {'auction_closing_time': 1774713711.0, 'created_time': 1774522848.746843, 'last_price_update_time': 1774706516.252199}
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TX70336') HTTP/1.1" 204 0
2026-03-28 14:01:56 [auto1.es] INFO: Found listing with ID: KD45513
2026-03-28 14:01:56 [auto1.es] INFO: Found listing with ID: YD06518
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD06518%27 HTTP/1.1" 200 None
2026-03-28 14:01:56 [auto1.es] INFO: Scrape type for YD06518: 0
2026-03-28 14:01:56 [auto1.es] INFO: Found listing with ID: UT62475
2026-03-28 14:01:56 [auto1.es] INFO: Found listing with ID: VJ40184
2026-03-28 14:01:56 [auto1.es] INFO: Found listing with ID: JF96117
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF96117%27 HTTP/1.1" 200 None
2026-03-28 14:01:56 [auto1.es] INFO: Scrape type for JF96117: 0
2026-03-28 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:01:57 [auto1.es] INFO: Channel: 24h | Page: 18 | totalHits: 2695 | hits on page: 40
2026-03-28 14:01:57 [auto1.es] INFO: Found listing with ID: VF82701
2026-03-28 14:01:57 [auto1.es] INFO: Found listing with ID: PE23246
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE23246%27 HTTP/1.1" 200 None
2026-03-28 14:01:57 [auto1.es] INFO: Scrape type for PE23246: 0
2026-03-28 14:01:57 [auto1.es] INFO: Found listing with ID: DR94392
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR94392%27 HTTP/1.1" 200 None
2026-03-28 14:01:57 [auto1.es] INFO: Scrape type for DR94392: 0
2026-03-28 14:01:57 [auto1.es] INFO: Found listing with ID: FP05442
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP05442%27 HTTP/1.1" 200 None
2026-03-28 14:01:57 [auto1.es] INFO: Scrape type for FP05442: 0
2026-03-28 14:01:57 [auto1.es] INFO: Found listing with ID: HC55702
2026-03-28 14:01:57 [auto1.es] INFO: Found listing with ID: HP42544
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP42544%27 HTTP/1.1" 200 None
2026-03-28 14:01:57 [auto1.es] INFO: Scrape type for HP42544: 2
2026-03-28 14:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bbd64d0-a7fa-53a4-a786-9cdc5444398e with identifier: HP42544
2026-03-28 14:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bbd64d0-a7fa-53a4-a786-9cdc5444398e with scrape type 2
2026-03-28 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bbd64d0-a7fa-53a4-a786-9cdc5444398e with scrape type 2
2026-03-28 14:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6bbd64d0-a7fa-53a4-a786-9cdc5444398e, identifier: HP42544
2026-03-28 14:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6bbd64d0-a7fa-53a4-a786-9cdc5444398e with identifier: HP42544
2026-03-28 14:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6bbd64d0-a7fa-53a4-a786-9cdc5444398e with identifier: HP42544
2026-03-28 14:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6bbd64d0-a7fa-53a4-a786-9cdc5444398e with identifier: HP42544 to the API
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:12:29Z',
 'fuel_type': 'petrol',
 'id': '6bbd64d0-a7fa-53a4-a786-9cdc5444398e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP42544',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 15079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-05-20',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Mild-Hybrid Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2025}
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP42544%27 HTTP/1.1" 200 None
2026-03-28 14:01:57 [auto1.es] INFO: Saving data for HP42544: {'auction_closing_time': 1774714349.0, 'created_time': 1773950548.99693, 'last_price_update_time': 1774706517.870655}
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HP42544') HTTP/1.1" 204 0
2026-03-28 14:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:01:57 [auto1.es] INFO: Found listing with ID: SR16333
2026-03-28 14:01:57 [auto1.es] INFO: Found listing with ID: XL86918
2026-03-28 14:01:57 [auto1.es] INFO: Found listing with ID: YB76254
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB76254%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Scrape type for YB76254: 0
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: LH51054
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH51054%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Scrape type for LH51054: 0
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: TZ65854
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: GT68357
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT68357%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Scrape type for GT68357: 2
2026-03-28 14:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efaae998-0403-57dd-bd1a-dcccd0c41fe9 with identifier: GT68357
2026-03-28 14:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efaae998-0403-57dd-bd1a-dcccd0c41fe9 with scrape type 2
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efaae998-0403-57dd-bd1a-dcccd0c41fe9 with scrape type 2
2026-03-28 14:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: efaae998-0403-57dd-bd1a-dcccd0c41fe9, identifier: GT68357
2026-03-28 14:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: efaae998-0403-57dd-bd1a-dcccd0c41fe9 with identifier: GT68357
2026-03-28 14:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: efaae998-0403-57dd-bd1a-dcccd0c41fe9 with identifier: GT68357
2026-03-28 14:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: efaae998-0403-57dd-bd1a-dcccd0c41fe9 with identifier: GT68357 to the API
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:44:30Z',
 'fuel_type': 'diesel',
 'id': 'efaae998-0403-57dd-bd1a-dcccd0c41fe9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT68357',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 257395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-27',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2007}
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT68357%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Saving data for GT68357: {'auction_closing_time': 1774716270.0, 'created_time': 1774522911.362408, 'last_price_update_time': 1774706518.489342}
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GT68357') HTTP/1.1" 204 0
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: XJ12820
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: WZ30869
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ30869%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Scrape type for WZ30869: 0
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: XZ41303
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: MG78931
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: HW09758
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: AU55314
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: LF34869
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: ZD98631
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD98631%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Scrape type for ZD98631: 0
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: CX01476
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX01476%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Scrape type for CX01476: 0
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: YW16377
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: LK93242
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: WH79460
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH79460%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Scrape type for WH79460: 0
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: BP77567
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP77567%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Scrape type for BP77567: 0
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: HF28057
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF28057%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Scrape type for HF28057: 0
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: HR03779
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR03779%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Scrape type for HR03779: 0
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: XH48089
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: AM70674
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM70674%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Scrape type for AM70674: 0
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: WY37005
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: YD82310
2026-03-28 14:01:58 [auto1.es] INFO: Found listing with ID: NM83304
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM83304%27 HTTP/1.1" 200 None
2026-03-28 14:01:58 [auto1.es] INFO: Scrape type for NM83304: 2
2026-03-28 14:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19b982d5-7bf6-5d97-8d1b-c3681168c23e with identifier: NM83304
2026-03-28 14:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19b982d5-7bf6-5d97-8d1b-c3681168c23e with scrape type 2
2026-03-28 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19b982d5-7bf6-5d97-8d1b-c3681168c23e with scrape type 2
2026-03-28 14:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 19b982d5-7bf6-5d97-8d1b-c3681168c23e, identifier: NM83304
2026-03-28 14:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 19b982d5-7bf6-5d97-8d1b-c3681168c23e with identifier: NM83304
2026-03-28 14:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 19b982d5-7bf6-5d97-8d1b-c3681168c23e with identifier: NM83304
2026-03-28 14:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 19b982d5-7bf6-5d97-8d1b-c3681168c23e with identifier: NM83304 to the API
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:33:27Z',
 'fuel_type': 'diesel',
 'id': '19b982d5-7bf6-5d97-8d1b-c3681168c23e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM83304',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 58714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-25',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2023}
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM83304%27 HTTP/1.1" 200 None
2026-03-28 14:01:59 [auto1.es] INFO: Saving data for NM83304: {'auction_closing_time': 1774715607.0, 'created_time': 1773302448.802084, 'last_price_update_time': 1774706519.099717}
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NM83304') HTTP/1.1" 204 0
2026-03-28 14:01:59 [auto1.es] INFO: Found listing with ID: JY28028
2026-03-28 14:01:59 [auto1.es] INFO: Found listing with ID: AK94783
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK94783%27 HTTP/1.1" 200 None
2026-03-28 14:01:59 [auto1.es] INFO: Scrape type for AK94783: 0
2026-03-28 14:01:59 [auto1.es] INFO: Found listing with ID: KP85187
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP85187%27 HTTP/1.1" 200 None
2026-03-28 14:01:59 [auto1.es] INFO: Scrape type for KP85187: 0
2026-03-28 14:01:59 [auto1.es] INFO: Found listing with ID: LM23612
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM23612%27 HTTP/1.1" 200 None
2026-03-28 14:01:59 [auto1.es] INFO: Scrape type for LM23612: 0
2026-03-28 14:01:59 [auto1.es] INFO: Found listing with ID: ZJ79467
2026-03-28 14:01:59 [auto1.es] INFO: Found listing with ID: YB91209
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB91209%27 HTTP/1.1" 200 None
2026-03-28 14:01:59 [auto1.es] INFO: Scrape type for YB91209: 0
2026-03-28 14:01:59 [auto1.es] INFO: Found listing with ID: VM24550
2026-03-28 14:01:59 [auto1.es] INFO: Found listing with ID: YY16835
2026-03-28 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:00 [auto1.es] INFO: Channel: 24h | Page: 19 | totalHits: 2695 | hits on page: 40
2026-03-28 14:02:00 [auto1.es] INFO: Found listing with ID: PC46178
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC46178%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [auto1.es] INFO: Scrape type for PC46178: 2
2026-03-28 14:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f4cf526-0ac5-537b-9120-062f283e7f04 with identifier: PC46178
2026-03-28 14:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f4cf526-0ac5-537b-9120-062f283e7f04 with scrape type 2
2026-03-28 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f4cf526-0ac5-537b-9120-062f283e7f04 with scrape type 2
2026-03-28 14:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f4cf526-0ac5-537b-9120-062f283e7f04, identifier: PC46178
2026-03-28 14:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f4cf526-0ac5-537b-9120-062f283e7f04 with identifier: PC46178
2026-03-28 14:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f4cf526-0ac5-537b-9120-062f283e7f04 with identifier: PC46178
2026-03-28 14:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f4cf526-0ac5-537b-9120-062f283e7f04 with identifier: PC46178 to the API
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:02:50Z',
 'fuel_type': 'diesel',
 'id': '6f4cf526-0ac5-537b-9120-062f283e7f04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC46178',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 153696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-08',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC46178%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [auto1.es] INFO: Saving data for PC46178: {'auction_closing_time': 1774713770.0, 'created_time': 1774425631.574288, 'last_price_update_time': 1774706520.871426}
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PC46178') HTTP/1.1" 204 0
2026-03-28 14:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:00 [auto1.es] INFO: Found listing with ID: FN37558
2026-03-28 14:02:00 [auto1.es] INFO: Found listing with ID: DB28446
2026-03-28 14:02:00 [auto1.es] INFO: Found listing with ID: KS53937
2026-03-28 14:02:00 [auto1.es] INFO: Found listing with ID: FX87163
2026-03-28 14:02:00 [auto1.es] INFO: Found listing with ID: UK11838
2026-03-28 14:02:00 [auto1.es] INFO: Found listing with ID: NW63422
2026-03-28 14:02:00 [auto1.es] INFO: Found listing with ID: GZ61403
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ61403%27 HTTP/1.1" 200 None
2026-03-28 14:02:00 [auto1.es] INFO: Scrape type for GZ61403: 0
2026-03-28 14:02:00 [auto1.es] INFO: Found listing with ID: BP61591
2026-03-28 14:02:00 [auto1.es] INFO: Found listing with ID: SC27418
2026-03-28 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC27418%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Scrape type for SC27418: 2
2026-03-28 14:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a8ae15-7cd6-5304-91a1-3442494875e1 with identifier: SC27418
2026-03-28 14:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a8ae15-7cd6-5304-91a1-3442494875e1 with scrape type 2
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15a8ae15-7cd6-5304-91a1-3442494875e1 with scrape type 2
2026-03-28 14:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15a8ae15-7cd6-5304-91a1-3442494875e1, identifier: SC27418
2026-03-28 14:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15a8ae15-7cd6-5304-91a1-3442494875e1 with identifier: SC27418
2026-03-28 14:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15a8ae15-7cd6-5304-91a1-3442494875e1 with identifier: SC27418
2026-03-28 14:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 15a8ae15-7cd6-5304-91a1-3442494875e1 with identifier: SC27418 to the API
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-28T16:04:07Z',
 'fuel_type': 'petrol',
 'id': '15a8ae15-7cd6-5304-91a1-3442494875e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC27418',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 38813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Star',
 'transmission': 'automatic',
 'trim': 'Star',
 'year': 2020}
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC27418%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Saving data for SC27418: {'auction_closing_time': 1774713847.0, 'created_time': 1774522861.588562, 'last_price_update_time': 1774706521.508346}
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SC27418') HTTP/1.1" 204 0
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: LS69638
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: WF15705
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: NJ68356
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ68356%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Scrape type for NJ68356: 0
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: LC97484
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC97484%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Scrape type for LC97484: 0
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: NP49445
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: FR82793
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR82793%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Scrape type for FR82793: 0
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: HJ26610
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: LF82591
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: HW63971
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: GU42237
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU42237%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Scrape type for GU42237: 0
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: RH35807
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: HN32774
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: LC37713
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC37713%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Scrape type for LC37713: 0
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: MZ99822
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ99822%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Scrape type for MZ99822: 0
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: YS28184
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: VR49277
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: FJ90358
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: TU72594
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: CR48575
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: WR24367
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: VL94048
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: TW02627
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW02627%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Scrape type for TW02627: 0
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: AE32204
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: JE65744
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE65744%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Scrape type for JE65744: 0
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: PF77952
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: HR81146
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR81146%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Scrape type for HR81146: 0
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: YD06754
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: WD69770
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: JG96257
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG96257%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Scrape type for JG96257: 0
2026-03-28 14:02:01 [auto1.es] INFO: Found listing with ID: JZ51794
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ51794%27 HTTP/1.1" 200 None
2026-03-28 14:02:01 [auto1.es] INFO: Scrape type for JZ51794: 2
2026-03-28 14:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8be5c731-b0d6-5c59-8654-089696cf099b with identifier: JZ51794
2026-03-28 14:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8be5c731-b0d6-5c59-8654-089696cf099b with scrape type 2
2026-03-28 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8be5c731-b0d6-5c59-8654-089696cf099b with scrape type 2
2026-03-28 14:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8be5c731-b0d6-5c59-8654-089696cf099b, identifier: JZ51794
2026-03-28 14:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8be5c731-b0d6-5c59-8654-089696cf099b with identifier: JZ51794
2026-03-28 14:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8be5c731-b0d6-5c59-8654-089696cf099b with identifier: JZ51794
2026-03-28 14:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8be5c731-b0d6-5c59-8654-089696cf099b with identifier: JZ51794 to the API
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:11:07Z',
 'fuel_type': 'diesel',
 'id': '8be5c731-b0d6-5c59-8654-089696cf099b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ51794',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 162496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ51794%27 HTTP/1.1" 200 None
2026-03-28 14:02:02 [auto1.es] INFO: Saving data for JZ51794: {'auction_closing_time': 1774714267.0, 'created_time': 1774522861.960465, 'last_price_update_time': 1774706522.321191}
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JZ51794') HTTP/1.1" 204 0
2026-03-28 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:09 [auto1.es] INFO: Channel: 24h | Page: 20 | totalHits: 2695 | hits on page: 40
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: RB01014
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB01014%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for RB01014: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: LK62452
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: RL13967
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL13967%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for RL13967: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: PG01286
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG01286%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for PG01286: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: YT35531
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: JF42327
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF42327%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for JF42327: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: UR00464
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: WV47930
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: SH75312
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH75312%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for SH75312: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: DM90018
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: WM47601
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: LS55149
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS55149%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for LS55149: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: TD48491
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: ZJ95453
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ95453%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for ZJ95453: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: FC13262
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: RP86418
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP86418%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for RP86418: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: SM64355
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: NU52184
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: FY50963
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY50963%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for FY50963: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: NN48613
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN48613%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for NN48613: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: AZ28710
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ28710%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for AZ28710: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: TC59600
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: VP39561
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP39561%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for VP39561: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: EU66649
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: FY66249
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: PR87201
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: FK50092
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK50092%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for FK50092: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: ZJ44850
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: PZ33789
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: WZ85087
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ85087%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for WZ85087: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: LP06915
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP06915%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for LP06915: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: GD92135
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD92135%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for GD92135: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: ZE71239
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: RK72644
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK72644%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for RK72644: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: AC50024
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC50024%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for AC50024: 0
2026-03-28 14:02:09 [auto1.es] INFO: Found listing with ID: JK92446
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK92446%27 HTTP/1.1" 200 None
2026-03-28 14:02:09 [auto1.es] INFO: Scrape type for JK92446: 2
2026-03-28 14:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bc45aa4-4926-556c-becd-ee7367dab4eb with identifier: JK92446
2026-03-28 14:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bc45aa4-4926-556c-becd-ee7367dab4eb with scrape type 2
2026-03-28 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bc45aa4-4926-556c-becd-ee7367dab4eb with scrape type 2
2026-03-28 14:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1bc45aa4-4926-556c-becd-ee7367dab4eb, identifier: JK92446
2026-03-28 14:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1bc45aa4-4926-556c-becd-ee7367dab4eb with identifier: JK92446
2026-03-28 14:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1bc45aa4-4926-556c-becd-ee7367dab4eb with identifier: JK92446
2026-03-28 14:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1bc45aa4-4926-556c-becd-ee7367dab4eb with identifier: JK92446 to the API
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:18:06Z',
 'fuel_type': 'petrol',
 'id': '1bc45aa4-4926-556c-becd-ee7367dab4eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK92446',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 180374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-06',
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 2008}
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK92446%27 HTTP/1.1" 200 None
2026-03-28 14:02:10 [auto1.es] INFO: Saving data for JK92446: {'auction_closing_time': 1774714686.0, 'created_time': 1773126791.027655, 'last_price_update_time': 1774706530.411071}
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JK92446') HTTP/1.1" 204 0
2026-03-28 14:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:10 [auto1.es] INFO: Found listing with ID: UP55531
2026-03-28 14:02:10 [auto1.es] INFO: Found listing with ID: WD98300
2026-03-28 14:02:10 [auto1.es] INFO: Found listing with ID: DR19910
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR19910%27 HTTP/1.1" 200 None
2026-03-28 14:02:10 [auto1.es] INFO: Scrape type for DR19910: 0
2026-03-28 14:02:10 [auto1.es] INFO: Found listing with ID: WA10977
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA10977%27 HTTP/1.1" 200 None
2026-03-28 14:02:10 [auto1.es] INFO: Scrape type for WA10977: 0
2026-03-28 14:02:10 [scrapy.extensions.logstats] INFO: Crawled 130 pages (at 34 pages/min), scraped 84 items (at 41 items/min)
2026-03-28 14:02:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-28 14:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:11 [auto1.es] INFO: Channel: 24h | Page: 21 | totalHits: 2695 | hits on page: 40
2026-03-28 14:02:11 [auto1.es] INFO: Found listing with ID: BF22404
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF22404%27 HTTP/1.1" 200 None
2026-03-28 14:02:11 [auto1.es] INFO: Scrape type for BF22404: 0
2026-03-28 14:02:11 [auto1.es] INFO: Found listing with ID: MF04433
2026-03-28 14:02:11 [auto1.es] INFO: Found listing with ID: VV66247
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV66247%27 HTTP/1.1" 200 None
2026-03-28 14:02:11 [auto1.es] INFO: Scrape type for VV66247: 0
2026-03-28 14:02:11 [auto1.es] INFO: Found listing with ID: BK72591
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK72591%27 HTTP/1.1" 200 None
2026-03-28 14:02:11 [auto1.es] INFO: Scrape type for BK72591: 0
2026-03-28 14:02:11 [auto1.es] INFO: Found listing with ID: NV84448
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV84448%27 HTTP/1.1" 200 None
2026-03-28 14:02:11 [auto1.es] INFO: Scrape type for NV84448: 0
2026-03-28 14:02:11 [auto1.es] INFO: Found listing with ID: FH30373
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH30373%27 HTTP/1.1" 200 None
2026-03-28 14:02:11 [auto1.es] INFO: Scrape type for FH30373: 2
2026-03-28 14:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a4c4942-0343-58d2-a65a-0ec2aab4e9d1 with identifier: FH30373
2026-03-28 14:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a4c4942-0343-58d2-a65a-0ec2aab4e9d1 with scrape type 2
2026-03-28 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a4c4942-0343-58d2-a65a-0ec2aab4e9d1 with scrape type 2
2026-03-28 14:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6a4c4942-0343-58d2-a65a-0ec2aab4e9d1, identifier: FH30373
2026-03-28 14:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6a4c4942-0343-58d2-a65a-0ec2aab4e9d1 with identifier: FH30373
2026-03-28 14:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6a4c4942-0343-58d2-a65a-0ec2aab4e9d1 with identifier: FH30373
2026-03-28 14:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6a4c4942-0343-58d2-a65a-0ec2aab4e9d1 with identifier: FH30373 to the API
2026-03-28 14:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:14:29Z',
 'fuel_type': 'diesel',
 'id': '6a4c4942-0343-58d2-a65a-0ec2aab4e9d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH30373',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 141686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-28',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH30373%27 HTTP/1.1" 200 None
2026-03-28 14:02:12 [auto1.es] INFO: Saving data for FH30373: {'auction_closing_time': 1774714469.0, 'created_time': 1774522877.829184, 'last_price_update_time': 1774706532.181065}
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FH30373') HTTP/1.1" 204 0
2026-03-28 14:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:12 [auto1.es] INFO: Found listing with ID: TB24356
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB24356%27 HTTP/1.1" 200 None
2026-03-28 14:02:12 [auto1.es] INFO: Scrape type for TB24356: 2
2026-03-28 14:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f55ac6-a981-5ba7-add4-f88b4328e8bd with identifier: TB24356
2026-03-28 14:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f55ac6-a981-5ba7-add4-f88b4328e8bd with scrape type 2
2026-03-28 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91f55ac6-a981-5ba7-add4-f88b4328e8bd with scrape type 2
2026-03-28 14:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 91f55ac6-a981-5ba7-add4-f88b4328e8bd, identifier: TB24356
2026-03-28 14:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 91f55ac6-a981-5ba7-add4-f88b4328e8bd with identifier: TB24356
2026-03-28 14:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 91f55ac6-a981-5ba7-add4-f88b4328e8bd with identifier: TB24356
2026-03-28 14:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 91f55ac6-a981-5ba7-add4-f88b4328e8bd with identifier: TB24356 to the API
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:12:07Z',
 'fuel_type': 'petrol',
 'id': '91f55ac6-a981-5ba7-add4-f88b4328e8bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB24356',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 31113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-08',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 T-GDI Maxx 2WD',
 'transmission': 'manual',
 'trim': 'Maxx 2WD',
 'year': 2022}
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB24356%27 HTTP/1.1" 200 None
2026-03-28 14:02:12 [auto1.es] INFO: Saving data for TB24356: {'auction_closing_time': 1774714327.0, 'created_time': 1774436541.452679, 'last_price_update_time': 1774706532.758491}
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB24356') HTTP/1.1" 204 0
2026-03-28 14:02:12 [auto1.es] INFO: Found listing with ID: TA73897
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA73897%27 HTTP/1.1" 200 None
2026-03-28 14:02:12 [auto1.es] INFO: Scrape type for TA73897: 0
2026-03-28 14:02:12 [auto1.es] INFO: Found listing with ID: WG98827
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG98827%27 HTTP/1.1" 200 None
2026-03-28 14:02:12 [auto1.es] INFO: Scrape type for WG98827: 0
2026-03-28 14:02:12 [auto1.es] INFO: Found listing with ID: TF48403
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF48403%27 HTTP/1.1" 200 None
2026-03-28 14:02:12 [auto1.es] INFO: Scrape type for TF48403: 0
2026-03-28 14:02:12 [auto1.es] INFO: Found listing with ID: EV89270
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV89270%27 HTTP/1.1" 200 None
2026-03-28 14:02:12 [auto1.es] INFO: Scrape type for EV89270: 0
2026-03-28 14:02:12 [auto1.es] INFO: Found listing with ID: GA27189
2026-03-28 14:02:12 [auto1.es] INFO: Found listing with ID: UG25415
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG25415%27 HTTP/1.1" 200 None
2026-03-28 14:02:12 [auto1.es] INFO: Scrape type for UG25415: 0
2026-03-28 14:02:12 [auto1.es] INFO: Found listing with ID: XG18917
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG18917%27 HTTP/1.1" 200 None
2026-03-28 14:02:12 [auto1.es] INFO: Scrape type for XG18917: 0
2026-03-28 14:02:12 [auto1.es] INFO: Found listing with ID: WJ72825
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ72825%27 HTTP/1.1" 200 None
2026-03-28 14:02:13 [auto1.es] INFO: Scrape type for WJ72825: 2
2026-03-28 14:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd234d85-9d91-53ac-8349-984326a4192a with identifier: WJ72825
2026-03-28 14:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd234d85-9d91-53ac-8349-984326a4192a with scrape type 2
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd234d85-9d91-53ac-8349-984326a4192a with scrape type 2
2026-03-28 14:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fd234d85-9d91-53ac-8349-984326a4192a, identifier: WJ72825
2026-03-28 14:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fd234d85-9d91-53ac-8349-984326a4192a with identifier: WJ72825
2026-03-28 14:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fd234d85-9d91-53ac-8349-984326a4192a with identifier: WJ72825
2026-03-28 14:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fd234d85-9d91-53ac-8349-984326a4192a with identifier: WJ72825 to the API
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:19:50Z',
 'fuel_type': 'diesel',
 'id': 'fd234d85-9d91-53ac-8349-984326a4192a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ72825',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 167865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-16',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 109 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2016}
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ72825%27 HTTP/1.1" 200 None
2026-03-28 14:02:13 [auto1.es] INFO: Saving data for WJ72825: {'auction_closing_time': 1774714790.0, 'created_time': 1773777693.359814, 'last_price_update_time': 1774706533.424492}
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WJ72825') HTTP/1.1" 204 0
2026-03-28 14:02:13 [auto1.es] INFO: Found listing with ID: YN66456
2026-03-28 14:02:13 [auto1.es] INFO: Found listing with ID: UT89838
2026-03-28 14:02:13 [auto1.es] INFO: Found listing with ID: DW22650
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW22650%27 HTTP/1.1" 200 None
2026-03-28 14:02:13 [auto1.es] INFO: Scrape type for DW22650: 0
2026-03-28 14:02:13 [auto1.es] INFO: Found listing with ID: WL78686
2026-03-28 14:02:13 [auto1.es] INFO: Found listing with ID: ZL13799
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL13799%27 HTTP/1.1" 200 None
2026-03-28 14:02:13 [auto1.es] INFO: Scrape type for ZL13799: 0
2026-03-28 14:02:13 [auto1.es] INFO: Found listing with ID: GU11449
2026-03-28 14:02:13 [auto1.es] INFO: Found listing with ID: DG38450
2026-03-28 14:02:13 [auto1.es] INFO: Found listing with ID: MR72452
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR72452%27 HTTP/1.1" 200 None
2026-03-28 14:02:13 [auto1.es] INFO: Scrape type for MR72452: 0
2026-03-28 14:02:13 [auto1.es] INFO: Found listing with ID: KF98963
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF98963%27 HTTP/1.1" 200 None
2026-03-28 14:02:13 [auto1.es] INFO: Scrape type for KF98963: 0
2026-03-28 14:02:13 [auto1.es] INFO: Found listing with ID: BT14659
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT14659%27 HTTP/1.1" 200 None
2026-03-28 14:02:13 [auto1.es] INFO: Scrape type for BT14659: 2
2026-03-28 14:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bca6571-7f05-5380-a469-eca95bc0b1d1 with identifier: BT14659
2026-03-28 14:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bca6571-7f05-5380-a469-eca95bc0b1d1 with scrape type 2
2026-03-28 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bca6571-7f05-5380-a469-eca95bc0b1d1 with scrape type 2
2026-03-28 14:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2bca6571-7f05-5380-a469-eca95bc0b1d1, identifier: BT14659
2026-03-28 14:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2bca6571-7f05-5380-a469-eca95bc0b1d1 with identifier: BT14659
2026-03-28 14:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2bca6571-7f05-5380-a469-eca95bc0b1d1 with identifier: BT14659
2026-03-28 14:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2bca6571-7f05-5380-a469-eca95bc0b1d1 with identifier: BT14659 to the API
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:35:19Z',
 'fuel_type': 'diesel',
 'id': '2bca6571-7f05-5380-a469-eca95bc0b1d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT14659',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 182142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-21',
 'seller_name': None,
 'title': 'Toyota Verso 2.0 D-4D Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT14659%27 HTTP/1.1" 200 None
2026-03-28 14:02:13 [auto1.es] INFO: Saving data for BT14659: {'auction_closing_time': 1774715719.0, 'created_time': 1773131652.049438, 'last_price_update_time': 1774706533.932933}
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BT14659') HTTP/1.1" 204 0
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: EK65360
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK65360%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [auto1.es] INFO: Scrape type for EK65360: 0
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: WC72839
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: ZK05634
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK05634%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [auto1.es] INFO: Scrape type for ZK05634: 0
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: LM00276
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: GZ25501
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ25501%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [auto1.es] INFO: Scrape type for GZ25501: 2
2026-03-28 14:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0c99c3-664e-55f2-9862-26bd3ae40b38 with identifier: GZ25501
2026-03-28 14:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0c99c3-664e-55f2-9862-26bd3ae40b38 with scrape type 2
2026-03-28 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a0c99c3-664e-55f2-9862-26bd3ae40b38 with scrape type 2
2026-03-28 14:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8a0c99c3-664e-55f2-9862-26bd3ae40b38, identifier: GZ25501
2026-03-28 14:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8a0c99c3-664e-55f2-9862-26bd3ae40b38 with identifier: GZ25501
2026-03-28 14:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8a0c99c3-664e-55f2-9862-26bd3ae40b38 with identifier: GZ25501
2026-03-28 14:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8a0c99c3-664e-55f2-9862-26bd3ae40b38 with identifier: GZ25501 to the API
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:59:49Z',
 'fuel_type': 'petrol',
 'id': '8a0c99c3-664e-55f2-9862-26bd3ae40b38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ25501',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 180720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-14',
 'seller_name': None,
 'title': 'Audi A3 1.8 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ25501%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [auto1.es] INFO: Saving data for GZ25501: {'auction_closing_time': 1774717189.0, 'created_time': 1774522895.491222, 'last_price_update_time': 1774706534.536962}
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GZ25501') HTTP/1.1" 204 0
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: AP64708
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: SE84848
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: KW07393
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: EH84467
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: ZW00345
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW00345%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [auto1.es] INFO: Scrape type for ZW00345: 0
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: SZ42428
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: WH24419
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: YG93174
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG93174%27 HTTP/1.1" 200 None
2026-03-28 14:02:14 [auto1.es] INFO: Scrape type for YG93174: 0
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: EH99000
2026-03-28 14:02:14 [auto1.es] INFO: Found listing with ID: FX85730
2026-03-28 14:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:15 [auto1.es] INFO: Channel: 24h | Page: 22 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:15 [auto1.es] INFO: Found listing with ID: FX85730
2026-03-28 14:02:15 [auto1.es] INFO: Found listing with ID: TN34966
2026-03-28 14:02:15 [auto1.es] INFO: Found listing with ID: SH03418
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH03418%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [auto1.es] INFO: Scrape type for SH03418: 0
2026-03-28 14:02:15 [auto1.es] INFO: Found listing with ID: EV20244
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV20244%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [auto1.es] INFO: Scrape type for EV20244: 0
2026-03-28 14:02:15 [auto1.es] INFO: Found listing with ID: NA23399
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA23399%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [auto1.es] INFO: Scrape type for NA23399: 2
2026-03-28 14:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 177d2928-22d8-5bc9-88ad-34ab30db50d6 with identifier: NA23399
2026-03-28 14:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 177d2928-22d8-5bc9-88ad-34ab30db50d6 with scrape type 2
2026-03-28 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 177d2928-22d8-5bc9-88ad-34ab30db50d6 with scrape type 2
2026-03-28 14:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 177d2928-22d8-5bc9-88ad-34ab30db50d6, identifier: NA23399
2026-03-28 14:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 177d2928-22d8-5bc9-88ad-34ab30db50d6 with identifier: NA23399
2026-03-28 14:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 177d2928-22d8-5bc9-88ad-34ab30db50d6 with identifier: NA23399
2026-03-28 14:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 177d2928-22d8-5bc9-88ad-34ab30db50d6 with identifier: NA23399 to the API
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:01:47Z',
 'fuel_type': 'diesel',
 'id': '177d2928-22d8-5bc9-88ad-34ab30db50d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA23399',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 212959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-28',
 'seller_name': None,
 'title': 'Honda CR-V 2.2 DTEC Executive 4WD',
 'transmission': 'automatic',
 'trim': 'Executive 4WD',
 'year': 2012}
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA23399%27 HTTP/1.1" 200 None
2026-03-28 14:02:15 [auto1.es] INFO: Saving data for NA23399: {'auction_closing_time': 1774713707.0, 'created_time': 1773132024.111113, 'last_price_update_time': 1774706535.998596}
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NA23399') HTTP/1.1" 204 0
2026-03-28 14:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:16 [auto1.es] INFO: Found listing with ID: DV59548
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV59548%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [auto1.es] INFO: Scrape type for DV59548: 0
2026-03-28 14:02:16 [auto1.es] INFO: Found listing with ID: YG50456
2026-03-28 14:02:16 [auto1.es] INFO: Found listing with ID: TU21075
2026-03-28 14:02:16 [auto1.es] INFO: Found listing with ID: AV16131
2026-03-28 14:02:16 [auto1.es] INFO: Found listing with ID: JW81079
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW81079%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [auto1.es] INFO: Scrape type for JW81079: 0
2026-03-28 14:02:16 [auto1.es] INFO: Found listing with ID: PS31871
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS31871%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [auto1.es] INFO: Scrape type for PS31871: 2
2026-03-28 14:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 362c83c0-8c7a-5533-8c64-bcfedcd15d48 with identifier: PS31871
2026-03-28 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 362c83c0-8c7a-5533-8c64-bcfedcd15d48 with scrape type 2
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 362c83c0-8c7a-5533-8c64-bcfedcd15d48 with scrape type 2
2026-03-28 14:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 362c83c0-8c7a-5533-8c64-bcfedcd15d48, identifier: PS31871
2026-03-28 14:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 362c83c0-8c7a-5533-8c64-bcfedcd15d48 with identifier: PS31871
2026-03-28 14:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 362c83c0-8c7a-5533-8c64-bcfedcd15d48 with identifier: PS31871
2026-03-28 14:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 362c83c0-8c7a-5533-8c64-bcfedcd15d48 with identifier: PS31871 to the API
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:41:28Z',
 'fuel_type': 'diesel',
 'id': '362c83c0-8c7a-5533-8c64-bcfedcd15d48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS31871',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 289034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-10',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Advance',
 'transmission': 'automatic',
 'trim': 'quattro Advance',
 'year': 2014}
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS31871%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [auto1.es] INFO: Saving data for PS31871: {'auction_closing_time': 1774716088.0, 'created_time': 1774522870.153405, 'last_price_update_time': 1774706536.582112}
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PS31871') HTTP/1.1" 204 0
2026-03-28 14:02:16 [auto1.es] INFO: Found listing with ID: BE63337
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE63337%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [auto1.es] INFO: Scrape type for BE63337: 0
2026-03-28 14:02:16 [auto1.es] INFO: Found listing with ID: XJ28313
2026-03-28 14:02:16 [auto1.es] INFO: Found listing with ID: FJ85779
2026-03-28 14:02:16 [auto1.es] INFO: Found listing with ID: MJ22041
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ22041%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [auto1.es] INFO: Scrape type for MJ22041: 0
2026-03-28 14:02:16 [auto1.es] INFO: Found listing with ID: BV18028
2026-03-28 14:02:16 [auto1.es] INFO: Found listing with ID: HG47154
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG47154%27 HTTP/1.1" 200 None
2026-03-28 14:02:16 [auto1.es] INFO: Scrape type for HG47154: 2
2026-03-28 14:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce875944-c62c-53ab-b114-e78bfa1c380f with identifier: HG47154
2026-03-28 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce875944-c62c-53ab-b114-e78bfa1c380f with scrape type 2
2026-03-28 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce875944-c62c-53ab-b114-e78bfa1c380f with scrape type 2
2026-03-28 14:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce875944-c62c-53ab-b114-e78bfa1c380f, identifier: HG47154
2026-03-28 14:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce875944-c62c-53ab-b114-e78bfa1c380f with identifier: HG47154
2026-03-28 14:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce875944-c62c-53ab-b114-e78bfa1c380f with identifier: HG47154
2026-03-28 14:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce875944-c62c-53ab-b114-e78bfa1c380f with identifier: HG47154 to the API
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:44:58Z',
 'fuel_type': 'diesel',
 'id': 'ce875944-c62c-53ab-b114-e78bfa1c380f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG47154',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 326123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-31',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Emotion',
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2010}
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG47154%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [auto1.es] INFO: Saving data for HG47154: {'auction_closing_time': 1774716298.0, 'created_time': 1774522872.886976, 'last_price_update_time': 1774706537.097461}
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HG47154') HTTP/1.1" 204 0
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: SN53081
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: RC21123
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: ZX16676
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX16676%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [auto1.es] INFO: Scrape type for ZX16676: 0
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: FZ38414
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ38414%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [auto1.es] INFO: Scrape type for FZ38414: 0
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: LH19294
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: XE96184
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: GY33906
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: HY73546
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: MK12831
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: WS59204
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: PT59425
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: TX02408
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX02408%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [auto1.es] INFO: Scrape type for TX02408: 0
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: YG37812
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: DE32472
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE32472%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [auto1.es] INFO: Scrape type for DE32472: 0
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: PJ49539
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: PP21573
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP21573%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [auto1.es] INFO: Scrape type for PP21573: 0
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: RJ04030
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ04030%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [auto1.es] INFO: Scrape type for RJ04030: 0
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: LK18237
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK18237%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [auto1.es] INFO: Scrape type for LK18237: 0
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: GS46060
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS46060%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [auto1.es] INFO: Scrape type for GS46060: 0
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: JJ86148
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: HW81498
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: JX49148
2026-03-28 14:02:17 [auto1.es] INFO: Found listing with ID: AF00025
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF00025%27 HTTP/1.1" 200 None
2026-03-28 14:02:17 [auto1.es] INFO: Scrape type for AF00025: 0
2026-03-28 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:18 [auto1.es] INFO: Channel: 24h | Page: 23 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: NM59518
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: RJ55423
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ55423%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for RJ55423: 0
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: TU32370
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: RS43039
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS43039%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for RS43039: 0
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: FF66391
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF66391%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for FF66391: 0
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: TU27127
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU27127%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for TU27127: 0
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: TU02735
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: KT63961
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: KG64326
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: WV75018
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: XD33524
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD33524%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for XD33524: 0
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: MH48496
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH48496%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for MH48496: 0
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: TX48554
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: DW56939
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: WA73685
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: AG21540
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: RE29588
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: KG74250
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: XV71103
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: ZG15911
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG15911%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for ZG15911: 0
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: ZL22233
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL22233%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for ZL22233: 0
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: WL57224
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL57224%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for WL57224: 0
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: SA46382
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA46382%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for SA46382: 0
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: HS16028
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: AK39798
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: GA00375
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA00375%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for GA00375: 0
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: ER64575
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER64575%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for ER64575: 0
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: PD85443
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: FR28511
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: CK41460
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: BC07750
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: YR87797
2026-03-28 14:02:18 [auto1.es] INFO: Found listing with ID: NN09509
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN09509%27 HTTP/1.1" 200 None
2026-03-28 14:02:18 [auto1.es] INFO: Scrape type for NN09509: 2
2026-03-28 14:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d202d8c-1e9d-5d03-9e86-a29a1674b76a with identifier: NN09509
2026-03-28 14:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d202d8c-1e9d-5d03-9e86-a29a1674b76a with scrape type 2
2026-03-28 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d202d8c-1e9d-5d03-9e86-a29a1674b76a with scrape type 2
2026-03-28 14:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2d202d8c-1e9d-5d03-9e86-a29a1674b76a, identifier: NN09509
2026-03-28 14:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2d202d8c-1e9d-5d03-9e86-a29a1674b76a with identifier: NN09509
2026-03-28 14:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2d202d8c-1e9d-5d03-9e86-a29a1674b76a with identifier: NN09509
2026-03-28 14:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2d202d8c-1e9d-5d03-9e86-a29a1674b76a with identifier: NN09509 to the API
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:35:10Z',
 'fuel_type': 'diesel',
 'id': '2d202d8c-1e9d-5d03-9e86-a29a1674b76a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN09509',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 41143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-20',
 'seller_name': None,
 'title': 'Citroen C4 1.6 Blue-HDi Live Edition',
 'transmission': 'manual',
 'trim': 'Live Edition',
 'year': 2015}
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN09509%27 HTTP/1.1" 200 None
2026-03-28 14:02:19 [auto1.es] INFO: Saving data for NN09509: {'auction_closing_time': 1774715710.0, 'created_time': 1774522883.366262, 'last_price_update_time': 1774706539.09271}
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NN09509') HTTP/1.1" 204 0
2026-03-28 14:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:19 [auto1.es] INFO: Found listing with ID: US86710
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US86710%27 HTTP/1.1" 200 None
2026-03-28 14:02:19 [auto1.es] INFO: Scrape type for US86710: 0
2026-03-28 14:02:19 [auto1.es] INFO: Found listing with ID: AS83743
2026-03-28 14:02:19 [auto1.es] INFO: Found listing with ID: ML55356
2026-03-28 14:02:19 [auto1.es] INFO: Found listing with ID: FG99809
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG99809%27 HTTP/1.1" 200 None
2026-03-28 14:02:19 [auto1.es] INFO: Scrape type for FG99809: 0
2026-03-28 14:02:19 [auto1.es] INFO: Found listing with ID: WY05538
2026-03-28 14:02:19 [auto1.es] INFO: Found listing with ID: FF26714
2026-03-28 14:02:19 [auto1.es] INFO: Found listing with ID: JB16763
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB16763%27 HTTP/1.1" 200 None
2026-03-28 14:02:19 [auto1.es] INFO: Scrape type for JB16763: 0
2026-03-28 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:20 [auto1.es] INFO: Channel: 24h | Page: 24 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:20 [auto1.es] INFO: Found listing with ID: KY38332
2026-03-28 14:02:20 [auto1.es] INFO: Found listing with ID: MN54657
2026-03-28 14:02:20 [auto1.es] INFO: Found listing with ID: MV29713
2026-03-28 14:02:20 [auto1.es] INFO: Found listing with ID: FL07647
2026-03-28 14:02:20 [auto1.es] INFO: Found listing with ID: ZJ56625
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ56625%27 HTTP/1.1" 200 None
2026-03-28 14:02:20 [auto1.es] INFO: Scrape type for ZJ56625: 0
2026-03-28 14:02:20 [auto1.es] INFO: Found listing with ID: XB50501
2026-03-28 14:02:20 [auto1.es] INFO: Found listing with ID: XH86580
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH86580%27 HTTP/1.1" 200 None
2026-03-28 14:02:20 [auto1.es] INFO: Scrape type for XH86580: 2
2026-03-28 14:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ef3df40-ba8a-5a1f-83ec-fee5ebf211d1 with identifier: XH86580
2026-03-28 14:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ef3df40-ba8a-5a1f-83ec-fee5ebf211d1 with scrape type 2
2026-03-28 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ef3df40-ba8a-5a1f-83ec-fee5ebf211d1 with scrape type 2
2026-03-28 14:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8ef3df40-ba8a-5a1f-83ec-fee5ebf211d1, identifier: XH86580
2026-03-28 14:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8ef3df40-ba8a-5a1f-83ec-fee5ebf211d1 with identifier: XH86580
2026-03-28 14:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8ef3df40-ba8a-5a1f-83ec-fee5ebf211d1 with identifier: XH86580
2026-03-28 14:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8ef3df40-ba8a-5a1f-83ec-fee5ebf211d1 with identifier: XH86580 to the API
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:39:02Z',
 'fuel_type': 'petrol',
 'id': '8ef3df40-ba8a-5a1f-83ec-fee5ebf211d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH86580',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 77472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH86580%27 HTTP/1.1" 200 None
2026-03-28 14:02:20 [auto1.es] INFO: Saving data for XH86580: {'auction_closing_time': 1774715942.0, 'created_time': 1774522888.080997, 'last_price_update_time': 1774706540.862385}
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XH86580') HTTP/1.1" 204 0
2026-03-28 14:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:20 [auto1.es] INFO: Found listing with ID: RM85615
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM85615%27 HTTP/1.1" 200 None
2026-03-28 14:02:20 [auto1.es] INFO: Scrape type for RM85615: 0
2026-03-28 14:02:20 [auto1.es] INFO: Found listing with ID: AG32524
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG32524%27 HTTP/1.1" 200 None
2026-03-28 14:02:20 [auto1.es] INFO: Scrape type for AG32524: 0
2026-03-28 14:02:20 [auto1.es] INFO: Found listing with ID: WF53807
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF53807%27 HTTP/1.1" 200 None
2026-03-28 14:02:21 [auto1.es] INFO: Scrape type for WF53807: 0
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: US15459
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US15459%27 HTTP/1.1" 200 None
2026-03-28 14:02:21 [auto1.es] INFO: Scrape type for US15459: 0
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: KE50509
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE50509%27 HTTP/1.1" 200 None
2026-03-28 14:02:21 [auto1.es] INFO: Scrape type for KE50509: 0
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: NX73421
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: YY12745
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: LD17478
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: FH07549
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: PF82044
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: BY63311
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: DR60635
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR60635%27 HTTP/1.1" 200 None
2026-03-28 14:02:21 [auto1.es] INFO: Scrape type for DR60635: 0
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: CY33639
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: YH86623
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH86623%27 HTTP/1.1" 200 None
2026-03-28 14:02:21 [auto1.es] INFO: Scrape type for YH86623: 2
2026-03-28 14:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb8bf839-7788-590d-b22c-1ce5940216d3 with identifier: YH86623
2026-03-28 14:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb8bf839-7788-590d-b22c-1ce5940216d3 with scrape type 2
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb8bf839-7788-590d-b22c-1ce5940216d3 with scrape type 2
2026-03-28 14:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fb8bf839-7788-590d-b22c-1ce5940216d3, identifier: YH86623
2026-03-28 14:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fb8bf839-7788-590d-b22c-1ce5940216d3 with identifier: YH86623
2026-03-28 14:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fb8bf839-7788-590d-b22c-1ce5940216d3 with identifier: YH86623
2026-03-28 14:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fb8bf839-7788-590d-b22c-1ce5940216d3 with identifier: YH86623 to the API
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:01:48Z',
 'fuel_type': 'diesel',
 'id': 'fb8bf839-7788-590d-b22c-1ce5940216d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH86623',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 303056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-04',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH86623%27 HTTP/1.1" 200 None
2026-03-28 14:02:21 [auto1.es] INFO: Saving data for YH86623: {'auction_closing_time': 1774713708.0, 'created_time': 1774522899.066884, 'last_price_update_time': 1774706541.583255}
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YH86623') HTTP/1.1" 204 0
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: LH99658
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: PD45625
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: GD38057
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: RK74623
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: PT78708
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: WF38269
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF38269%27 HTTP/1.1" 200 None
2026-03-28 14:02:21 [auto1.es] INFO: Scrape type for WF38269: 0
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: SP90051
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: ZT52456
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: YP26589
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: BM87438
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM87438%27 HTTP/1.1" 200 None
2026-03-28 14:02:21 [auto1.es] INFO: Scrape type for BM87438: 0
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: LD07198
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD07198%27 HTTP/1.1" 200 None
2026-03-28 14:02:21 [auto1.es] INFO: Scrape type for LD07198: 0
2026-03-28 14:02:21 [auto1.es] INFO: Found listing with ID: RB88414
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB88414%27 HTTP/1.1" 200 None
2026-03-28 14:02:21 [auto1.es] INFO: Scrape type for RB88414: 2
2026-03-28 14:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80fb015d-b8a7-5221-b705-cc0cca141b9e with identifier: RB88414
2026-03-28 14:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80fb015d-b8a7-5221-b705-cc0cca141b9e with scrape type 2
2026-03-28 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80fb015d-b8a7-5221-b705-cc0cca141b9e with scrape type 2
2026-03-28 14:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 80fb015d-b8a7-5221-b705-cc0cca141b9e, identifier: RB88414
2026-03-28 14:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 80fb015d-b8a7-5221-b705-cc0cca141b9e with identifier: RB88414
2026-03-28 14:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 80fb015d-b8a7-5221-b705-cc0cca141b9e with identifier: RB88414
2026-03-28 14:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 80fb015d-b8a7-5221-b705-cc0cca141b9e with identifier: RB88414 to the API
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:20:20Z',
 'fuel_type': 'gas',
 'id': '80fb015d-b8a7-5221-b705-cc0cca141b9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB88414',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 78770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-06',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2021}
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB88414%27 HTTP/1.1" 200 None
2026-03-28 14:02:22 [auto1.es] INFO: Saving data for RB88414: {'auction_closing_time': 1774714820.0, 'created_time': 1774522910.202137, 'last_price_update_time': 1774706542.303399}
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RB88414') HTTP/1.1" 204 0
2026-03-28 14:02:22 [auto1.es] INFO: Found listing with ID: RD88147
2026-03-28 14:02:22 [auto1.es] INFO: Found listing with ID: NF50225
2026-03-28 14:02:22 [auto1.es] INFO: Found listing with ID: HK38908
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK38908%27 HTTP/1.1" 200 None
2026-03-28 14:02:22 [auto1.es] INFO: Scrape type for HK38908: 0
2026-03-28 14:02:22 [auto1.es] INFO: Found listing with ID: BF57593
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF57593%27 HTTP/1.1" 200 None
2026-03-28 14:02:22 [auto1.es] INFO: Scrape type for BF57593: 0
2026-03-28 14:02:22 [auto1.es] INFO: Found listing with ID: DL26730
2026-03-28 14:02:22 [auto1.es] INFO: Found listing with ID: JR29098
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR29098%27 HTTP/1.1" 200 None
2026-03-28 14:02:22 [auto1.es] INFO: Scrape type for JR29098: 0
2026-03-28 14:02:22 [auto1.es] INFO: Found listing with ID: JB62304
2026-03-28 14:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:23 [auto1.es] INFO: Channel: 24h | Page: 25 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: SP20451
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: YE50848
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: VG19882
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG19882%27 HTTP/1.1" 200 None
2026-03-28 14:02:23 [auto1.es] INFO: Scrape type for VG19882: 0
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: YK51395
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: AG66489
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: HY26691
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: XB87201
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB87201%27 HTTP/1.1" 200 None
2026-03-28 14:02:23 [auto1.es] INFO: Scrape type for XB87201: 0
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: BX65620
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX65620%27 HTTP/1.1" 200 None
2026-03-28 14:02:23 [auto1.es] INFO: Scrape type for BX65620: 0
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: BF21105
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF21105%27 HTTP/1.1" 200 None
2026-03-28 14:02:23 [auto1.es] INFO: Scrape type for BF21105: 0
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: HT23405
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: ST42885
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: GF99536
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: UJ65320
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ65320%27 HTTP/1.1" 200 None
2026-03-28 14:02:23 [auto1.es] INFO: Scrape type for UJ65320: 0
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: RU65769
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU65769%27 HTTP/1.1" 200 None
2026-03-28 14:02:23 [auto1.es] INFO: Scrape type for RU65769: 0
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: WW31091
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: PT77544
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: YG72070
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: MM73463
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM73463%27 HTTP/1.1" 200 None
2026-03-28 14:02:23 [auto1.es] INFO: Scrape type for MM73463: 0
2026-03-28 14:02:23 [auto1.es] INFO: Found listing with ID: ZD58886
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD58886%27 HTTP/1.1" 200 None
2026-03-28 14:02:23 [auto1.es] INFO: Scrape type for ZD58886: 2
2026-03-28 14:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3930c4-1f1c-5bc9-ac79-f465f1e70d29 with identifier: ZD58886
2026-03-28 14:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3930c4-1f1c-5bc9-ac79-f465f1e70d29 with scrape type 2
2026-03-28 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be3930c4-1f1c-5bc9-ac79-f465f1e70d29 with scrape type 2
2026-03-28 14:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be3930c4-1f1c-5bc9-ac79-f465f1e70d29, identifier: ZD58886
2026-03-28 14:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be3930c4-1f1c-5bc9-ac79-f465f1e70d29 with identifier: ZD58886
2026-03-28 14:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be3930c4-1f1c-5bc9-ac79-f465f1e70d29 with identifier: ZD58886
2026-03-28 14:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be3930c4-1f1c-5bc9-ac79-f465f1e70d29 with identifier: ZD58886 to the API
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:28:51Z',
 'fuel_type': 'diesel',
 'id': 'be3930c4-1f1c-5bc9-ac79-f465f1e70d29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD58886',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 237444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-29',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD58886%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [auto1.es] INFO: Saving data for ZD58886: {'auction_closing_time': 1774715331.0, 'created_time': 1774522897.071035, 'last_price_update_time': 1774706544.247347}
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZD58886') HTTP/1.1" 204 0
2026-03-28 14:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: BX60688
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: DW27035
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW27035%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [auto1.es] INFO: Scrape type for DW27035: 0
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: EB96855
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: XJ69303
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: UY47592
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UY47592%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [auto1.es] INFO: Scrape type for UY47592: 0
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: HH46764
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: YB94347
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: NZ09379
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ09379%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [auto1.es] INFO: Scrape type for NZ09379: 0
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: XY25635
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: MN96118
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN96118%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [auto1.es] INFO: Scrape type for MN96118: 0
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: SL72652
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL72652%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [auto1.es] INFO: Scrape type for SL72652: 0
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: JP30275
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: BW95892
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW95892%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [auto1.es] INFO: Scrape type for BW95892: 0
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: HX96572
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX96572%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [auto1.es] INFO: Scrape type for HX96572: 0
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: JX80621
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX80621%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [auto1.es] INFO: Scrape type for JX80621: 0
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: SF77258
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: XR92407
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: NT36194
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: PU11377
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU11377%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [auto1.es] INFO: Scrape type for PU11377: 0
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: PC22199
2026-03-28 14:02:24 [auto1.es] INFO: Found listing with ID: AG75766
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG75766%27 HTTP/1.1" 200 None
2026-03-28 14:02:24 [auto1.es] INFO: Scrape type for AG75766: 0
2026-03-28 14:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:28 [auto1.es] INFO: Channel: 24h | Page: 26 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:28 [auto1.es] INFO: Found listing with ID: XY83185
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY83185%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [auto1.es] INFO: Scrape type for XY83185: 0
2026-03-28 14:02:28 [auto1.es] INFO: Found listing with ID: MW26851
2026-03-28 14:02:28 [auto1.es] INFO: Found listing with ID: ML17412
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML17412%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [auto1.es] INFO: Scrape type for ML17412: 0
2026-03-28 14:02:28 [auto1.es] INFO: Found listing with ID: BZ29136
2026-03-28 14:02:28 [auto1.es] INFO: Found listing with ID: BU72892
2026-03-28 14:02:28 [auto1.es] INFO: Found listing with ID: AB84528
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB84528%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [auto1.es] INFO: Scrape type for AB84528: 0
2026-03-28 14:02:28 [auto1.es] INFO: Found listing with ID: RC36042
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC36042%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [auto1.es] INFO: Scrape type for RC36042: 0
2026-03-28 14:02:28 [auto1.es] INFO: Found listing with ID: MK04112
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK04112%27 HTTP/1.1" 200 None
2026-03-28 14:02:28 [auto1.es] INFO: Scrape type for MK04112: 2
2026-03-28 14:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2fef962-1f21-5840-ae6c-5ae08eb8ec8a with identifier: MK04112
2026-03-28 14:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2fef962-1f21-5840-ae6c-5ae08eb8ec8a with scrape type 2
2026-03-28 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2fef962-1f21-5840-ae6c-5ae08eb8ec8a with scrape type 2
2026-03-28 14:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f2fef962-1f21-5840-ae6c-5ae08eb8ec8a, identifier: MK04112
2026-03-28 14:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f2fef962-1f21-5840-ae6c-5ae08eb8ec8a with identifier: MK04112
2026-03-28 14:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f2fef962-1f21-5840-ae6c-5ae08eb8ec8a with identifier: MK04112
2026-03-28 14:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f2fef962-1f21-5840-ae6c-5ae08eb8ec8a with identifier: MK04112 to the API
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:54:05Z',
 'fuel_type': 'diesel',
 'id': 'f2fef962-1f21-5840-ae6c-5ae08eb8ec8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK04112',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 153981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-31',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 2.0 HDi X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2005}
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK04112%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Saving data for MK04112: {'auction_closing_time': 1774716845.0, 'created_time': 1774522832.303785, 'last_price_update_time': 1774706549.098657}
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MK04112') HTTP/1.1" 204 0
2026-03-28 14:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: JX17367
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: KM36431
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: WC35260
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC35260%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for WC35260: 0
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: PX21457
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX21457%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for PX21457: 0
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: ZF10967
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: JK64156
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: RW45199
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW45199%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for RW45199: 0
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: BA78017
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA78017%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for BA78017: 0
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: WT17927
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT17927%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for WT17927: 0
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: JM88117
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM88117%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for JM88117: 0
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: NL01564
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL01564%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for NL01564: 0
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: GG08550
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG08550%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for GG08550: 0
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: VJ61689
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: MA92923
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA92923%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for MA92923: 2
2026-03-28 14:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d17e280-80d0-5b0d-932d-9decfff71329 with identifier: MA92923
2026-03-28 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d17e280-80d0-5b0d-932d-9decfff71329 with scrape type 2
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d17e280-80d0-5b0d-932d-9decfff71329 with scrape type 2
2026-03-28 14:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d17e280-80d0-5b0d-932d-9decfff71329, identifier: MA92923
2026-03-28 14:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d17e280-80d0-5b0d-932d-9decfff71329 with identifier: MA92923
2026-03-28 14:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d17e280-80d0-5b0d-932d-9decfff71329 with identifier: MA92923
2026-03-28 14:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d17e280-80d0-5b0d-932d-9decfff71329 with identifier: MA92923 to the API
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:55:08Z',
 'fuel_type': 'diesel',
 'id': '0d17e280-80d0-5b0d-932d-9decfff71329',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA92923',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 156268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-10',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA92923%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Saving data for MA92923: {'auction_closing_time': 1774716908.0, 'created_time': 1774522839.628459, 'last_price_update_time': 1774706549.802399}
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MA92923') HTTP/1.1" 204 0
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: MG47386
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG47386%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for MG47386: 0
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: UD80780
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD80780%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for UD80780: 0
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: BF82327
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF82327%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for BF82327: 0
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: MH30055
2026-03-28 14:02:29 [auto1.es] INFO: Found listing with ID: CE45579
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE45579%27 HTTP/1.1" 200 None
2026-03-28 14:02:29 [auto1.es] INFO: Scrape type for CE45579: 2
2026-03-28 14:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0db3beb9-2e89-561c-b010-4fcfe9709d41 with identifier: CE45579
2026-03-28 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0db3beb9-2e89-561c-b010-4fcfe9709d41 with scrape type 2
2026-03-28 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0db3beb9-2e89-561c-b010-4fcfe9709d41 with scrape type 2
2026-03-28 14:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0db3beb9-2e89-561c-b010-4fcfe9709d41, identifier: CE45579
2026-03-28 14:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0db3beb9-2e89-561c-b010-4fcfe9709d41 with identifier: CE45579
2026-03-28 14:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0db3beb9-2e89-561c-b010-4fcfe9709d41 with identifier: CE45579
2026-03-28 14:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0db3beb9-2e89-561c-b010-4fcfe9709d41 with identifier: CE45579 to the API
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-28T16:51:32Z',
 'fuel_type': 'petrol',
 'id': '0db3beb9-2e89-561c-b010-4fcfe9709d41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE45579',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 215656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-10',
 'seller_name': None,
 'title': 'BMW 3er 335i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE45579%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [auto1.es] INFO: Saving data for CE45579: {'auction_closing_time': 1774716692.0, 'created_time': 1774123254.376383, 'last_price_update_time': 1774706550.466542}
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CE45579') HTTP/1.1" 204 0
2026-03-28 14:02:30 [auto1.es] INFO: Found listing with ID: KS98335
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS98335%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [auto1.es] INFO: Scrape type for KS98335: 0
2026-03-28 14:02:30 [auto1.es] INFO: Found listing with ID: YL06778
2026-03-28 14:02:30 [auto1.es] INFO: Found listing with ID: SK01159
2026-03-28 14:02:30 [auto1.es] INFO: Found listing with ID: SS95298
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SS95298%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [auto1.es] INFO: Scrape type for SS95298: 0
2026-03-28 14:02:30 [auto1.es] INFO: Found listing with ID: PZ99435
2026-03-28 14:02:30 [auto1.es] INFO: Found listing with ID: AA63946
2026-03-28 14:02:30 [auto1.es] INFO: Found listing with ID: LL40861
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL40861%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [auto1.es] INFO: Scrape type for LL40861: 0
2026-03-28 14:02:30 [auto1.es] INFO: Found listing with ID: YL34665
2026-03-28 14:02:30 [auto1.es] INFO: Found listing with ID: VJ44998
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ44998%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [auto1.es] INFO: Scrape type for VJ44998: 0
2026-03-28 14:02:30 [auto1.es] INFO: Found listing with ID: XX41183
2026-03-28 14:02:30 [auto1.es] INFO: Found listing with ID: YH27551
2026-03-28 14:02:30 [auto1.es] INFO: Found listing with ID: SE78782
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE78782%27 HTTP/1.1" 200 None
2026-03-28 14:02:30 [auto1.es] INFO: Scrape type for SE78782: 2
2026-03-28 14:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd91056-5762-5b04-a788-9a63188d10f1 with identifier: SE78782
2026-03-28 14:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd91056-5762-5b04-a788-9a63188d10f1 with scrape type 2
2026-03-28 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd91056-5762-5b04-a788-9a63188d10f1 with scrape type 2
2026-03-28 14:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4fd91056-5762-5b04-a788-9a63188d10f1, identifier: SE78782
2026-03-28 14:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4fd91056-5762-5b04-a788-9a63188d10f1 with identifier: SE78782
2026-03-28 14:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4fd91056-5762-5b04-a788-9a63188d10f1 with identifier: SE78782
2026-03-28 14:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4fd91056-5762-5b04-a788-9a63188d10f1 with identifier: SE78782 to the API
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:47:44Z',
 'fuel_type': 'petrol',
 'id': '4fd91056-5762-5b04-a788-9a63188d10f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE78782',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 71603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-25',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2018}
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE78782%27 HTTP/1.1" 200 None
2026-03-28 14:02:31 [auto1.es] INFO: Saving data for SE78782: {'auction_closing_time': 1774716464.0, 'created_time': 1773131413.183141, 'last_price_update_time': 1774706551.357327}
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SE78782') HTTP/1.1" 204 0
2026-03-28 14:02:31 [auto1.es] INFO: Found listing with ID: RR55958
2026-03-28 14:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:32 [auto1.es] INFO: Channel: 24h | Page: 27 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: PD17011
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: EA52375
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA52375%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for EA52375: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: GG28459
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG28459%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for GG28459: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: HK75942
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK75942%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for HK75942: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: CZ94183
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: ZA55994
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: PC51622
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: SN64789
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: HK12855
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: JH04975
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH04975%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for JH04975: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: EN87990
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: XH57732
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH57732%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for XH57732: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: AK39366
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: KH58468
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH58468%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for KH58468: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: MG44284
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: SL52436
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL52436%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for SL52436: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: SR43030
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR43030%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for SR43030: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: KA53373
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: PF81025
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF81025%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for PF81025: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: ZP63371
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: YF13100
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: YR71719
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: YW89108
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW89108%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for YW89108: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: DW38851
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: GU69943
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU69943%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for GU69943: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: YU31002
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU31002%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for YU31002: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: NA15103
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: AV80298
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV80298%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for AV80298: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: WX54724
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX54724%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for WX54724: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: LC77404
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: NC39762
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: UJ64573
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ64573%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for UJ64573: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: PZ51501
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ51501%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for PZ51501: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: EV89991
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV89991%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for EV89991: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: YZ29146
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ29146%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for YZ29146: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: UD79775
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD79775%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for UD79775: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: LL26626
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL26626%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for LL26626: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: EG32676
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG32676%27 HTTP/1.1" 200 None
2026-03-28 14:02:32 [auto1.es] INFO: Scrape type for EG32676: 0
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: LJ17075
2026-03-28 14:02:32 [auto1.es] INFO: Found listing with ID: CN46922
2026-03-28 14:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:33 [auto1.es] INFO: Channel: 24h | Page: 28 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:33 [auto1.es] INFO: Found listing with ID: PU35155
2026-03-28 14:02:33 [auto1.es] INFO: Found listing with ID: GT40833
2026-03-28 14:02:33 [auto1.es] INFO: Found listing with ID: XZ52900
2026-03-28 14:02:33 [auto1.es] INFO: Found listing with ID: US62841
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US62841%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [auto1.es] INFO: Scrape type for US62841: 0
2026-03-28 14:02:33 [auto1.es] INFO: Found listing with ID: NF79265
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF79265%27 HTTP/1.1" 200 None
2026-03-28 14:02:33 [auto1.es] INFO: Scrape type for NF79265: 0
2026-03-28 14:02:33 [auto1.es] INFO: Found listing with ID: WT21682
2026-03-28 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT21682%27 HTTP/1.1" 200 None
2026-03-28 14:02:34 [auto1.es] INFO: Scrape type for WT21682: 0
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: CN05073
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN05073%27 HTTP/1.1" 200 None
2026-03-28 14:02:34 [auto1.es] INFO: Scrape type for CN05073: 0
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: VP11478
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: VG29597
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: GT09442
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT09442%27 HTTP/1.1" 200 None
2026-03-28 14:02:34 [auto1.es] INFO: Scrape type for GT09442: 2
2026-03-28 14:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 641c4e23-0c16-56c1-8b46-dc595ca4e907 with identifier: GT09442
2026-03-28 14:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 641c4e23-0c16-56c1-8b46-dc595ca4e907 with scrape type 2
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 641c4e23-0c16-56c1-8b46-dc595ca4e907 with scrape type 2
2026-03-28 14:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 641c4e23-0c16-56c1-8b46-dc595ca4e907, identifier: GT09442
2026-03-28 14:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 641c4e23-0c16-56c1-8b46-dc595ca4e907 with identifier: GT09442
2026-03-28 14:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 641c4e23-0c16-56c1-8b46-dc595ca4e907 with identifier: GT09442
2026-03-28 14:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 641c4e23-0c16-56c1-8b46-dc595ca4e907 with identifier: GT09442 to the API
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:19:49Z',
 'fuel_type': 'diesel',
 'id': '641c4e23-0c16-56c1-8b46-dc595ca4e907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT09442',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Commander',
 'odometer': 244269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-02',
 'seller_name': None,
 'title': 'Jeep Commander 3.0 CRD V6 Limited',
 'transmission': 'automatic',
 'trim': 'V6 Limited',
 'year': 2007}
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT09442%27 HTTP/1.1" 200 None
2026-03-28 14:02:34 [auto1.es] INFO: Saving data for GT09442: {'auction_closing_time': 1774714789.0, 'created_time': 1774522907.00951, 'last_price_update_time': 1774706554.485329}
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GT09442') HTTP/1.1" 204 0
2026-03-28 14:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: AY69334
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AY69334%27 HTTP/1.1" 200 None
2026-03-28 14:02:34 [auto1.es] INFO: Scrape type for AY69334: 0
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: ZT32060
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT32060%27 HTTP/1.1" 200 None
2026-03-28 14:02:34 [auto1.es] INFO: Scrape type for ZT32060: 0
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: PK17062
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK17062%27 HTTP/1.1" 200 None
2026-03-28 14:02:34 [auto1.es] INFO: Scrape type for PK17062: 0
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: YX85928
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX85928%27 HTTP/1.1" 200 None
2026-03-28 14:02:34 [auto1.es] INFO: Scrape type for YX85928: 0
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: JW07247
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: RE64316
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: RA16154
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA16154%27 HTTP/1.1" 200 None
2026-03-28 14:02:34 [auto1.es] INFO: Scrape type for RA16154: 0
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: AR88261
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR88261%27 HTTP/1.1" 200 None
2026-03-28 14:02:34 [auto1.es] INFO: Scrape type for AR88261: 0
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: YH68644
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: WA88394
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: PH91048
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH91048%27 HTTP/1.1" 200 None
2026-03-28 14:02:34 [auto1.es] INFO: Scrape type for PH91048: 0
2026-03-28 14:02:34 [auto1.es] INFO: Found listing with ID: AK44201
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK44201%27 HTTP/1.1" 200 None
2026-03-28 14:02:34 [auto1.es] INFO: Scrape type for AK44201: 2
2026-03-28 14:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4740f9f6-7618-5668-af4c-980e651da48a with identifier: AK44201
2026-03-28 14:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4740f9f6-7618-5668-af4c-980e651da48a with scrape type 2
2026-03-28 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4740f9f6-7618-5668-af4c-980e651da48a with scrape type 2
2026-03-28 14:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4740f9f6-7618-5668-af4c-980e651da48a, identifier: AK44201
2026-03-28 14:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4740f9f6-7618-5668-af4c-980e651da48a with identifier: AK44201
2026-03-28 14:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4740f9f6-7618-5668-af4c-980e651da48a with identifier: AK44201
2026-03-28 14:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4740f9f6-7618-5668-af4c-980e651da48a with identifier: AK44201 to the API
2026-03-28 14:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:43:52Z',
 'fuel_type': 'diesel',
 'id': '4740f9f6-7618-5668-af4c-980e651da48a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK44201',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 489462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-28',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 250 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK44201%27 HTTP/1.1" 200 None
2026-03-28 14:02:35 [auto1.es] INFO: Saving data for AK44201: {'auction_closing_time': 1774716232.0, 'created_time': 1774522869.10286, 'last_price_update_time': 1774706555.689965}
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AK44201') HTTP/1.1" 204 0
2026-03-28 14:02:35 [auto1.es] INFO: Found listing with ID: FH27641
2026-03-28 14:02:35 [auto1.es] INFO: Found listing with ID: EV12094
2026-03-28 14:02:35 [auto1.es] INFO: Found listing with ID: UY91237
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UY91237%27 HTTP/1.1" 200 None
2026-03-28 14:02:35 [auto1.es] INFO: Scrape type for UY91237: 0
2026-03-28 14:02:35 [auto1.es] INFO: Found listing with ID: AE81863
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE81863%27 HTTP/1.1" 200 None
2026-03-28 14:02:35 [auto1.es] INFO: Scrape type for AE81863: 0
2026-03-28 14:02:35 [auto1.es] INFO: Found listing with ID: CH38483
2026-03-28 14:02:35 [auto1.es] INFO: Found listing with ID: KJ28856
2026-03-28 14:02:35 [auto1.es] INFO: Found listing with ID: FE33802
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE33802%27 HTTP/1.1" 200 None
2026-03-28 14:02:35 [auto1.es] INFO: Scrape type for FE33802: 0
2026-03-28 14:02:35 [auto1.es] INFO: Found listing with ID: JC17966
2026-03-28 14:02:35 [auto1.es] INFO: Found listing with ID: XZ06121
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ06121%27 HTTP/1.1" 200 None
2026-03-28 14:02:35 [auto1.es] INFO: Scrape type for XZ06121: 0
2026-03-28 14:02:35 [auto1.es] INFO: Found listing with ID: HA53879
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA53879%27 HTTP/1.1" 200 None
2026-03-28 14:02:35 [auto1.es] INFO: Scrape type for HA53879: 0
2026-03-28 14:02:35 [auto1.es] INFO: Found listing with ID: KG68296
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG68296%27 HTTP/1.1" 200 None
2026-03-28 14:02:35 [auto1.es] INFO: Scrape type for KG68296: 0
2026-03-28 14:02:35 [auto1.es] INFO: Found listing with ID: AJ93581
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ93581%27 HTTP/1.1" 200 None
2026-03-28 14:02:35 [auto1.es] INFO: Scrape type for AJ93581: 2
2026-03-28 14:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9f76051-c605-5f58-a392-aacd791a3d9c with identifier: AJ93581
2026-03-28 14:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9f76051-c605-5f58-a392-aacd791a3d9c with scrape type 2
2026-03-28 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9f76051-c605-5f58-a392-aacd791a3d9c with scrape type 2
2026-03-28 14:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9f76051-c605-5f58-a392-aacd791a3d9c, identifier: AJ93581
2026-03-28 14:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9f76051-c605-5f58-a392-aacd791a3d9c with identifier: AJ93581
2026-03-28 14:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9f76051-c605-5f58-a392-aacd791a3d9c with identifier: AJ93581
2026-03-28 14:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f9f76051-c605-5f58-a392-aacd791a3d9c with identifier: AJ93581 to the API
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:17:55Z',
 'fuel_type': 'diesel',
 'id': 'f9f76051-c605-5f58-a392-aacd791a3d9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ93581',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 100471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ93581%27 HTTP/1.1" 200 None
2026-03-28 14:02:36 [auto1.es] INFO: Saving data for AJ93581: {'auction_closing_time': 1774714675.0, 'created_time': 1773932269.727731, 'last_price_update_time': 1774706556.416256}
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AJ93581') HTTP/1.1" 204 0
2026-03-28 14:02:36 [auto1.es] INFO: Found listing with ID: UR41471
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR41471%27 HTTP/1.1" 200 None
2026-03-28 14:02:36 [auto1.es] INFO: Scrape type for UR41471: 0
2026-03-28 14:02:36 [auto1.es] INFO: Found listing with ID: LL30707
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL30707%27 HTTP/1.1" 200 None
2026-03-28 14:02:36 [auto1.es] INFO: Scrape type for LL30707: 0
2026-03-28 14:02:36 [auto1.es] INFO: Found listing with ID: CN83416
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN83416%27 HTTP/1.1" 200 None
2026-03-28 14:02:36 [auto1.es] INFO: Scrape type for CN83416: 0
2026-03-28 14:02:36 [auto1.es] INFO: Found listing with ID: DE85844
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE85844%27 HTTP/1.1" 200 None
2026-03-28 14:02:36 [auto1.es] INFO: Scrape type for DE85844: 0
2026-03-28 14:02:36 [auto1.es] INFO: Found listing with ID: KX46751
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX46751%27 HTTP/1.1" 200 None
2026-03-28 14:02:36 [auto1.es] INFO: Scrape type for KX46751: 0
2026-03-28 14:02:36 [auto1.es] INFO: Found listing with ID: VV79755
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV79755%27 HTTP/1.1" 200 None
2026-03-28 14:02:36 [auto1.es] INFO: Scrape type for VV79755: 0
2026-03-28 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:37 [auto1.es] INFO: Channel: 24h | Page: 29 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: BV16371
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV16371%27 HTTP/1.1" 200 None
2026-03-28 14:02:37 [auto1.es] INFO: Scrape type for BV16371: 0
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: WL52368
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: SJ53715
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ53715%27 HTTP/1.1" 200 None
2026-03-28 14:02:37 [auto1.es] INFO: Scrape type for SJ53715: 0
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: SM68144
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM68144%27 HTTP/1.1" 200 None
2026-03-28 14:02:37 [auto1.es] INFO: Scrape type for SM68144: 0
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: RC81564
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC81564%27 HTTP/1.1" 200 None
2026-03-28 14:02:37 [auto1.es] INFO: Scrape type for RC81564: 0
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: RJ81343
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: LK68537
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: VU28227
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: ZA80784
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: PN97483
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN97483%27 HTTP/1.1" 200 None
2026-03-28 14:02:37 [auto1.es] INFO: Scrape type for PN97483: 0
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: YZ97545
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ97545%27 HTTP/1.1" 200 None
2026-03-28 14:02:37 [auto1.es] INFO: Scrape type for YZ97545: 0
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: BY18698
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: DR12042
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR12042%27 HTTP/1.1" 200 None
2026-03-28 14:02:37 [auto1.es] INFO: Scrape type for DR12042: 0
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: EG74552
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG74552%27 HTTP/1.1" 200 None
2026-03-28 14:02:37 [auto1.es] INFO: Scrape type for EG74552: 0
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: UH51284
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH51284%27 HTTP/1.1" 200 None
2026-03-28 14:02:37 [auto1.es] INFO: Scrape type for UH51284: 0
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: MJ33537
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: EB93661
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB93661%27 HTTP/1.1" 200 None
2026-03-28 14:02:37 [auto1.es] INFO: Scrape type for EB93661: 0
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: HJ75824
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: DJ31574
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ31574%27 HTTP/1.1" 200 None
2026-03-28 14:02:37 [auto1.es] INFO: Scrape type for DJ31574: 0
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: MX73277
2026-03-28 14:02:37 [auto1.es] INFO: Found listing with ID: KC46578
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC46578%27 HTTP/1.1" 200 None
2026-03-28 14:02:37 [auto1.es] INFO: Scrape type for KC46578: 2
2026-03-28 14:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b1b2e14-dcf1-5edb-bda4-593d45626708 with identifier: KC46578
2026-03-28 14:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1b2e14-dcf1-5edb-bda4-593d45626708 with scrape type 2
2026-03-28 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b1b2e14-dcf1-5edb-bda4-593d45626708 with scrape type 2
2026-03-28 14:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0b1b2e14-dcf1-5edb-bda4-593d45626708, identifier: KC46578
2026-03-28 14:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0b1b2e14-dcf1-5edb-bda4-593d45626708 with identifier: KC46578
2026-03-28 14:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0b1b2e14-dcf1-5edb-bda4-593d45626708 with identifier: KC46578
2026-03-28 14:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0b1b2e14-dcf1-5edb-bda4-593d45626708 with identifier: KC46578 to the API
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:07:04Z',
 'fuel_type': 'diesel',
 'id': '0b1b2e14-dcf1-5edb-bda4-593d45626708',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC46578',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 150231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-25',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2011}
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC46578%27 HTTP/1.1" 200 None
2026-03-28 14:02:38 [auto1.es] INFO: Saving data for KC46578: {'auction_closing_time': 1774714024.0, 'created_time': 1774522876.0827, 'last_price_update_time': 1774706558.407517}
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KC46578') HTTP/1.1" 204 0
2026-03-28 14:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:38 [auto1.es] INFO: Found listing with ID: HC34911
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC34911%27 HTTP/1.1" 200 None
2026-03-28 14:02:38 [auto1.es] INFO: Scrape type for HC34911: 0
2026-03-28 14:02:38 [auto1.es] INFO: Found listing with ID: RV14392
2026-03-28 14:02:38 [auto1.es] INFO: Found listing with ID: PN16892
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN16892%27 HTTP/1.1" 200 None
2026-03-28 14:02:38 [auto1.es] INFO: Scrape type for PN16892: 0
2026-03-28 14:02:38 [auto1.es] INFO: Found listing with ID: SY91056
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY91056%27 HTTP/1.1" 200 None
2026-03-28 14:02:38 [auto1.es] INFO: Scrape type for SY91056: 0
2026-03-28 14:02:38 [auto1.es] INFO: Found listing with ID: DH89256
2026-03-28 14:02:38 [auto1.es] INFO: Found listing with ID: YS60567
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS60567%27 HTTP/1.1" 200 None
2026-03-28 14:02:38 [auto1.es] INFO: Scrape type for YS60567: 0
2026-03-28 14:02:38 [auto1.es] INFO: Found listing with ID: VL93613
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL93613%27 HTTP/1.1" 200 None
2026-03-28 14:02:38 [auto1.es] INFO: Scrape type for VL93613: 0
2026-03-28 14:02:38 [auto1.es] INFO: Found listing with ID: ZR59289
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR59289%27 HTTP/1.1" 200 None
2026-03-28 14:02:38 [auto1.es] INFO: Scrape type for ZR59289: 0
2026-03-28 14:02:38 [auto1.es] INFO: Found listing with ID: WA75456
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA75456%27 HTTP/1.1" 200 None
2026-03-28 14:02:38 [auto1.es] INFO: Scrape type for WA75456: 2
2026-03-28 14:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4eb9b0c-a6e8-54b8-9b4e-b8f60e6a29dd with identifier: WA75456
2026-03-28 14:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4eb9b0c-a6e8-54b8-9b4e-b8f60e6a29dd with scrape type 2
2026-03-28 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4eb9b0c-a6e8-54b8-9b4e-b8f60e6a29dd with scrape type 2
2026-03-28 14:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4eb9b0c-a6e8-54b8-9b4e-b8f60e6a29dd, identifier: WA75456
2026-03-28 14:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4eb9b0c-a6e8-54b8-9b4e-b8f60e6a29dd with identifier: WA75456
2026-03-28 14:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4eb9b0c-a6e8-54b8-9b4e-b8f60e6a29dd with identifier: WA75456
2026-03-28 14:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e4eb9b0c-a6e8-54b8-9b4e-b8f60e6a29dd with identifier: WA75456 to the API
2026-03-28 14:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:18Z',
 'fuel_type': 'petrol',
 'id': 'e4eb9b0c-a6e8-54b8-9b4e-b8f60e6a29dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA75456',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 78655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-25',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Klass 2WD',
 'transmission': 'manual',
 'trim': 'Klass 2WD',
 'year': 2022}
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA75456%27 HTTP/1.1" 200 None
2026-03-28 14:02:39 [auto1.es] INFO: Saving data for WA75456: {'auction_closing_time': 1774714518.0, 'created_time': 1773238570.339663, 'last_price_update_time': 1774706559.151134}
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WA75456') HTTP/1.1" 204 0
2026-03-28 14:02:39 [auto1.es] INFO: Found listing with ID: PU00730
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU00730%27 HTTP/1.1" 200 None
2026-03-28 14:02:39 [auto1.es] INFO: Scrape type for PU00730: 0
2026-03-28 14:02:39 [auto1.es] INFO: Found listing with ID: GJ83927
2026-03-28 14:02:39 [auto1.es] INFO: Found listing with ID: PK46399
2026-03-28 14:02:39 [auto1.es] INFO: Found listing with ID: CZ41335
2026-03-28 14:02:39 [auto1.es] INFO: Found listing with ID: XJ15260
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ15260%27 HTTP/1.1" 200 None
2026-03-28 14:02:39 [auto1.es] INFO: Scrape type for XJ15260: 0
2026-03-28 14:02:39 [auto1.es] INFO: Found listing with ID: TL40717
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL40717%27 HTTP/1.1" 200 None
2026-03-28 14:02:39 [auto1.es] INFO: Scrape type for TL40717: 0
2026-03-28 14:02:39 [auto1.es] INFO: Found listing with ID: MR15790
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR15790%27 HTTP/1.1" 200 None
2026-03-28 14:02:39 [auto1.es] INFO: Scrape type for MR15790: 0
2026-03-28 14:02:39 [auto1.es] INFO: Found listing with ID: SG19170
2026-03-28 14:02:39 [auto1.es] INFO: Found listing with ID: JB47197
2026-03-28 14:02:39 [auto1.es] INFO: Found listing with ID: LS97770
2026-03-28 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:40 [auto1.es] INFO: Channel: 24h | Page: 30 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: ME02001
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: AV97332
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV97332%27 HTTP/1.1" 200 None
2026-03-28 14:02:40 [auto1.es] INFO: Scrape type for AV97332: 0
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: YC67931
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC67931%27 HTTP/1.1" 200 None
2026-03-28 14:02:40 [auto1.es] INFO: Scrape type for YC67931: 0
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: TM54521
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: NE32180
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: EW19678
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: CJ74975
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: CW02489
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: UX78126
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX78126%27 HTTP/1.1" 200 None
2026-03-28 14:02:40 [auto1.es] INFO: Scrape type for UX78126: 0
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: VV06777
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: ZM36181
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: NJ25414
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: CP72287
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP72287%27 HTTP/1.1" 200 None
2026-03-28 14:02:40 [auto1.es] INFO: Scrape type for CP72287: 0
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: ES00256
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES00256%27 HTTP/1.1" 200 None
2026-03-28 14:02:40 [auto1.es] INFO: Scrape type for ES00256: 0
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: WG83508
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: JG83987
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: LE44410
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: VC68158
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: WW30264
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: SK17439
2026-03-28 14:02:40 [auto1.es] INFO: Found listing with ID: FC08911
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC08911%27 HTTP/1.1" 200 None
2026-03-28 14:02:40 [auto1.es] INFO: Scrape type for FC08911: 2
2026-03-28 14:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ddb53f2-c47a-56ba-a733-5e38740c3c38 with identifier: FC08911
2026-03-28 14:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ddb53f2-c47a-56ba-a733-5e38740c3c38 with scrape type 2
2026-03-28 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ddb53f2-c47a-56ba-a733-5e38740c3c38 with scrape type 2
2026-03-28 14:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9ddb53f2-c47a-56ba-a733-5e38740c3c38, identifier: FC08911
2026-03-28 14:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9ddb53f2-c47a-56ba-a733-5e38740c3c38 with identifier: FC08911
2026-03-28 14:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9ddb53f2-c47a-56ba-a733-5e38740c3c38 with identifier: FC08911
2026-03-28 14:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9ddb53f2-c47a-56ba-a733-5e38740c3c38 with identifier: FC08911 to the API
2026-03-28 14:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:58:20Z',
 'fuel_type': 'diesel',
 'id': '9ddb53f2-c47a-56ba-a733-5e38740c3c38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC08911',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 47337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC08911%27 HTTP/1.1" 200 None
2026-03-28 14:02:41 [auto1.es] INFO: Saving data for FC08911: {'auction_closing_time': 1774717100.0, 'created_time': 1773907233.149562, 'last_price_update_time': 1774706561.161858}
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FC08911') HTTP/1.1" 204 0
2026-03-28 14:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:41 [auto1.es] INFO: Found listing with ID: TJ87450
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ87450%27 HTTP/1.1" 200 None
2026-03-28 14:02:41 [auto1.es] INFO: Scrape type for TJ87450: 0
2026-03-28 14:02:41 [auto1.es] INFO: Found listing with ID: JY07683
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY07683%27 HTTP/1.1" 200 None
2026-03-28 14:02:41 [auto1.es] INFO: Scrape type for JY07683: 2
2026-03-28 14:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9299c687-a092-56e7-a322-4c4604fd3833 with identifier: JY07683
2026-03-28 14:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9299c687-a092-56e7-a322-4c4604fd3833 with scrape type 2
2026-03-28 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9299c687-a092-56e7-a322-4c4604fd3833 with scrape type 2
2026-03-28 14:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9299c687-a092-56e7-a322-4c4604fd3833, identifier: JY07683
2026-03-28 14:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9299c687-a092-56e7-a322-4c4604fd3833 with identifier: JY07683
2026-03-28 14:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9299c687-a092-56e7-a322-4c4604fd3833 with identifier: JY07683
2026-03-28 14:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9299c687-a092-56e7-a322-4c4604fd3833 with identifier: JY07683 to the API
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:39:25Z',
 'fuel_type': 'petrol',
 'id': '9299c687-a092-56e7-a322-4c4604fd3833',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY07683',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 79891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-20',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.2 e-THP Feel Edition',
 'transmission': 'manual',
 'trim': 'Feel Edition',
 'year': 2017}
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY07683%27 HTTP/1.1" 200 None
2026-03-28 14:02:41 [auto1.es] INFO: Saving data for JY07683: {'auction_closing_time': 1774715965.0, 'created_time': 1774522842.513172, 'last_price_update_time': 1774706561.935372}
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JY07683') HTTP/1.1" 204 0
2026-03-28 14:02:41 [auto1.es] INFO: Found listing with ID: ET27583
2026-03-28 14:02:41 [auto1.es] INFO: Found listing with ID: RF10879
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF10879%27 HTTP/1.1" 200 None
2026-03-28 14:02:41 [auto1.es] INFO: Scrape type for RF10879: 0
2026-03-28 14:02:41 [auto1.es] INFO: Found listing with ID: SR01470
2026-03-28 14:02:41 [auto1.es] INFO: Found listing with ID: JC88561
2026-03-28 14:02:41 [auto1.es] INFO: Found listing with ID: ZV35449
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV35449%27 HTTP/1.1" 200 None
2026-03-28 14:02:41 [auto1.es] INFO: Scrape type for ZV35449: 0
2026-03-28 14:02:41 [auto1.es] INFO: Found listing with ID: DL51279
2026-03-28 14:02:41 [auto1.es] INFO: Found listing with ID: UC09258
2026-03-28 14:02:41 [auto1.es] INFO: Found listing with ID: HK88265
2026-03-28 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK88265%27 HTTP/1.1" 200 None
2026-03-28 14:02:42 [auto1.es] INFO: Scrape type for HK88265: 0
2026-03-28 14:02:42 [auto1.es] INFO: Found listing with ID: CX27112
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX27112%27 HTTP/1.1" 200 None
2026-03-28 14:02:42 [auto1.es] INFO: Scrape type for CX27112: 0
2026-03-28 14:02:42 [auto1.es] INFO: Found listing with ID: DG13081
2026-03-28 14:02:42 [auto1.es] INFO: Found listing with ID: YH51861
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH51861%27 HTTP/1.1" 200 None
2026-03-28 14:02:42 [auto1.es] INFO: Scrape type for YH51861: 0
2026-03-28 14:02:42 [auto1.es] INFO: Found listing with ID: YD66722
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD66722%27 HTTP/1.1" 200 None
2026-03-28 14:02:42 [auto1.es] INFO: Scrape type for YD66722: 0
2026-03-28 14:02:42 [auto1.es] INFO: Found listing with ID: UB76587
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB76587%27 HTTP/1.1" 200 None
2026-03-28 14:02:42 [auto1.es] INFO: Scrape type for UB76587: 0
2026-03-28 14:02:42 [auto1.es] INFO: Found listing with ID: YU72281
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU72281%27 HTTP/1.1" 200 None
2026-03-28 14:02:42 [auto1.es] INFO: Scrape type for YU72281: 0
2026-03-28 14:02:42 [auto1.es] INFO: Found listing with ID: TW45528
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW45528%27 HTTP/1.1" 200 None
2026-03-28 14:02:42 [auto1.es] INFO: Scrape type for TW45528: 0
2026-03-28 14:02:42 [auto1.es] INFO: Found listing with ID: CD57804
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD57804%27 HTTP/1.1" 200 None
2026-03-28 14:02:42 [auto1.es] INFO: Scrape type for CD57804: 2
2026-03-28 14:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 599d5f73-3b03-5297-9095-2c54be34748b with identifier: CD57804
2026-03-28 14:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 599d5f73-3b03-5297-9095-2c54be34748b with scrape type 2
2026-03-28 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 599d5f73-3b03-5297-9095-2c54be34748b with scrape type 2
2026-03-28 14:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 599d5f73-3b03-5297-9095-2c54be34748b, identifier: CD57804
2026-03-28 14:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 599d5f73-3b03-5297-9095-2c54be34748b with identifier: CD57804
2026-03-28 14:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 599d5f73-3b03-5297-9095-2c54be34748b with identifier: CD57804
2026-03-28 14:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 599d5f73-3b03-5297-9095-2c54be34748b with identifier: CD57804 to the API
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:07:07Z',
 'fuel_type': 'diesel',
 'id': '599d5f73-3b03-5297-9095-2c54be34748b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD57804',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 324962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-29',
 'seller_name': None,
 'title': 'Seat Altea 1.9 TDI Stylance Style',
 'transmission': 'manual',
 'trim': 'Stylance Style',
 'year': 2007}
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD57804%27 HTTP/1.1" 200 None
2026-03-28 14:02:42 [auto1.es] INFO: Saving data for CD57804: {'auction_closing_time': 1774714027.0, 'created_time': 1774296243.46536, 'last_price_update_time': 1774706562.540513}
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CD57804') HTTP/1.1" 204 0
2026-03-28 14:02:42 [auto1.es] INFO: Found listing with ID: GZ44252
2026-03-28 14:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:43 [auto1.es] INFO: Channel: 24h | Page: 31 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: RT90695
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: BC37690
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: YH03872
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH03872%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for YH03872: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: AD89683
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: TH72342
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: GW16894
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: TA62942
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: XY35870
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY35870%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for XY35870: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: WK84423
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK84423%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for WK84423: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: NL09405
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL09405%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for NL09405: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: VY26684
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY26684%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for VY26684: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: DG34195
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG34195%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for DG34195: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: YF57320
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: DP90373
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: CY07348
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: SX15472
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX15472%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for SX15472: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: BF55946
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: SN05044
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: PD75300
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: ZL27133
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL27133%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for ZL27133: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: VR01411
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: GA11784
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: XN31464
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: AG74382
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: FA05527
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA05527%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for FA05527: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: KD95768
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: ZC95482
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC95482%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for ZC95482: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: EY10319
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY10319%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for EY10319: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: KN38404
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: MY11525
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: WC31368
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: GY52926
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY52926%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for GY52926: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: PK04858
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK04858%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for PK04858: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: YC45232
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC45232%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for YC45232: 0
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: RN76428
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: VZ27900
2026-03-28 14:02:43 [auto1.es] INFO: Found listing with ID: MW68540
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW68540%27 HTTP/1.1" 200 None
2026-03-28 14:02:43 [auto1.es] INFO: Scrape type for MW68540: 2
2026-03-28 14:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe378250-a9d6-52eb-8385-19b16a2ea0af with identifier: MW68540
2026-03-28 14:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe378250-a9d6-52eb-8385-19b16a2ea0af with scrape type 2
2026-03-28 14:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe378250-a9d6-52eb-8385-19b16a2ea0af with scrape type 2
2026-03-28 14:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fe378250-a9d6-52eb-8385-19b16a2ea0af, identifier: MW68540
2026-03-28 14:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fe378250-a9d6-52eb-8385-19b16a2ea0af with identifier: MW68540
2026-03-28 14:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fe378250-a9d6-52eb-8385-19b16a2ea0af with identifier: MW68540
2026-03-28 14:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fe378250-a9d6-52eb-8385-19b16a2ea0af with identifier: MW68540 to the API
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:26:18Z',
 'fuel_type': 'diesel',
 'id': 'fe378250-a9d6-52eb-8385-19b16a2ea0af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW68540',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 264212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-31',
 'seller_name': None,
 'title': 'Audi Q5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW68540%27 HTTP/1.1" 200 None
2026-03-28 14:02:44 [auto1.es] INFO: Saving data for MW68540: {'auction_closing_time': 1774715178.0, 'created_time': 1774522864.764187, 'last_price_update_time': 1774706564.327209}
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MW68540') HTTP/1.1" 204 0
2026-03-28 14:02:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:44 [auto1.es] INFO: Found listing with ID: VM02811
2026-03-28 14:02:44 [auto1.es] INFO: Found listing with ID: SA97364
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA97364%27 HTTP/1.1" 200 None
2026-03-28 14:02:44 [auto1.es] INFO: Scrape type for SA97364: 2
2026-03-28 14:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42039778-45d3-5a39-960b-1809491478d4 with identifier: SA97364
2026-03-28 14:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42039778-45d3-5a39-960b-1809491478d4 with scrape type 2
2026-03-28 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42039778-45d3-5a39-960b-1809491478d4 with scrape type 2
2026-03-28 14:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 42039778-45d3-5a39-960b-1809491478d4, identifier: SA97364
2026-03-28 14:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 42039778-45d3-5a39-960b-1809491478d4 with identifier: SA97364
2026-03-28 14:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 42039778-45d3-5a39-960b-1809491478d4 with identifier: SA97364
2026-03-28 14:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 42039778-45d3-5a39-960b-1809491478d4 with identifier: SA97364 to the API
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:35:59Z',
 'fuel_type': 'diesel',
 'id': '42039778-45d3-5a39-960b-1809491478d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA97364',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 287725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-10',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2007}
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA97364%27 HTTP/1.1" 200 None
2026-03-28 14:02:44 [auto1.es] INFO: Saving data for SA97364: {'auction_closing_time': 1774715759.0, 'created_time': 1774522842.011535, 'last_price_update_time': 1774706564.949915}
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SA97364') HTTP/1.1" 204 0
2026-03-28 14:02:44 [auto1.es] INFO: Found listing with ID: UN48469
2026-03-28 14:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:45 [auto1.es] INFO: Channel: 24h | Page: 32 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:45 [auto1.es] INFO: Found listing with ID: NA86164
2026-03-28 14:02:45 [auto1.es] INFO: Found listing with ID: SW69088
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW69088%27 HTTP/1.1" 200 None
2026-03-28 14:02:45 [auto1.es] INFO: Scrape type for SW69088: 0
2026-03-28 14:02:45 [auto1.es] INFO: Found listing with ID: BW81200
2026-03-28 14:02:45 [auto1.es] INFO: Found listing with ID: AR07470
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR07470%27 HTTP/1.1" 200 None
2026-03-28 14:02:45 [auto1.es] INFO: Scrape type for AR07470: 0
2026-03-28 14:02:45 [auto1.es] INFO: Found listing with ID: FD93505
2026-03-28 14:02:45 [auto1.es] INFO: Found listing with ID: VC05043
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC05043%27 HTTP/1.1" 200 None
2026-03-28 14:02:45 [auto1.es] INFO: Scrape type for VC05043: 0
2026-03-28 14:02:45 [auto1.es] INFO: Found listing with ID: PW99692
2026-03-28 14:02:45 [auto1.es] INFO: Found listing with ID: VY79156
2026-03-28 14:02:45 [auto1.es] INFO: Found listing with ID: MV66149
2026-03-28 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV66149%27 HTTP/1.1" 200 None
2026-03-28 14:02:46 [auto1.es] INFO: Scrape type for MV66149: 0
2026-03-28 14:02:46 [auto1.es] INFO: Found listing with ID: GR78945
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR78945%27 HTTP/1.1" 200 None
2026-03-28 14:02:46 [auto1.es] INFO: Scrape type for GR78945: 0
2026-03-28 14:02:46 [auto1.es] INFO: Found listing with ID: SJ56624
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ56624%27 HTTP/1.1" 200 None
2026-03-28 14:02:46 [auto1.es] INFO: Scrape type for SJ56624: 0
2026-03-28 14:02:46 [auto1.es] INFO: Found listing with ID: ZL69555
2026-03-28 14:02:46 [auto1.es] INFO: Found listing with ID: JC19208
2026-03-28 14:02:46 [auto1.es] INFO: Found listing with ID: VS82741
2026-03-28 14:02:46 [auto1.es] INFO: Found listing with ID: NY33487
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY33487%27 HTTP/1.1" 200 None
2026-03-28 14:02:46 [auto1.es] INFO: Scrape type for NY33487: 2
2026-03-28 14:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9590efb-01a1-519d-853e-ba84ff0c0636 with identifier: NY33487
2026-03-28 14:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9590efb-01a1-519d-853e-ba84ff0c0636 with scrape type 2
2026-03-28 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9590efb-01a1-519d-853e-ba84ff0c0636 with scrape type 2
2026-03-28 14:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d9590efb-01a1-519d-853e-ba84ff0c0636, identifier: NY33487
2026-03-28 14:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d9590efb-01a1-519d-853e-ba84ff0c0636 with identifier: NY33487
2026-03-28 14:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d9590efb-01a1-519d-853e-ba84ff0c0636 with identifier: NY33487
2026-03-28 14:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d9590efb-01a1-519d-853e-ba84ff0c0636 with identifier: NY33487 to the API
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:11:43Z',
 'fuel_type': 'petrol',
 'id': 'd9590efb-01a1-519d-853e-ba84ff0c0636',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY33487',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 27879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2022}
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY33487%27 HTTP/1.1" 200 None
2026-03-28 14:02:46 [auto1.es] INFO: Saving data for NY33487: {'auction_closing_time': 1774714303.0, 'created_time': 1774522886.519523, 'last_price_update_time': 1774706566.53992}
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NY33487') HTTP/1.1" 204 0
2026-03-28 14:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:46 [auto1.es] INFO: Found listing with ID: CH02568
2026-03-28 14:02:46 [auto1.es] INFO: Found listing with ID: YA31535
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA31535%27 HTTP/1.1" 200 None
2026-03-28 14:02:46 [auto1.es] INFO: Scrape type for YA31535: 0
2026-03-28 14:02:46 [auto1.es] INFO: Found listing with ID: KD09714
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD09714%27 HTTP/1.1" 200 None
2026-03-28 14:02:46 [auto1.es] INFO: Scrape type for KD09714: 2
2026-03-28 14:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98f73f3b-9686-5efc-a93f-b693871eec93 with identifier: KD09714
2026-03-28 14:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98f73f3b-9686-5efc-a93f-b693871eec93 with scrape type 2
2026-03-28 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98f73f3b-9686-5efc-a93f-b693871eec93 with scrape type 2
2026-03-28 14:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 98f73f3b-9686-5efc-a93f-b693871eec93, identifier: KD09714
2026-03-28 14:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 98f73f3b-9686-5efc-a93f-b693871eec93 with identifier: KD09714
2026-03-28 14:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 98f73f3b-9686-5efc-a93f-b693871eec93 with identifier: KD09714
2026-03-28 14:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 98f73f3b-9686-5efc-a93f-b693871eec93 with identifier: KD09714 to the API
2026-03-28 14:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:12:10Z',
 'fuel_type': 'diesel',
 'id': '98f73f3b-9686-5efc-a93f-b693871eec93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD09714',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 120533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-18',
 'seller_name': None,
 'title': 'Jaguar F-Pace 25d Pure AWD',
 'transmission': 'automatic',
 'trim': 'Pure AWD',
 'year': 2017}
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD09714%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Saving data for KD09714: {'auction_closing_time': 1774714330.0, 'created_time': 1774522858.154342, 'last_price_update_time': 1774706567.129525}
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KD09714') HTTP/1.1" 204 0
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: RW57284
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: MJ10048
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: TF35206
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: YL41788
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL41788%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Scrape type for YL41788: 0
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: CC73171
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC73171%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Scrape type for CC73171: 0
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: EN74570
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN74570%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Scrape type for EN74570: 0
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: BM81559
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM81559%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Scrape type for BM81559: 2
2026-03-28 14:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a6e80fe-2cfe-5292-a8e7-0acb9fdb1dc2 with identifier: BM81559
2026-03-28 14:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a6e80fe-2cfe-5292-a8e7-0acb9fdb1dc2 with scrape type 2
2026-03-28 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a6e80fe-2cfe-5292-a8e7-0acb9fdb1dc2 with scrape type 2
2026-03-28 14:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1a6e80fe-2cfe-5292-a8e7-0acb9fdb1dc2, identifier: BM81559
2026-03-28 14:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1a6e80fe-2cfe-5292-a8e7-0acb9fdb1dc2 with identifier: BM81559
2026-03-28 14:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1a6e80fe-2cfe-5292-a8e7-0acb9fdb1dc2 with identifier: BM81559
2026-03-28 14:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1a6e80fe-2cfe-5292-a8e7-0acb9fdb1dc2 with identifier: BM81559 to the API
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:58:45Z',
 'fuel_type': 'diesel',
 'id': '1a6e80fe-2cfe-5292-a8e7-0acb9fdb1dc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM81559',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 168499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-25',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2010}
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM81559%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Saving data for BM81559: {'auction_closing_time': 1774717125.0, 'created_time': 1773130398.073608, 'last_price_update_time': 1774706567.644774}
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BM81559') HTTP/1.1" 204 0
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: KY27191
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: GY66563
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY66563%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Scrape type for GY66563: 0
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: EW34917
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW34917%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Scrape type for EW34917: 0
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: WC51146
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC51146%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Scrape type for WC51146: 0
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: EX52175
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX52175%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Scrape type for EX52175: 0
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: KL17939
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: YG24338
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: NB11190
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB11190%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Scrape type for NB11190: 0
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: FH47587
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: FS24848
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: JB29857
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB29857%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Scrape type for JB29857: 0
2026-03-28 14:02:47 [auto1.es] INFO: Found listing with ID: ZN14981
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN14981%27 HTTP/1.1" 200 None
2026-03-28 14:02:47 [auto1.es] INFO: Scrape type for ZN14981: 2
2026-03-28 14:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39120bc7-0281-5045-bafc-9c9d0cc8b5ab with identifier: ZN14981
2026-03-28 14:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39120bc7-0281-5045-bafc-9c9d0cc8b5ab with scrape type 2
2026-03-28 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39120bc7-0281-5045-bafc-9c9d0cc8b5ab with scrape type 2
2026-03-28 14:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 39120bc7-0281-5045-bafc-9c9d0cc8b5ab, identifier: ZN14981
2026-03-28 14:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 39120bc7-0281-5045-bafc-9c9d0cc8b5ab with identifier: ZN14981
2026-03-28 14:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 39120bc7-0281-5045-bafc-9c9d0cc8b5ab with identifier: ZN14981
2026-03-28 14:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 39120bc7-0281-5045-bafc-9c9d0cc8b5ab with identifier: ZN14981 to the API
2026-03-28 14:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:06:01Z',
 'fuel_type': 'diesel',
 'id': '39120bc7-0281-5045-bafc-9c9d0cc8b5ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN14981',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 191206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-24',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN14981%27 HTTP/1.1" 200 None
2026-03-28 14:02:48 [auto1.es] INFO: Saving data for ZN14981: {'auction_closing_time': 1774713961.0, 'created_time': 1774522855.208706, 'last_price_update_time': 1774706568.247144}
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZN14981') HTTP/1.1" 204 0
2026-03-28 14:02:48 [auto1.es] INFO: Found listing with ID: VE17467
2026-03-28 14:02:48 [auto1.es] INFO: Found listing with ID: ZB98870
2026-03-28 14:02:48 [auto1.es] INFO: Found listing with ID: RR37131
2026-03-28 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:49 [auto1.es] INFO: Channel: 24h | Page: 33 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: TX53008
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: AD15625
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD15625%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for AD15625: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: KX23330
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: UG82758
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG82758%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for UG82758: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: DA46223
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA46223%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for DA46223: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: GY39157
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: TV93426
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: VH23688
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH23688%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for VH23688: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: MU93951
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: VU67275
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: VL75431
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL75431%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for VL75431: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: PB35716
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB35716%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for PB35716: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: WC06824
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: HV93146
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV93146%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for HV93146: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: KK58093
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK58093%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for KK58093: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: NR52566
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: WH83968
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH83968%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for WH83968: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: VB99654
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB99654%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for VB99654: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: TD60260
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: WJ41546
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ41546%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for WJ41546: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: XA12312
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: FT73766
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT73766%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for FT73766: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: YM72054
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: UX12381
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: PP93305
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP93305%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for PP93305: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: BK24148
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK24148%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for BK24148: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: YA45169
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA45169%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for YA45169: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: RK45787
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK45787%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for RK45787: 0
2026-03-28 14:02:49 [auto1.es] INFO: Found listing with ID: CE82736
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE82736%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Scrape type for CE82736: 2
2026-03-28 14:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc2bdf57-3663-56f7-9a44-86fa1f718265 with identifier: CE82736
2026-03-28 14:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc2bdf57-3663-56f7-9a44-86fa1f718265 with scrape type 2
2026-03-28 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc2bdf57-3663-56f7-9a44-86fa1f718265 with scrape type 2
2026-03-28 14:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc2bdf57-3663-56f7-9a44-86fa1f718265, identifier: CE82736
2026-03-28 14:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc2bdf57-3663-56f7-9a44-86fa1f718265 with identifier: CE82736
2026-03-28 14:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc2bdf57-3663-56f7-9a44-86fa1f718265 with identifier: CE82736
2026-03-28 14:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc2bdf57-3663-56f7-9a44-86fa1f718265 with identifier: CE82736 to the API
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:24:44Z',
 'fuel_type': 'petrol',
 'id': 'dc2bdf57-3663-56f7-9a44-86fa1f718265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE82736',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 91410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-27',
 'seller_name': None,
 'title': 'Dacia Dokker 1.6 SCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2019}
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE82736%27 HTTP/1.1" 200 None
2026-03-28 14:02:49 [auto1.es] INFO: Saving data for CE82736: {'auction_closing_time': 1774715084.0, 'created_time': 1773133894.250603, 'last_price_update_time': 1774706569.893206}
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CE82736') HTTP/1.1" 204 0
2026-03-28 14:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:50 [auto1.es] INFO: Found listing with ID: AE24734
2026-03-28 14:02:50 [auto1.es] INFO: Found listing with ID: AC91156
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC91156%27 HTTP/1.1" 200 None
2026-03-28 14:02:50 [auto1.es] INFO: Scrape type for AC91156: 0
2026-03-28 14:02:50 [auto1.es] INFO: Found listing with ID: FH72535
2026-03-28 14:02:50 [auto1.es] INFO: Found listing with ID: PX22333
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX22333%27 HTTP/1.1" 200 None
2026-03-28 14:02:50 [auto1.es] INFO: Scrape type for PX22333: 0
2026-03-28 14:02:50 [auto1.es] INFO: Found listing with ID: BH69278
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH69278%27 HTTP/1.1" 200 None
2026-03-28 14:02:50 [auto1.es] INFO: Scrape type for BH69278: 0
2026-03-28 14:02:50 [auto1.es] INFO: Found listing with ID: CR04544
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR04544%27 HTTP/1.1" 200 None
2026-03-28 14:02:50 [auto1.es] INFO: Scrape type for CR04544: 0
2026-03-28 14:02:50 [auto1.es] INFO: Found listing with ID: DS93846
2026-03-28 14:02:50 [auto1.es] INFO: Found listing with ID: AF99504
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF99504%27 HTTP/1.1" 200 None
2026-03-28 14:02:50 [auto1.es] INFO: Scrape type for AF99504: 0
2026-03-28 14:02:50 [auto1.es] INFO: Found listing with ID: KL41152
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL41152%27 HTTP/1.1" 200 None
2026-03-28 14:02:50 [auto1.es] INFO: Scrape type for KL41152: 0
2026-03-28 14:02:50 [auto1.es] INFO: Found listing with ID: YE09930
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE09930%27 HTTP/1.1" 200 None
2026-03-28 14:02:50 [auto1.es] INFO: Scrape type for YE09930: 0
2026-03-28 14:02:50 [auto1.es] INFO: Found listing with ID: XB61397
2026-03-28 14:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:51 [auto1.es] INFO: Channel: 24h | Page: 34 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: CV87260
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: LX51563
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX51563%27 HTTP/1.1" 200 None
2026-03-28 14:02:51 [auto1.es] INFO: Scrape type for LX51563: 0
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: ZW73484
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: FG12610
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG12610%27 HTTP/1.1" 200 None
2026-03-28 14:02:51 [auto1.es] INFO: Scrape type for FG12610: 0
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: TY35729
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY35729%27 HTTP/1.1" 200 None
2026-03-28 14:02:51 [auto1.es] INFO: Scrape type for TY35729: 0
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: BV26369
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: TN84578
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN84578%27 HTTP/1.1" 200 None
2026-03-28 14:02:51 [auto1.es] INFO: Scrape type for TN84578: 0
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: SC59966
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: EF44253
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: XD15291
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: NT29011
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT29011%27 HTTP/1.1" 200 None
2026-03-28 14:02:51 [auto1.es] INFO: Scrape type for NT29011: 0
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: TW93253
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW93253%27 HTTP/1.1" 200 None
2026-03-28 14:02:51 [auto1.es] INFO: Scrape type for TW93253: 2
2026-03-28 14:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f71d60c1-8d29-5d5a-929c-805ad5c6ac66 with identifier: TW93253
2026-03-28 14:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f71d60c1-8d29-5d5a-929c-805ad5c6ac66 with scrape type 2
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f71d60c1-8d29-5d5a-929c-805ad5c6ac66 with scrape type 2
2026-03-28 14:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f71d60c1-8d29-5d5a-929c-805ad5c6ac66, identifier: TW93253
2026-03-28 14:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f71d60c1-8d29-5d5a-929c-805ad5c6ac66 with identifier: TW93253
2026-03-28 14:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f71d60c1-8d29-5d5a-929c-805ad5c6ac66 with identifier: TW93253
2026-03-28 14:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f71d60c1-8d29-5d5a-929c-805ad5c6ac66 with identifier: TW93253 to the API
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:55:39Z',
 'fuel_type': 'petrol',
 'id': 'f71d60c1-8d29-5d5a-929c-805ad5c6ac66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW93253',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 245463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW93253%27 HTTP/1.1" 200 None
2026-03-28 14:02:51 [auto1.es] INFO: Saving data for TW93253: {'auction_closing_time': 1774716939.0, 'created_time': 1774522874.938823, 'last_price_update_time': 1774706571.532954}
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TW93253') HTTP/1.1" 204 0
2026-03-28 14:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:51 [auto1.es] INFO: Found listing with ID: ZR33369
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR33369%27 HTTP/1.1" 200 None
2026-03-28 14:02:51 [auto1.es] INFO: Scrape type for ZR33369: 2
2026-03-28 14:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ad0373e-9092-5fc6-985f-285ee8088734 with identifier: ZR33369
2026-03-28 14:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ad0373e-9092-5fc6-985f-285ee8088734 with scrape type 2
2026-03-28 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ad0373e-9092-5fc6-985f-285ee8088734 with scrape type 2
2026-03-28 14:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7ad0373e-9092-5fc6-985f-285ee8088734, identifier: ZR33369
2026-03-28 14:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7ad0373e-9092-5fc6-985f-285ee8088734 with identifier: ZR33369
2026-03-28 14:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7ad0373e-9092-5fc6-985f-285ee8088734 with identifier: ZR33369
2026-03-28 14:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7ad0373e-9092-5fc6-985f-285ee8088734 with identifier: ZR33369 to the API
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:46:10Z',
 'fuel_type': 'diesel',
 'id': '7ad0373e-9092-5fc6-985f-285ee8088734',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR33369',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera Tino',
 'odometer': 116237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-30',
 'seller_name': None,
 'title': 'Nissan Almera Tino 2.2 dCi Acenta plus',
 'transmission': 'manual',
 'trim': 'Acenta plus',
 'year': 2006}
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR33369%27 HTTP/1.1" 200 None
2026-03-28 14:02:52 [auto1.es] INFO: Saving data for ZR33369: {'auction_closing_time': 1774716370.0, 'created_time': 1774436427.829488, 'last_price_update_time': 1774706572.047301}
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZR33369') HTTP/1.1" 204 0
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: WC19502
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: UP08407
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: TD30983
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD30983%27 HTTP/1.1" 200 None
2026-03-28 14:02:52 [auto1.es] INFO: Scrape type for TD30983: 0
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: SH43107
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: KV39877
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: YN87603
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN87603%27 HTTP/1.1" 200 None
2026-03-28 14:02:52 [auto1.es] INFO: Scrape type for YN87603: 0
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: TT78731
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: CD98275
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD98275%27 HTTP/1.1" 200 None
2026-03-28 14:02:52 [auto1.es] INFO: Scrape type for CD98275: 0
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: DC35826
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: JN26439
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: YS21780
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: BG05674
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: DH23772
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH23772%27 HTTP/1.1" 200 None
2026-03-28 14:02:52 [auto1.es] INFO: Scrape type for DH23772: 2
2026-03-28 14:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3ab1528-534c-500c-9722-f7a7bab0ebd3 with identifier: DH23772
2026-03-28 14:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ab1528-534c-500c-9722-f7a7bab0ebd3 with scrape type 2
2026-03-28 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3ab1528-534c-500c-9722-f7a7bab0ebd3 with scrape type 2
2026-03-28 14:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a3ab1528-534c-500c-9722-f7a7bab0ebd3, identifier: DH23772
2026-03-28 14:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a3ab1528-534c-500c-9722-f7a7bab0ebd3 with identifier: DH23772
2026-03-28 14:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a3ab1528-534c-500c-9722-f7a7bab0ebd3 with identifier: DH23772
2026-03-28 14:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a3ab1528-534c-500c-9722-f7a7bab0ebd3 with identifier: DH23772 to the API
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:34:36Z',
 'fuel_type': 'hybrid',
 'id': 'a3ab1528-534c-500c-9722-f7a7bab0ebd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH23772',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 120130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-18',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Tecno 2WD',
 'transmission': 'automatic',
 'trim': 'Tecno 2WD',
 'year': 2021}
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH23772%27 HTTP/1.1" 200 None
2026-03-28 14:02:52 [auto1.es] INFO: Saving data for DH23772: {'auction_closing_time': 1774715676.0, 'created_time': 1774037067.012906, 'last_price_update_time': 1774706572.56994}
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DH23772') HTTP/1.1" 204 0
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: HH68332
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH68332%27 HTTP/1.1" 200 None
2026-03-28 14:02:52 [auto1.es] INFO: Scrape type for HH68332: 0
2026-03-28 14:02:52 [auto1.es] INFO: Found listing with ID: EH02657
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH02657%27 HTTP/1.1" 200 None
2026-03-28 14:02:52 [auto1.es] INFO: Scrape type for EH02657: 2
2026-03-28 14:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d25eccf8-6729-5d6d-9328-300d2ae9d267 with identifier: EH02657
2026-03-28 14:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d25eccf8-6729-5d6d-9328-300d2ae9d267 with scrape type 2
2026-03-28 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d25eccf8-6729-5d6d-9328-300d2ae9d267 with scrape type 2
2026-03-28 14:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d25eccf8-6729-5d6d-9328-300d2ae9d267, identifier: EH02657
2026-03-28 14:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d25eccf8-6729-5d6d-9328-300d2ae9d267 with identifier: EH02657
2026-03-28 14:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d25eccf8-6729-5d6d-9328-300d2ae9d267 with identifier: EH02657
2026-03-28 14:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d25eccf8-6729-5d6d-9328-300d2ae9d267 with identifier: EH02657 to the API
2026-03-28 14:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:22:09Z',
 'fuel_type': 'diesel',
 'id': 'd25eccf8-6729-5d6d-9328-300d2ae9d267',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH02657',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 210449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-15',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH02657%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [auto1.es] INFO: Saving data for EH02657: {'auction_closing_time': 1774714929.0, 'created_time': 1774123260.41168, 'last_price_update_time': 1774706573.172347}
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EH02657') HTTP/1.1" 204 0
2026-03-28 14:02:53 [auto1.es] INFO: Found listing with ID: ME41297
2026-03-28 14:02:53 [auto1.es] INFO: Found listing with ID: BW06558
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW06558%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [auto1.es] INFO: Scrape type for BW06558: 0
2026-03-28 14:02:53 [auto1.es] INFO: Found listing with ID: LC05327
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC05327%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [auto1.es] INFO: Scrape type for LC05327: 0
2026-03-28 14:02:53 [auto1.es] INFO: Found listing with ID: NV73082
2026-03-28 14:02:53 [auto1.es] INFO: Found listing with ID: MA08789
2026-03-28 14:02:53 [auto1.es] INFO: Found listing with ID: VC32257
2026-03-28 14:02:53 [auto1.es] INFO: Found listing with ID: XH30785
2026-03-28 14:02:53 [auto1.es] INFO: Found listing with ID: RL96289
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL96289%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [auto1.es] INFO: Scrape type for RL96289: 0
2026-03-28 14:02:53 [auto1.es] INFO: Found listing with ID: WB94881
2026-03-28 14:02:53 [auto1.es] INFO: Found listing with ID: BS00293
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BS00293%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [auto1.es] INFO: Scrape type for BS00293: 0
2026-03-28 14:02:53 [auto1.es] INFO: Found listing with ID: MR84448
2026-03-28 14:02:53 [auto1.es] INFO: Found listing with ID: ET53098
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET53098%27 HTTP/1.1" 200 None
2026-03-28 14:02:53 [auto1.es] INFO: Scrape type for ET53098: 0
2026-03-28 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:54 [auto1.es] INFO: Channel: 24h | Page: 35 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: FA94127
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: YP93952
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP93952%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [auto1.es] INFO: Scrape type for YP93952: 0
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: FB20792
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB20792%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [auto1.es] INFO: Scrape type for FB20792: 0
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: HZ26587
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: RH85625
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: DG40190
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG40190%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [auto1.es] INFO: Scrape type for DG40190: 0
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: MP04292
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: LJ64414
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ64414%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [auto1.es] INFO: Scrape type for LJ64414: 2
2026-03-28 14:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42ee872c-5d1c-57ec-ac89-9932cc8aac52 with identifier: LJ64414
2026-03-28 14:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42ee872c-5d1c-57ec-ac89-9932cc8aac52 with scrape type 2
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42ee872c-5d1c-57ec-ac89-9932cc8aac52 with scrape type 2
2026-03-28 14:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 42ee872c-5d1c-57ec-ac89-9932cc8aac52, identifier: LJ64414
2026-03-28 14:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 42ee872c-5d1c-57ec-ac89-9932cc8aac52 with identifier: LJ64414
2026-03-28 14:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 42ee872c-5d1c-57ec-ac89-9932cc8aac52 with identifier: LJ64414
2026-03-28 14:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 42ee872c-5d1c-57ec-ac89-9932cc8aac52 with identifier: LJ64414 to the API
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:50:29Z',
 'fuel_type': 'petrol',
 'id': '42ee872c-5d1c-57ec-ac89-9932cc8aac52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ64414',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 173064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-13',
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.2 V6 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ64414%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [auto1.es] INFO: Saving data for LJ64414: {'auction_closing_time': 1774716629.0, 'created_time': 1774522871.584731, 'last_price_update_time': 1774706574.743998}
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LJ64414') HTTP/1.1" 204 0
2026-03-28 14:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: YW02554
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: RR71682
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR71682%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [auto1.es] INFO: Scrape type for RR71682: 0
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: WY33726
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: AR59073
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: NH73319
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH73319%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [auto1.es] INFO: Scrape type for NH73319: 0
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: MV76420
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: TZ42213
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ42213%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [auto1.es] INFO: Scrape type for TZ42213: 0
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: MA84687
2026-03-28 14:02:54 [auto1.es] INFO: Found listing with ID: TY81479
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY81479%27 HTTP/1.1" 200 None
2026-03-28 14:02:54 [auto1.es] INFO: Scrape type for TY81479: 2
2026-03-28 14:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e with identifier: TY81479
2026-03-28 14:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e with scrape type 2
2026-03-28 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e with scrape type 2
2026-03-28 14:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e, identifier: TY81479
2026-03-28 14:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e with identifier: TY81479
2026-03-28 14:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e with identifier: TY81479
2026-03-28 14:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e with identifier: TY81479 to the API
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:14:20Z',
 'fuel_type': 'diesel',
 'id': 'a9dfd2c9-ad96-541e-94dc-367a2b2e1e1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY81479',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 174729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-20',
 'seller_name': None,
 'title': 'Opel Zafira 2.0 DTI Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2004}
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY81479%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [auto1.es] INFO: Saving data for TY81479: {'auction_closing_time': 1774714460.0, 'created_time': 1774436430.768265, 'last_price_update_time': 1774706575.353035}
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TY81479') HTTP/1.1" 204 0
2026-03-28 14:02:55 [auto1.es] INFO: Found listing with ID: NL32920
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL32920%27 HTTP/1.1" 200 None
2026-03-28 14:02:55 [auto1.es] INFO: Scrape type for NL32920: 2
2026-03-28 14:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a083bfd9-04f1-5c07-ac5d-f215c22c7247 with identifier: NL32920
2026-03-28 14:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a083bfd9-04f1-5c07-ac5d-f215c22c7247 with scrape type 2
2026-03-28 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a083bfd9-04f1-5c07-ac5d-f215c22c7247 with scrape type 2
2026-03-28 14:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a083bfd9-04f1-5c07-ac5d-f215c22c7247, identifier: NL32920
2026-03-28 14:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a083bfd9-04f1-5c07-ac5d-f215c22c7247 with identifier: NL32920
2026-03-28 14:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a083bfd9-04f1-5c07-ac5d-f215c22c7247 with identifier: NL32920
2026-03-28 14:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a083bfd9-04f1-5c07-ac5d-f215c22c7247 with identifier: NL32920 to the API
2026-03-28 14:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:57:09Z',
 'fuel_type': 'petrol',
 'id': 'a083bfd9-04f1-5c07-ac5d-f215c22c7247',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL32920',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 137049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2011}
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL32920%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [auto1.es] INFO: Saving data for NL32920: {'auction_closing_time': 1774717029.0, 'created_time': 1774522873.264215, 'last_price_update_time': 1774706576.64094}
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NL32920') HTTP/1.1" 204 0
2026-03-28 14:02:56 [auto1.es] INFO: Found listing with ID: HL39596
2026-03-28 14:02:56 [auto1.es] INFO: Found listing with ID: VT03580
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT03580%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [auto1.es] INFO: Scrape type for VT03580: 0
2026-03-28 14:02:56 [auto1.es] INFO: Found listing with ID: AS19038
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS19038%27 HTTP/1.1" 200 None
2026-03-28 14:02:56 [auto1.es] INFO: Scrape type for AS19038: 2
2026-03-28 14:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50705a58-667b-5f41-a4ff-17f99a8cbb7f with identifier: AS19038
2026-03-28 14:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50705a58-667b-5f41-a4ff-17f99a8cbb7f with scrape type 2
2026-03-28 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50705a58-667b-5f41-a4ff-17f99a8cbb7f with scrape type 2
2026-03-28 14:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50705a58-667b-5f41-a4ff-17f99a8cbb7f, identifier: AS19038
2026-03-28 14:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50705a58-667b-5f41-a4ff-17f99a8cbb7f with identifier: AS19038
2026-03-28 14:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50705a58-667b-5f41-a4ff-17f99a8cbb7f with identifier: AS19038
2026-03-28 14:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 50705a58-667b-5f41-a4ff-17f99a8cbb7f with identifier: AS19038 to the API
2026-03-28 14:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:01:34Z',
 'fuel_type': 'diesel',
 'id': '50705a58-667b-5f41-a4ff-17f99a8cbb7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS19038',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 151095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-29',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2020}
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS19038%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [auto1.es] INFO: Saving data for AS19038: {'auction_closing_time': 1774713694.0, 'created_time': 1773133846.623509, 'last_price_update_time': 1774706577.156616}
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AS19038') HTTP/1.1" 204 0
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: BY33283
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY33283%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [auto1.es] INFO: Scrape type for BY33283: 0
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: JF88454
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: EZ85260
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: RM57308
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: UF70444
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF70444%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [auto1.es] INFO: Scrape type for UF70444: 0
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: PL43950
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: KL28800
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: TZ81028
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ81028%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [auto1.es] INFO: Scrape type for TZ81028: 0
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: NB98056
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB98056%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [auto1.es] INFO: Scrape type for NB98056: 0
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: GR21814
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: GK19760
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK19760%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [auto1.es] INFO: Scrape type for GK19760: 0
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: KU93995
2026-03-28 14:02:57 [auto1.es] INFO: Found listing with ID: CH33556
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH33556%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [auto1.es] INFO: Scrape type for CH33556: 2
2026-03-28 14:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf1396ae-ec45-5e75-b150-42dd02257d03 with identifier: CH33556
2026-03-28 14:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf1396ae-ec45-5e75-b150-42dd02257d03 with scrape type 2
2026-03-28 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf1396ae-ec45-5e75-b150-42dd02257d03 with scrape type 2
2026-03-28 14:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bf1396ae-ec45-5e75-b150-42dd02257d03, identifier: CH33556
2026-03-28 14:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bf1396ae-ec45-5e75-b150-42dd02257d03 with identifier: CH33556
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 14:02:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bf1396ae-ec45-5e75-b150-42dd02257d03 with identifier: CH33556
2026-03-28 14:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bf1396ae-ec45-5e75-b150-42dd02257d03 with identifier: CH33556 to the API
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:37:51Z',
 'fuel_type': 'diesel',
 'id': 'bf1396ae-ec45-5e75-b150-42dd02257d03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH33556',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 108079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-28',
 'seller_name': None,
 'title': 'Renault Laguna 1.9 dCi Confort Expression',
 'transmission': 'manual',
 'trim': 'Confort Expression',
 'year': 2006}
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH33556%27 HTTP/1.1" 200 None
2026-03-28 14:02:57 [auto1.es] INFO: Saving data for CH33556: {'auction_closing_time': 1774715871.0, 'created_time': 1774522862.508909, 'last_price_update_time': 1774706577.96259}
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CH33556') HTTP/1.1" 204 0
2026-03-28 14:02:58 [auto1.es] INFO: Found listing with ID: RX23320
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX23320%27 HTTP/1.1" 200 None
2026-03-28 14:02:58 [auto1.es] INFO: Scrape type for RX23320: 2
2026-03-28 14:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a522207a-cb68-546a-9af6-be37f1240c9d with identifier: RX23320
2026-03-28 14:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a522207a-cb68-546a-9af6-be37f1240c9d with scrape type 2
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a522207a-cb68-546a-9af6-be37f1240c9d with scrape type 2
2026-03-28 14:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a522207a-cb68-546a-9af6-be37f1240c9d, identifier: RX23320
2026-03-28 14:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a522207a-cb68-546a-9af6-be37f1240c9d with identifier: RX23320
2026-03-28 14:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a522207a-cb68-546a-9af6-be37f1240c9d with identifier: RX23320
2026-03-28 14:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a522207a-cb68-546a-9af6-be37f1240c9d with identifier: RX23320 to the API
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:23:21Z',
 'fuel_type': 'diesel',
 'id': 'a522207a-cb68-546a-9af6-be37f1240c9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX23320',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 332686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-13',
 'seller_name': None,
 'title': 'Ford C-Max 1.8 TDCi Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 2006}
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX23320%27 HTTP/1.1" 200 None
2026-03-28 14:02:58 [auto1.es] INFO: Saving data for RX23320: {'auction_closing_time': 1774715001.0, 'created_time': 1774522906.593279, 'last_price_update_time': 1774706578.534196}
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RX23320') HTTP/1.1" 204 0
2026-03-28 14:02:58 [auto1.es] INFO: Found listing with ID: PJ00608
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ00608%27 HTTP/1.1" 200 None
2026-03-28 14:02:58 [auto1.es] INFO: Scrape type for PJ00608: 2
2026-03-28 14:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 329760a8-d176-568d-8f17-8d532eb44623 with identifier: PJ00608
2026-03-28 14:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 329760a8-d176-568d-8f17-8d532eb44623 with scrape type 2
2026-03-28 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 329760a8-d176-568d-8f17-8d532eb44623 with scrape type 2
2026-03-28 14:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 329760a8-d176-568d-8f17-8d532eb44623, identifier: PJ00608
2026-03-28 14:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 329760a8-d176-568d-8f17-8d532eb44623 with identifier: PJ00608
2026-03-28 14:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 329760a8-d176-568d-8f17-8d532eb44623 with identifier: PJ00608
2026-03-28 14:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 329760a8-d176-568d-8f17-8d532eb44623 with identifier: PJ00608 to the API
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:46:06Z',
 'fuel_type': 'diesel',
 'id': '329760a8-d176-568d-8f17-8d532eb44623',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ00608',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 246824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-27',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2007}
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ00608%27 HTTP/1.1" 200 None
2026-03-28 14:02:59 [auto1.es] INFO: Saving data for PJ00608: {'auction_closing_time': 1774716366.0, 'created_time': 1773950718.79822, 'last_price_update_time': 1774706579.00014}
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PJ00608') HTTP/1.1" 204 0
2026-03-28 14:02:59 [auto1.es] INFO: Found listing with ID: LU54456
2026-03-28 14:02:59 [auto1.es] INFO: Found listing with ID: EX28567
2026-03-28 14:02:59 [auto1.es] INFO: Found listing with ID: RA35463
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA35463%27 HTTP/1.1" 200 None
2026-03-28 14:02:59 [auto1.es] INFO: Scrape type for RA35463: 0
2026-03-28 14:02:59 [auto1.es] INFO: Found listing with ID: CV55647
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV55647%27 HTTP/1.1" 200 None
2026-03-28 14:02:59 [auto1.es] INFO: Scrape type for CV55647: 2
2026-03-28 14:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db71ec3e-071e-5e7b-b6d5-2d34d573bd1b with identifier: CV55647
2026-03-28 14:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db71ec3e-071e-5e7b-b6d5-2d34d573bd1b with scrape type 2
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db71ec3e-071e-5e7b-b6d5-2d34d573bd1b with scrape type 2
2026-03-28 14:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: db71ec3e-071e-5e7b-b6d5-2d34d573bd1b, identifier: CV55647
2026-03-28 14:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: db71ec3e-071e-5e7b-b6d5-2d34d573bd1b with identifier: CV55647
2026-03-28 14:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: db71ec3e-071e-5e7b-b6d5-2d34d573bd1b with identifier: CV55647
2026-03-28 14:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: db71ec3e-071e-5e7b-b6d5-2d34d573bd1b with identifier: CV55647 to the API
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:52:19Z',
 'fuel_type': 'diesel',
 'id': 'db71ec3e-071e-5e7b-b6d5-2d34d573bd1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV55647',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Toledo',
 'odometer': 174364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-27',
 'seller_name': None,
 'title': 'Seat Toledo 1.9 TDI Sport-up',
 'transmission': 'manual',
 'trim': 'Sport-up',
 'year': 2005}
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV55647%27 HTTP/1.1" 200 None
2026-03-28 14:02:59 [auto1.es] INFO: Saving data for CV55647: {'auction_closing_time': 1774716739.0, 'created_time': 1773950552.563185, 'last_price_update_time': 1774706579.486888}
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CV55647') HTTP/1.1" 204 0
2026-03-28 14:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:02:59 [auto1.es] INFO: Channel: 24h | Page: 36 | totalHits: 2696 | hits on page: 40
2026-03-28 14:02:59 [auto1.es] INFO: Found listing with ID: PA43540
2026-03-28 14:02:59 [auto1.es] INFO: Found listing with ID: KW12372
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW12372%27 HTTP/1.1" 200 None
2026-03-28 14:02:59 [auto1.es] INFO: Scrape type for KW12372: 0
2026-03-28 14:02:59 [auto1.es] INFO: Found listing with ID: XT42288
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT42288%27 HTTP/1.1" 200 None
2026-03-28 14:02:59 [auto1.es] INFO: Scrape type for XT42288: 2
2026-03-28 14:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9c49768-1280-54f5-8b63-c455fc43e70b with identifier: XT42288
2026-03-28 14:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9c49768-1280-54f5-8b63-c455fc43e70b with scrape type 2
2026-03-28 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9c49768-1280-54f5-8b63-c455fc43e70b with scrape type 2
2026-03-28 14:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9c49768-1280-54f5-8b63-c455fc43e70b, identifier: XT42288
2026-03-28 14:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9c49768-1280-54f5-8b63-c455fc43e70b with identifier: XT42288
2026-03-28 14:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9c49768-1280-54f5-8b63-c455fc43e70b with identifier: XT42288
2026-03-28 14:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f9c49768-1280-54f5-8b63-c455fc43e70b with identifier: XT42288 to the API
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:50:56Z',
 'fuel_type': 'diesel',
 'id': 'f9c49768-1280-54f5-8b63-c455fc43e70b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT42288',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 178917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-29',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT42288%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Saving data for XT42288: {'auction_closing_time': 1774716656.0, 'created_time': 1774522846.855967, 'last_price_update_time': 1774706580.093907}
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XT42288') HTTP/1.1" 204 0
2026-03-28 14:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: HA98182
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: VY50847
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: TS51738
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS51738%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for TS51738: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: JA52917
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: KK03288
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK03288%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for KK03288: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: NX72938
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: WM80180
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM80180%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for WM80180: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: FM79545
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: UR77276
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: FG51952
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: BR63324
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: LV60077
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV60077%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for LV60077: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: VL50797
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: SW23101
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW23101%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for SW23101: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: TF28365
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF28365%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for TF28365: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: FB55193
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: NM57742
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM57742%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for NM57742: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: BS14602
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: SZ63984
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ63984%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for SZ63984: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: XU33886
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU33886%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for XU33886: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: FD79630
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: NV08430
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV08430%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for NV08430: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: ES89527
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: ZL78219
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL78219%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for ZL78219: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: KE44681
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE44681%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for KE44681: 2
2026-03-28 14:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23651d85-97bf-59e0-b45a-962eab987b76 with identifier: KE44681
2026-03-28 14:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23651d85-97bf-59e0-b45a-962eab987b76 with scrape type 2
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23651d85-97bf-59e0-b45a-962eab987b76 with scrape type 2
2026-03-28 14:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 23651d85-97bf-59e0-b45a-962eab987b76, identifier: KE44681
2026-03-28 14:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 23651d85-97bf-59e0-b45a-962eab987b76 with identifier: KE44681
2026-03-28 14:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 23651d85-97bf-59e0-b45a-962eab987b76 with identifier: KE44681
2026-03-28 14:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 23651d85-97bf-59e0-b45a-962eab987b76 with identifier: KE44681 to the API
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:47:03Z',
 'fuel_type': 'petrol',
 'id': '23651d85-97bf-59e0-b45a-962eab987b76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE44681',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 66295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-15',
 'seller_name': None,
 'title': 'Renault Megane 1.4 Century',
 'transmission': 'manual',
 'trim': 'Century',
 'year': 2002}
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE44681%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Saving data for KE44681: {'auction_closing_time': 1774716423.0, 'created_time': 1774522835.023565, 'last_price_update_time': 1774706580.800304}
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KE44681') HTTP/1.1" 204 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: XY74308
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY74308%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for XY74308: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: JN45905
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN45905%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for JN45905: 0
2026-03-28 14:03:00 [auto1.es] INFO: Found listing with ID: MT58185
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT58185%27 HTTP/1.1" 200 None
2026-03-28 14:03:00 [auto1.es] INFO: Scrape type for MT58185: 2
2026-03-28 14:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00bed97e-a2c4-5304-a9f7-6128c6fa76d6 with identifier: MT58185
2026-03-28 14:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00bed97e-a2c4-5304-a9f7-6128c6fa76d6 with scrape type 2
2026-03-28 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00bed97e-a2c4-5304-a9f7-6128c6fa76d6 with scrape type 2
2026-03-28 14:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 00bed97e-a2c4-5304-a9f7-6128c6fa76d6, identifier: MT58185
2026-03-28 14:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 00bed97e-a2c4-5304-a9f7-6128c6fa76d6 with identifier: MT58185
2026-03-28 14:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 00bed97e-a2c4-5304-a9f7-6128c6fa76d6 with identifier: MT58185
2026-03-28 14:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 00bed97e-a2c4-5304-a9f7-6128c6fa76d6 with identifier: MT58185 to the API
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:58:56Z',
 'fuel_type': 'diesel',
 'id': '00bed97e-a2c4-5304-a9f7-6128c6fa76d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT58185',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 126242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-16',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT58185%27 HTTP/1.1" 200 None
2026-03-28 14:03:01 [auto1.es] INFO: Saving data for MT58185: {'auction_closing_time': 1774717136.0, 'created_time': 1774522879.724107, 'last_price_update_time': 1774706581.384594}
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MT58185') HTTP/1.1" 204 0
2026-03-28 14:03:01 [auto1.es] INFO: Found listing with ID: XZ34869
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ34869%27 HTTP/1.1" 200 None
2026-03-28 14:03:01 [auto1.es] INFO: Scrape type for XZ34869: 0
2026-03-28 14:03:01 [auto1.es] INFO: Found listing with ID: DW24133
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW24133%27 HTTP/1.1" 200 None
2026-03-28 14:03:01 [auto1.es] INFO: Scrape type for DW24133: 0
2026-03-28 14:03:01 [auto1.es] INFO: Found listing with ID: SG11403
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG11403%27 HTTP/1.1" 200 None
2026-03-28 14:03:01 [auto1.es] INFO: Scrape type for SG11403: 0
2026-03-28 14:03:01 [auto1.es] INFO: Found listing with ID: BR35184
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR35184%27 HTTP/1.1" 200 None
2026-03-28 14:03:01 [auto1.es] INFO: Scrape type for BR35184: 2
2026-03-28 14:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdb0f429-7adf-5bbc-b408-a0b986d5b7fa with identifier: BR35184
2026-03-28 14:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdb0f429-7adf-5bbc-b408-a0b986d5b7fa with scrape type 2
2026-03-28 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdb0f429-7adf-5bbc-b408-a0b986d5b7fa with scrape type 2
2026-03-28 14:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fdb0f429-7adf-5bbc-b408-a0b986d5b7fa, identifier: BR35184
2026-03-28 14:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fdb0f429-7adf-5bbc-b408-a0b986d5b7fa with identifier: BR35184
2026-03-28 14:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fdb0f429-7adf-5bbc-b408-a0b986d5b7fa with identifier: BR35184
2026-03-28 14:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fdb0f429-7adf-5bbc-b408-a0b986d5b7fa with identifier: BR35184 to the API
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:12:35Z',
 'fuel_type': 'diesel',
 'id': 'fdb0f429-7adf-5bbc-b408-a0b986d5b7fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR35184',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 137258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-25',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR35184%27 HTTP/1.1" 200 None
2026-03-28 14:03:01 [auto1.es] INFO: Saving data for BR35184: {'auction_closing_time': 1774714355.0, 'created_time': 1774101664.123404, 'last_price_update_time': 1774706581.952866}
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BR35184') HTTP/1.1" 204 0
2026-03-28 14:03:01 [auto1.es] INFO: Found listing with ID: WD04556
2026-03-28 14:03:01 [auto1.es] INFO: Found listing with ID: UC81403
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC81403%27 HTTP/1.1" 200 None
2026-03-28 14:03:01 [auto1.es] INFO: Scrape type for UC81403: 0
2026-03-28 14:03:01 [auto1.es] INFO: Found listing with ID: CG34681
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG34681%27 HTTP/1.1" 200 None
2026-03-28 14:03:02 [auto1.es] INFO: Scrape type for CG34681: 0
2026-03-28 14:03:02 [auto1.es] INFO: Found listing with ID: UF24863
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF24863%27 HTTP/1.1" 200 None
2026-03-28 14:03:02 [auto1.es] INFO: Scrape type for UF24863: 0
2026-03-28 14:03:02 [auto1.es] INFO: Found listing with ID: BZ30519
2026-03-28 14:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:03 [auto1.es] INFO: Channel: 24h | Page: 37 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: WW50429
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW50429%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for WW50429: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: LL75884
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL75884%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for LL75884: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: ZB37818
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: DY77667
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY77667%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for DY77667: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: BB64860
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: XR73155
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR73155%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for XR73155: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: RZ31529
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ31529%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for RZ31529: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: EW95234
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW95234%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for EW95234: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: ZS73380
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: YV96776
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: GA63026
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA63026%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for GA63026: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: VD82224
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD82224%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for VD82224: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: ZT77590
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT77590%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for ZT77590: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: VF01083
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: UU89702
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU89702%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for UU89702: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: ZY52551
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: YF84144
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF84144%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for YF84144: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: EN42971
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: PD68374
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD68374%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for PD68374: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: UD71414
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: XR91515
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR91515%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for XR91515: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: KJ07748
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ07748%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for KJ07748: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: AJ61664
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ61664%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for AJ61664: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: RV91175
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV91175%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for RV91175: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: NL36775
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: MA45744
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: FZ75347
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ75347%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for FZ75347: 0
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: NT89177
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: ZC64345
2026-03-28 14:03:03 [auto1.es] INFO: Found listing with ID: FG54373
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG54373%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Scrape type for FG54373: 2
2026-03-28 14:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91a543ef-ab05-5475-a4f8-d0db70161919 with identifier: FG54373
2026-03-28 14:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a543ef-ab05-5475-a4f8-d0db70161919 with scrape type 2
2026-03-28 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91a543ef-ab05-5475-a4f8-d0db70161919 with scrape type 2
2026-03-28 14:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 91a543ef-ab05-5475-a4f8-d0db70161919, identifier: FG54373
2026-03-28 14:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 91a543ef-ab05-5475-a4f8-d0db70161919 with identifier: FG54373
2026-03-28 14:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 91a543ef-ab05-5475-a4f8-d0db70161919 with identifier: FG54373
2026-03-28 14:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 91a543ef-ab05-5475-a4f8-d0db70161919 with identifier: FG54373 to the API
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:19:56Z',
 'fuel_type': 'diesel',
 'id': '91a543ef-ab05-5475-a4f8-d0db70161919',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG54373',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 166208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-18',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Tecno',
 'transmission': 'automatic',
 'trim': 'Tecno',
 'year': 2014}
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG54373%27 HTTP/1.1" 200 None
2026-03-28 14:03:03 [auto1.es] INFO: Saving data for FG54373: {'auction_closing_time': 1774714796.0, 'created_time': 1773900628.351459, 'last_price_update_time': 1774706583.987209}
2026-03-28 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FG54373') HTTP/1.1" 204 0
2026-03-28 14:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:04 [auto1.es] INFO: Found listing with ID: XD17912
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD17912%27 HTTP/1.1" 200 None
2026-03-28 14:03:04 [auto1.es] INFO: Scrape type for XD17912: 0
2026-03-28 14:03:04 [auto1.es] INFO: Found listing with ID: RY22174
2026-03-28 14:03:04 [auto1.es] INFO: Found listing with ID: UT20809
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT20809%27 HTTP/1.1" 200 None
2026-03-28 14:03:04 [auto1.es] INFO: Scrape type for UT20809: 0
2026-03-28 14:03:04 [auto1.es] INFO: Found listing with ID: FG10684
2026-03-28 14:03:04 [auto1.es] INFO: Found listing with ID: FU47680
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU47680%27 HTTP/1.1" 200 None
2026-03-28 14:03:04 [auto1.es] INFO: Scrape type for FU47680: 0
2026-03-28 14:03:04 [auto1.es] INFO: Found listing with ID: CH09218
2026-03-28 14:03:04 [auto1.es] INFO: Found listing with ID: UF43058
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF43058%27 HTTP/1.1" 200 None
2026-03-28 14:03:04 [auto1.es] INFO: Scrape type for UF43058: 2
2026-03-28 14:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3fdac99-1b10-554a-a58f-def6ef4fc51a with identifier: UF43058
2026-03-28 14:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3fdac99-1b10-554a-a58f-def6ef4fc51a with scrape type 2
2026-03-28 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3fdac99-1b10-554a-a58f-def6ef4fc51a with scrape type 2
2026-03-28 14:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f3fdac99-1b10-554a-a58f-def6ef4fc51a, identifier: UF43058
2026-03-28 14:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f3fdac99-1b10-554a-a58f-def6ef4fc51a with identifier: UF43058
2026-03-28 14:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f3fdac99-1b10-554a-a58f-def6ef4fc51a with identifier: UF43058
2026-03-28 14:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f3fdac99-1b10-554a-a58f-def6ef4fc51a with identifier: UF43058 to the API
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:18:57Z',
 'fuel_type': 'petrol',
 'id': 'f3fdac99-1b10-554a-a58f-def6ef4fc51a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF43058',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 123859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI R-Line BlueMotion',
 'transmission': 'automatic',
 'trim': 'R-Line BlueMotion',
 'year': 2016}
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF43058%27 HTTP/1.1" 200 None
2026-03-28 14:03:04 [auto1.es] INFO: Saving data for UF43058: {'auction_closing_time': 1774714737.0, 'created_time': 1773181521.611203, 'last_price_update_time': 1774706584.656155}
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UF43058') HTTP/1.1" 204 0
2026-03-28 14:03:04 [auto1.es] INFO: Found listing with ID: TF80262
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF80262%27 HTTP/1.1" 200 None
2026-03-28 14:03:04 [auto1.es] INFO: Scrape type for TF80262: 0
2026-03-28 14:03:04 [auto1.es] INFO: Found listing with ID: YT73159
2026-03-28 14:03:04 [auto1.es] INFO: Found listing with ID: TG66753
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG66753%27 HTTP/1.1" 200 None
2026-03-28 14:03:04 [auto1.es] INFO: Scrape type for TG66753: 0
2026-03-28 14:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:05 [auto1.es] INFO: Channel: 24h | Page: 38 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:05 [auto1.es] INFO: Found listing with ID: AU62151
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU62151%27 HTTP/1.1" 200 None
2026-03-28 14:03:05 [auto1.es] INFO: Scrape type for AU62151: 0
2026-03-28 14:03:05 [auto1.es] INFO: Found listing with ID: CL10688
2026-03-28 14:03:05 [auto1.es] INFO: Found listing with ID: UT51740
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT51740%27 HTTP/1.1" 200 None
2026-03-28 14:03:05 [auto1.es] INFO: Scrape type for UT51740: 2
2026-03-28 14:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1d037ea-69b2-5351-9f7c-a0a7e180c4b4 with identifier: UT51740
2026-03-28 14:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1d037ea-69b2-5351-9f7c-a0a7e180c4b4 with scrape type 2
2026-03-28 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1d037ea-69b2-5351-9f7c-a0a7e180c4b4 with scrape type 2
2026-03-28 14:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e1d037ea-69b2-5351-9f7c-a0a7e180c4b4, identifier: UT51740
2026-03-28 14:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e1d037ea-69b2-5351-9f7c-a0a7e180c4b4 with identifier: UT51740
2026-03-28 14:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e1d037ea-69b2-5351-9f7c-a0a7e180c4b4 with identifier: UT51740
2026-03-28 14:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e1d037ea-69b2-5351-9f7c-a0a7e180c4b4 with identifier: UT51740 to the API
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:28:06Z',
 'fuel_type': 'diesel',
 'id': 'e1d037ea-69b2-5351-9f7c-a0a7e180c4b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT51740',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 212221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-29',
 'seller_name': None,
 'title': 'BMW X6 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT51740%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Saving data for UT51740: {'auction_closing_time': 1774715286.0, 'created_time': 1774522899.433729, 'last_price_update_time': 1774706586.03047}
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UT51740') HTTP/1.1" 204 0
2026-03-28 14:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: XH62171
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH62171%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for XH62171: 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: DH48682
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH48682%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for DH48682: 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: TU72670
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU72670%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for TU72670: 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: CC38102
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: DT94982
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: GC28603
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: MC11095
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: NV62926
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV62926%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for NV62926: 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: MA34031
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA34031%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for MA34031: 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: KM76960
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: NK65007
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK65007%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for NK65007: 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: TW71891
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: UD05464
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: DD26500
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD26500%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for DD26500: 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: XP71478
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP71478%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for XP71478: 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: ZZ54358
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ54358%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for ZZ54358: 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: BB78010
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: SP16189
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: LN74062
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: GT09019
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: FX97244
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX97244%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for FX97244: 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: SK09082
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: NY35082
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: CD12764
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD12764%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for CD12764: 2
2026-03-28 14:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f5676a3-2e8c-5d12-a2c0-cc9603b2d6f4 with identifier: CD12764
2026-03-28 14:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f5676a3-2e8c-5d12-a2c0-cc9603b2d6f4 with scrape type 2
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f5676a3-2e8c-5d12-a2c0-cc9603b2d6f4 with scrape type 2
2026-03-28 14:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5f5676a3-2e8c-5d12-a2c0-cc9603b2d6f4, identifier: CD12764
2026-03-28 14:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5f5676a3-2e8c-5d12-a2c0-cc9603b2d6f4 with identifier: CD12764
2026-03-28 14:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5f5676a3-2e8c-5d12-a2c0-cc9603b2d6f4 with identifier: CD12764
2026-03-28 14:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5f5676a3-2e8c-5d12-a2c0-cc9603b2d6f4 with identifier: CD12764 to the API
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:31:55Z',
 'fuel_type': 'petrol',
 'id': '5f5676a3-2e8c-5d12-a2c0-cc9603b2d6f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD12764',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 352126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2007}
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD12764%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Saving data for CD12764: {'auction_closing_time': 1774715515.0, 'created_time': 1773133106.175248, 'last_price_update_time': 1774706586.793121}
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CD12764') HTTP/1.1" 204 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: JL56851
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: JF75670
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: ZY41152
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY41152%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for ZY41152: 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: WT09242
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: FS30541
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS30541%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for FS30541: 0
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: KS85396
2026-03-28 14:03:06 [auto1.es] INFO: Found listing with ID: GS63441
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS63441%27 HTTP/1.1" 200 None
2026-03-28 14:03:06 [auto1.es] INFO: Scrape type for GS63441: 2
2026-03-28 14:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 770a0d76-f81c-5e13-9675-c09472195fc1 with identifier: GS63441
2026-03-28 14:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770a0d76-f81c-5e13-9675-c09472195fc1 with scrape type 2
2026-03-28 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 770a0d76-f81c-5e13-9675-c09472195fc1 with scrape type 2
2026-03-28 14:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 770a0d76-f81c-5e13-9675-c09472195fc1, identifier: GS63441
2026-03-28 14:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 770a0d76-f81c-5e13-9675-c09472195fc1 with identifier: GS63441
2026-03-28 14:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 770a0d76-f81c-5e13-9675-c09472195fc1 with identifier: GS63441
2026-03-28 14:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 770a0d76-f81c-5e13-9675-c09472195fc1 with identifier: GS63441 to the API
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:42:00Z',
 'fuel_type': 'diesel',
 'id': '770a0d76-f81c-5e13-9675-c09472195fc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS63441',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C-Elysée',
 'odometer': 190707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-28',
 'seller_name': None,
 'title': 'Citroen C-Elysée 1.6 Blue-HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2016}
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS63441%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [auto1.es] INFO: Saving data for GS63441: {'auction_closing_time': 1774716120.0, 'created_time': 1774522857.711008, 'last_price_update_time': 1774706587.445133}
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GS63441') HTTP/1.1" 204 0
2026-03-28 14:03:07 [auto1.es] INFO: Found listing with ID: FB21971
2026-03-28 14:03:07 [auto1.es] INFO: Found listing with ID: AG10118
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG10118%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [auto1.es] INFO: Scrape type for AG10118: 0
2026-03-28 14:03:07 [auto1.es] INFO: Found listing with ID: YM84351
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM84351%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [auto1.es] INFO: Scrape type for YM84351: 0
2026-03-28 14:03:07 [auto1.es] INFO: Found listing with ID: EU03494
2026-03-28 14:03:07 [auto1.es] INFO: Found listing with ID: RF56388
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF56388%27 HTTP/1.1" 200 None
2026-03-28 14:03:07 [auto1.es] INFO: Scrape type for RF56388: 0
2026-03-28 14:03:07 [auto1.es] INFO: Found listing with ID: XA81448
2026-03-28 14:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:08 [auto1.es] INFO: Channel: 24h | Page: 39 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:08 [auto1.es] INFO: Found listing with ID: RL15311
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL15311%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [auto1.es] INFO: Scrape type for RL15311: 0
2026-03-28 14:03:08 [auto1.es] INFO: Found listing with ID: AD59112
2026-03-28 14:03:08 [auto1.es] INFO: Found listing with ID: FL29872
2026-03-28 14:03:08 [auto1.es] INFO: Found listing with ID: NK77548
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK77548%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [auto1.es] INFO: Scrape type for NK77548: 0
2026-03-28 14:03:08 [auto1.es] INFO: Found listing with ID: JH13002
2026-03-28 14:03:08 [auto1.es] INFO: Found listing with ID: VG51698
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG51698%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [auto1.es] INFO: Scrape type for VG51698: 0
2026-03-28 14:03:08 [auto1.es] INFO: Found listing with ID: XZ20616
2026-03-28 14:03:08 [auto1.es] INFO: Found listing with ID: WF62317
2026-03-28 14:03:08 [auto1.es] INFO: Found listing with ID: CL39322
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL39322%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [auto1.es] INFO: Scrape type for CL39322: 2
2026-03-28 14:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b23040d-0233-52b9-b578-aaa458a9f98f with identifier: CL39322
2026-03-28 14:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b23040d-0233-52b9-b578-aaa458a9f98f with scrape type 2
2026-03-28 14:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b23040d-0233-52b9-b578-aaa458a9f98f with scrape type 2
2026-03-28 14:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2b23040d-0233-52b9-b578-aaa458a9f98f, identifier: CL39322
2026-03-28 14:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2b23040d-0233-52b9-b578-aaa458a9f98f with identifier: CL39322
2026-03-28 14:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2b23040d-0233-52b9-b578-aaa458a9f98f with identifier: CL39322
2026-03-28 14:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2b23040d-0233-52b9-b578-aaa458a9f98f with identifier: CL39322 to the API
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:21:24Z',
 'fuel_type': 'petrol',
 'id': '2b23040d-0233-52b9-b578-aaa458a9f98f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL39322',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 110078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-30',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Sport Rider',
 'transmission': 'manual',
 'trim': 'Sport Rider',
 'year': 2005}
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL39322%27 HTTP/1.1" 200 None
2026-03-28 14:03:08 [auto1.es] INFO: Saving data for CL39322: {'auction_closing_time': 1774714884.0, 'created_time': 1773950581.291543, 'last_price_update_time': 1774706588.936361}
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CL39322') HTTP/1.1" 204 0
2026-03-28 14:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: CU36803
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: KT28524
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT28524%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for KT28524: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: EX93255
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: SH77373
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH77373%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for SH77373: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: GM36563
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM36563%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for GM36563: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: XT63016
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: KD18831
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: UC02522
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC02522%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for UC02522: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: EV19134
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: UZ90788
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: FU34465
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: YA75501
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA75501%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for YA75501: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: XA87642
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA87642%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for XA87642: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: XZ11402
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ11402%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for XZ11402: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: JV95856
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JV95856%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for JV95856: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: XS50380
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: LC68552
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC68552%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for LC68552: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: CD34626
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: TV57362
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV57362%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for TV57362: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: BS42122
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: SM85087
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM85087%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for SM85087: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: LS40670
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: RC86632
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC86632%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for RC86632: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: RR39906
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: RU34223
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: GA97156
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: VW25923
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: YY21107
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: YM80761
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM80761%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for YM80761: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: HV14061
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV14061%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for HV14061: 0
2026-03-28 14:03:09 [auto1.es] INFO: Found listing with ID: HR86968
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR86968%27 HTTP/1.1" 200 None
2026-03-28 14:03:09 [auto1.es] INFO: Scrape type for HR86968: 0
2026-03-28 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:10 [auto1.es] INFO: Channel: 24h | Page: 40 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: KP17570
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP17570%27 HTTP/1.1" 200 None
2026-03-28 14:03:10 [auto1.es] INFO: Scrape type for KP17570: 0
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: ZW86524
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW86524%27 HTTP/1.1" 200 None
2026-03-28 14:03:10 [auto1.es] INFO: Scrape type for ZW86524: 0
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: ZT59108
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: XX07827
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: CU53246
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: LR10742
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: VC56562
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: HB97411
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: ZS36669
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: NJ98715
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ98715%27 HTTP/1.1" 200 None
2026-03-28 14:03:10 [auto1.es] INFO: Scrape type for NJ98715: 0
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: VY69585
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: FT04300
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT04300%27 HTTP/1.1" 200 None
2026-03-28 14:03:10 [auto1.es] INFO: Scrape type for FT04300: 0
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: PS20422
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS20422%27 HTTP/1.1" 200 None
2026-03-28 14:03:10 [auto1.es] INFO: Scrape type for PS20422: 0
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: KB11280
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: AC97398
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC97398%27 HTTP/1.1" 200 None
2026-03-28 14:03:10 [auto1.es] INFO: Scrape type for AC97398: 0
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: FK13380
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: DD02893
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD02893%27 HTTP/1.1" 200 None
2026-03-28 14:03:10 [auto1.es] INFO: Scrape type for DD02893: 0
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: FJ48317
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: TB67105
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB67105%27 HTTP/1.1" 200 None
2026-03-28 14:03:10 [auto1.es] INFO: Scrape type for TB67105: 0
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: YH79403
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH79403%27 HTTP/1.1" 200 None
2026-03-28 14:03:10 [auto1.es] INFO: Scrape type for YH79403: 0
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: RJ57584
2026-03-28 14:03:10 [auto1.es] INFO: Found listing with ID: ZM86466
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM86466%27 HTTP/1.1" 200 None
2026-03-28 14:03:10 [auto1.es] INFO: Scrape type for ZM86466: 2
2026-03-28 14:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 664ff1a1-c382-5032-ae82-498920e22f9e with identifier: ZM86466
2026-03-28 14:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 664ff1a1-c382-5032-ae82-498920e22f9e with scrape type 2
2026-03-28 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 664ff1a1-c382-5032-ae82-498920e22f9e with scrape type 2
2026-03-28 14:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 664ff1a1-c382-5032-ae82-498920e22f9e, identifier: ZM86466
2026-03-28 14:03:10 [scrapy.extensions.logstats] INFO: Crawled 150 pages (at 20 pages/min), scraped 138 items (at 54 items/min)
2026-03-28 14:03:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-28 14:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 664ff1a1-c382-5032-ae82-498920e22f9e with identifier: ZM86466
2026-03-28 14:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 664ff1a1-c382-5032-ae82-498920e22f9e with identifier: ZM86466
2026-03-28 14:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 664ff1a1-c382-5032-ae82-498920e22f9e with identifier: ZM86466 to the API
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:12:08Z',
 'fuel_type': 'diesel',
 'id': '664ff1a1-c382-5032-ae82-498920e22f9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM86466',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC70',
 'odometer': 252481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-29',
 'seller_name': None,
 'title': 'Volvo XC70 2.4 D5 AWD Momentum',
 'transmission': 'automatic',
 'trim': 'AWD Momentum',
 'year': 2004}
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM86466%27 HTTP/1.1" 200 None
2026-03-28 14:03:10 [auto1.es] INFO: Saving data for ZM86466: {'auction_closing_time': 1774714328.0, 'created_time': 1774522862.995859, 'last_price_update_time': 1774706590.967222}
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZM86466') HTTP/1.1" 204 0
2026-03-28 14:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: SK07271
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: WZ18115
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ18115%27 HTTP/1.1" 200 None
2026-03-28 14:03:11 [auto1.es] INFO: Scrape type for WZ18115: 0
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: CL69232
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL69232%27 HTTP/1.1" 200 None
2026-03-28 14:03:11 [auto1.es] INFO: Scrape type for CL69232: 0
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: XZ49849
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: VK08624
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK08624%27 HTTP/1.1" 200 None
2026-03-28 14:03:11 [auto1.es] INFO: Scrape type for VK08624: 0
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: ZF20558
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: LA59477
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA59477%27 HTTP/1.1" 200 None
2026-03-28 14:03:11 [auto1.es] INFO: Scrape type for LA59477: 0
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: WT51875
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT51875%27 HTTP/1.1" 200 None
2026-03-28 14:03:11 [auto1.es] INFO: Scrape type for WT51875: 0
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: YJ22618
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: CY21718
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY21718%27 HTTP/1.1" 200 None
2026-03-28 14:03:11 [auto1.es] INFO: Scrape type for CY21718: 0
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: EN57511
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: MJ86771
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ86771%27 HTTP/1.1" 200 None
2026-03-28 14:03:11 [auto1.es] INFO: Scrape type for MJ86771: 0
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: FG81749
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG81749%27 HTTP/1.1" 200 None
2026-03-28 14:03:11 [auto1.es] INFO: Scrape type for FG81749: 0
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: XW98344
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW98344%27 HTTP/1.1" 200 None
2026-03-28 14:03:11 [auto1.es] INFO: Scrape type for XW98344: 0
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: FA05952
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA05952%27 HTTP/1.1" 200 None
2026-03-28 14:03:11 [auto1.es] INFO: Scrape type for FA05952: 2
2026-03-28 14:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 625ed1db-3180-5a8a-a2f7-cdd5bedc485a with identifier: FA05952
2026-03-28 14:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 625ed1db-3180-5a8a-a2f7-cdd5bedc485a with scrape type 2
2026-03-28 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 625ed1db-3180-5a8a-a2f7-cdd5bedc485a with scrape type 2
2026-03-28 14:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 625ed1db-3180-5a8a-a2f7-cdd5bedc485a, identifier: FA05952
2026-03-28 14:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 625ed1db-3180-5a8a-a2f7-cdd5bedc485a with identifier: FA05952
2026-03-28 14:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 625ed1db-3180-5a8a-a2f7-cdd5bedc485a with identifier: FA05952
2026-03-28 14:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 625ed1db-3180-5a8a-a2f7-cdd5bedc485a with identifier: FA05952 to the API
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:54:51Z',
 'fuel_type': 'diesel',
 'id': '625ed1db-3180-5a8a-a2f7-cdd5bedc485a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA05952',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 229797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2008}
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA05952%27 HTTP/1.1" 200 None
2026-03-28 14:03:11 [auto1.es] INFO: Saving data for FA05952: {'auction_closing_time': 1774716891.0, 'created_time': 1774522871.998137, 'last_price_update_time': 1774706591.668899}
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FA05952') HTTP/1.1" 204 0
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: HY26286
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: SL84888
2026-03-28 14:03:11 [auto1.es] INFO: Found listing with ID: DR35066
2026-03-28 14:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:12 [auto1.es] INFO: Channel: 24h | Page: 41 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:12 [auto1.es] INFO: Found listing with ID: CM92438
2026-03-28 14:03:12 [auto1.es] INFO: Found listing with ID: EG03635
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG03635%27 HTTP/1.1" 200 None
2026-03-28 14:03:12 [auto1.es] INFO: Scrape type for EG03635: 0
2026-03-28 14:03:12 [auto1.es] INFO: Found listing with ID: EM05584
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM05584%27 HTTP/1.1" 200 None
2026-03-28 14:03:12 [auto1.es] INFO: Scrape type for EM05584: 0
2026-03-28 14:03:12 [auto1.es] INFO: Found listing with ID: ZT41669
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT41669%27 HTTP/1.1" 200 None
2026-03-28 14:03:12 [auto1.es] INFO: Scrape type for ZT41669: 0
2026-03-28 14:03:12 [auto1.es] INFO: Found listing with ID: LB47883
2026-03-28 14:03:12 [auto1.es] INFO: Found listing with ID: ZH70186
2026-03-28 14:03:12 [auto1.es] INFO: Found listing with ID: BE54244
2026-03-28 14:03:12 [auto1.es] INFO: Found listing with ID: RC07486
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC07486%27 HTTP/1.1" 200 None
2026-03-28 14:03:12 [auto1.es] INFO: Scrape type for RC07486: 0
2026-03-28 14:03:12 [auto1.es] INFO: Found listing with ID: FM46706
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM46706%27 HTTP/1.1" 200 None
2026-03-28 14:03:12 [auto1.es] INFO: Scrape type for FM46706: 0
2026-03-28 14:03:12 [auto1.es] INFO: Found listing with ID: PU52271
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU52271%27 HTTP/1.1" 200 None
2026-03-28 14:03:12 [auto1.es] INFO: Scrape type for PU52271: 0
2026-03-28 14:03:12 [auto1.es] INFO: Found listing with ID: JW04171
2026-03-28 14:03:12 [auto1.es] INFO: Found listing with ID: HF45963
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF45963%27 HTTP/1.1" 200 None
2026-03-28 14:03:12 [auto1.es] INFO: Scrape type for HF45963: 2
2026-03-28 14:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1 with identifier: HF45963
2026-03-28 14:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1 with scrape type 2
2026-03-28 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1 with scrape type 2
2026-03-28 14:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1, identifier: HF45963
2026-03-28 14:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1 with identifier: HF45963
2026-03-28 14:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1 with identifier: HF45963
2026-03-28 14:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8fec7e7d-df2b-5d4b-9bb5-073dc282afa1 with identifier: HF45963 to the API
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:55:51Z',
 'fuel_type': 'diesel',
 'id': '8fec7e7d-df2b-5d4b-9bb5-073dc282afa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF45963',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 153319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-26',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Live Edition',
 'transmission': 'manual',
 'trim': 'Live Edition',
 'year': 2017}
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF45963%27 HTTP/1.1" 200 None
2026-03-28 14:03:13 [auto1.es] INFO: Saving data for HF45963: {'auction_closing_time': 1774716951.0, 'created_time': 1773129220.619375, 'last_price_update_time': 1774706593.380627}
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HF45963') HTTP/1.1" 204 0
2026-03-28 14:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:13 [auto1.es] INFO: Found listing with ID: UD26451
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD26451%27 HTTP/1.1" 200 None
2026-03-28 14:03:13 [auto1.es] INFO: Scrape type for UD26451: 0
2026-03-28 14:03:13 [auto1.es] INFO: Found listing with ID: YL57759
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL57759%27 HTTP/1.1" 200 None
2026-03-28 14:03:13 [auto1.es] INFO: Scrape type for YL57759: 0
2026-03-28 14:03:13 [auto1.es] INFO: Found listing with ID: BY74928
2026-03-28 14:03:13 [auto1.es] INFO: Found listing with ID: AP77113
2026-03-28 14:03:13 [auto1.es] INFO: Found listing with ID: VW52839
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW52839%27 HTTP/1.1" 200 None
2026-03-28 14:03:13 [auto1.es] INFO: Scrape type for VW52839: 2
2026-03-28 14:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b0063ee-ddab-598e-a8ff-2241264c3257 with identifier: VW52839
2026-03-28 14:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b0063ee-ddab-598e-a8ff-2241264c3257 with scrape type 2
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b0063ee-ddab-598e-a8ff-2241264c3257 with scrape type 2
2026-03-28 14:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8b0063ee-ddab-598e-a8ff-2241264c3257, identifier: VW52839
2026-03-28 14:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8b0063ee-ddab-598e-a8ff-2241264c3257 with identifier: VW52839
2026-03-28 14:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8b0063ee-ddab-598e-a8ff-2241264c3257 with identifier: VW52839
2026-03-28 14:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8b0063ee-ddab-598e-a8ff-2241264c3257 with identifier: VW52839 to the API
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:28:14Z',
 'fuel_type': 'diesel',
 'id': '8b0063ee-ddab-598e-a8ff-2241264c3257',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW52839',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 256748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-15',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.7 CDTI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2006}
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW52839%27 HTTP/1.1" 200 None
2026-03-28 14:03:13 [auto1.es] INFO: Saving data for VW52839: {'auction_closing_time': 1774715294.0, 'created_time': 1774522887.41755, 'last_price_update_time': 1774706593.926318}
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VW52839') HTTP/1.1" 204 0
2026-03-28 14:03:13 [auto1.es] INFO: Found listing with ID: UH68821
2026-03-28 14:03:13 [auto1.es] INFO: Found listing with ID: FJ96130
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ96130%27 HTTP/1.1" 200 None
2026-03-28 14:03:13 [auto1.es] INFO: Scrape type for FJ96130: 0
2026-03-28 14:03:13 [auto1.es] INFO: Found listing with ID: MC49666
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC49666%27 HTTP/1.1" 200 None
2026-03-28 14:03:13 [auto1.es] INFO: Scrape type for MC49666: 2
2026-03-28 14:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db5bc65c-9074-5fdc-b7ad-0bdd20140a63 with identifier: MC49666
2026-03-28 14:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db5bc65c-9074-5fdc-b7ad-0bdd20140a63 with scrape type 2
2026-03-28 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db5bc65c-9074-5fdc-b7ad-0bdd20140a63 with scrape type 2
2026-03-28 14:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: db5bc65c-9074-5fdc-b7ad-0bdd20140a63, identifier: MC49666
2026-03-28 14:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: db5bc65c-9074-5fdc-b7ad-0bdd20140a63 with identifier: MC49666
2026-03-28 14:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: db5bc65c-9074-5fdc-b7ad-0bdd20140a63 with identifier: MC49666
2026-03-28 14:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: db5bc65c-9074-5fdc-b7ad-0bdd20140a63 with identifier: MC49666 to the API
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:47:25Z',
 'fuel_type': 'diesel',
 'id': 'db5bc65c-9074-5fdc-b7ad-0bdd20140a63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC49666',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 402068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-30',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Shine XL',
 'transmission': 'manual',
 'trim': 'Shine XL',
 'year': 2020}
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC49666%27 HTTP/1.1" 200 None
2026-03-28 14:03:14 [auto1.es] INFO: Saving data for MC49666: {'auction_closing_time': 1774716445.0, 'created_time': 1774522899.830429, 'last_price_update_time': 1774706594.394867}
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MC49666') HTTP/1.1" 204 0
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: RR74853
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR74853%27 HTTP/1.1" 200 None
2026-03-28 14:03:14 [auto1.es] INFO: Scrape type for RR74853: 0
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: JJ77360
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: CY26712
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY26712%27 HTTP/1.1" 200 None
2026-03-28 14:03:14 [auto1.es] INFO: Scrape type for CY26712: 0
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: SR69249
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR69249%27 HTTP/1.1" 200 None
2026-03-28 14:03:14 [auto1.es] INFO: Scrape type for SR69249: 0
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: RG81713
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: NC65740
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: MP83522
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP83522%27 HTTP/1.1" 200 None
2026-03-28 14:03:14 [auto1.es] INFO: Scrape type for MP83522: 0
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: ZV33545
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV33545%27 HTTP/1.1" 200 None
2026-03-28 14:03:14 [auto1.es] INFO: Scrape type for ZV33545: 0
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: GL92788
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: XH10437
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: JN05964
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: KW20253
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: CG09187
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG09187%27 HTTP/1.1" 200 None
2026-03-28 14:03:14 [auto1.es] INFO: Scrape type for CG09187: 0
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: ZL32724
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: YF74611
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: WC57455
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: YU51978
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: LY65055
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: NG74473
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG74473%27 HTTP/1.1" 200 None
2026-03-28 14:03:14 [auto1.es] INFO: Scrape type for NG74473: 0
2026-03-28 14:03:14 [auto1.es] INFO: Found listing with ID: NF74888
2026-03-28 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:15 [auto1.es] INFO: Channel: 24h | Page: 42 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: DH03412
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH03412%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for DH03412: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: XR15363
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR15363%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for XR15363: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: JV83587
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: SN56696
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN56696%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for SN56696: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: XV15787
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: FR40817
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: BU83574
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: HV80518
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV80518%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for HV80518: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: YP61713
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: SP65649
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP65649%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for SP65649: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: KP20621
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: NA52413
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: ZE77964
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: WA77291
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: EN05559
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN05559%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for EN05559: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: EU16511
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: PF18321
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: JC37021
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC37021%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for JC37021: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: YW59434
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW59434%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for YW59434: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: XW29028
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW29028%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for XW29028: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: ZF17550
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: DY05510
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY05510%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for DY05510: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: YC76181
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: XH10383
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: SF23835
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: JZ74348
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ74348%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for JZ74348: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: EV57307
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV57307%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for EV57307: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: AP01935
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP01935%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for AP01935: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: HA51253
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA51253%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for HA51253: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: DB91286
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB91286%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for DB91286: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: US16617
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: UZ32916
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: KH58937
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: BB21726
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB21726%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for BB21726: 0
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: VE25065
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: VC51874
2026-03-28 14:03:15 [auto1.es] INFO: Found listing with ID: HB80191
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB80191%27 HTTP/1.1" 200 None
2026-03-28 14:03:15 [auto1.es] INFO: Scrape type for HB80191: 2
2026-03-28 14:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3faab5e5-8c35-5a96-aa53-83fc3dedf928 with identifier: HB80191
2026-03-28 14:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3faab5e5-8c35-5a96-aa53-83fc3dedf928 with scrape type 2
2026-03-28 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3faab5e5-8c35-5a96-aa53-83fc3dedf928 with scrape type 2
2026-03-28 14:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3faab5e5-8c35-5a96-aa53-83fc3dedf928, identifier: HB80191
2026-03-28 14:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3faab5e5-8c35-5a96-aa53-83fc3dedf928 with identifier: HB80191
2026-03-28 14:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3faab5e5-8c35-5a96-aa53-83fc3dedf928 with identifier: HB80191
2026-03-28 14:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3faab5e5-8c35-5a96-aa53-83fc3dedf928 with identifier: HB80191 to the API
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:56:27Z',
 'fuel_type': 'diesel',
 'id': '3faab5e5-8c35-5a96-aa53-83fc3dedf928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB80191',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 78760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2019}
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB80191%27 HTTP/1.1" 200 None
2026-03-28 14:03:16 [auto1.es] INFO: Saving data for HB80191: {'auction_closing_time': 1774716987.0, 'created_time': 1773918205.303431, 'last_price_update_time': 1774706596.420741}
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HB80191') HTTP/1.1" 204 0
2026-03-28 14:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:16 [auto1.es] INFO: Found listing with ID: EH44076
2026-03-28 14:03:16 [auto1.es] INFO: Found listing with ID: BV69737
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV69737%27 HTTP/1.1" 200 None
2026-03-28 14:03:16 [auto1.es] INFO: Scrape type for BV69737: 0
2026-03-28 14:03:16 [auto1.es] INFO: Found listing with ID: CE26517
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE26517%27 HTTP/1.1" 200 None
2026-03-28 14:03:16 [auto1.es] INFO: Scrape type for CE26517: 0
2026-03-28 14:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:17 [auto1.es] INFO: Channel: 24h | Page: 43 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: WP31785
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP31785%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for WP31785: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: NA45690
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA45690%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for NA45690: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: XW07664
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: UL26650
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: PN60622
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: BE55826
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE55826%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for BE55826: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: MR13736
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR13736%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for MR13736: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: XY73701
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: NJ64367
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: MU84560
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU84560%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for MU84560: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: VZ14573
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ14573%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for VZ14573: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: NP28736
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: BE57585
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE57585%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for BE57585: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: LZ46895
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ46895%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for LZ46895: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: ZK08967
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK08967%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for ZK08967: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: MF18812
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: VX73239
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: GS37711
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS37711%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for GS37711: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: MD97530
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD97530%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for MD97530: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: HE26407
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: CH37145
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: YX91165
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: PM01444
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: CG97821
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: HU91100
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU91100%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for HU91100: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: CP16982
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP16982%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for CP16982: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: SW39850
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW39850%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for SW39850: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: ES67704
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: UF98716
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF98716%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for UF98716: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: UV98686
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: ZL46614
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: CF72772
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: CD32787
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: ME11919
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME11919%27 HTTP/1.1" 200 None
2026-03-28 14:03:17 [auto1.es] INFO: Scrape type for ME11919: 0
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: YU32195
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: HE05235
2026-03-28 14:03:17 [auto1.es] INFO: Found listing with ID: GE49904
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE49904%27 HTTP/1.1" 200 None
2026-03-28 14:03:18 [auto1.es] INFO: Scrape type for GE49904: 0
2026-03-28 14:03:18 [auto1.es] INFO: Found listing with ID: UX45403
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX45403%27 HTTP/1.1" 200 None
2026-03-28 14:03:18 [auto1.es] INFO: Scrape type for UX45403: 0
2026-03-28 14:03:18 [auto1.es] INFO: Found listing with ID: PY10364
2026-03-28 14:03:18 [auto1.es] INFO: Found listing with ID: FY36073
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY36073%27 HTTP/1.1" 200 None
2026-03-28 14:03:18 [auto1.es] INFO: Scrape type for FY36073: 0
2026-03-28 14:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:19 [auto1.es] INFO: Channel: 24h | Page: 44 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: HM53954
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM53954%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for HM53954: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: KE93313
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: GX93030
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: DS99682
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: WV40532
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: KC53673
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC53673%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for KC53673: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: SM25064
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM25064%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for SM25064: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: MP42129
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: NK34270
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK34270%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for NK34270: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: US76988
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US76988%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for US76988: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: HL11989
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL11989%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for HL11989: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: UL24539
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL24539%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for UL24539: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: WE46909
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: XL66794
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL66794%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for XL66794: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: GJ58304
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: SU07288
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: RN04683
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: KE66826
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE66826%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for KE66826: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: GT62572
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: SA21904
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA21904%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for SA21904: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: CU63126
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: PS40392
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: ER70032
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: NB66504
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: LY43971
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY43971%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for LY43971: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: AR16993
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: AE99486
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: ST64769
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST64769%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for ST64769: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: BR73846
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: NZ52735
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: VG19915
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG19915%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for VG19915: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: JX90216
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: WW69130
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: DB60699
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB60699%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for DB60699: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: MD84451
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD84451%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for MD84451: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: FF27063
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF27063%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for FF27063: 0
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: FM76074
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: FN47664
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: PX56700
2026-03-28 14:03:19 [auto1.es] INFO: Found listing with ID: LE05631
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE05631%27 HTTP/1.1" 200 None
2026-03-28 14:03:19 [auto1.es] INFO: Scrape type for LE05631: 0
2026-03-28 14:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:20 [auto1.es] INFO: Channel: 24h | Page: 45 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: YA92841
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA92841%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [auto1.es] INFO: Scrape type for YA92841: 0
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: WJ47895
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: EN16009
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN16009%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [auto1.es] INFO: Scrape type for EN16009: 0
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: BP83698
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP83698%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [auto1.es] INFO: Scrape type for BP83698: 0
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: UY61522
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: FP96823
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: MT75330
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: CY83374
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: CA59744
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: GZ65139
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: SV82730
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: NR18889
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR18889%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [auto1.es] INFO: Scrape type for NR18889: 0
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: GT34308
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: VE56967
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE56967%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [auto1.es] INFO: Scrape type for VE56967: 0
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: YG49669
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG49669%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [auto1.es] INFO: Scrape type for YG49669: 0
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: XX51310
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: NZ53366
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ53366%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [auto1.es] INFO: Scrape type for NZ53366: 0
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: HA69691
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA69691%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [auto1.es] INFO: Scrape type for HA69691: 0
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: BR02548
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR02548%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [auto1.es] INFO: Scrape type for BR02548: 0
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: CK45240
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: NT11654
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: FU44920
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: CH18424
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: KR74310
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR74310%27 HTTP/1.1" 200 None
2026-03-28 14:03:20 [auto1.es] INFO: Scrape type for KR74310: 0
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: HL87277
2026-03-28 14:03:20 [auto1.es] INFO: Found listing with ID: ZS52106
2026-03-28 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS52106%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [auto1.es] INFO: Scrape type for ZS52106: 0
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: GA48296
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: PV57289
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV57289%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [auto1.es] INFO: Scrape type for PV57289: 0
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: DH51017
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: YS24805
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS24805%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [auto1.es] INFO: Scrape type for YS24805: 0
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: KK62636
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK62636%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [auto1.es] INFO: Scrape type for KK62636: 0
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: GP88698
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP88698%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [auto1.es] INFO: Scrape type for GP88698: 0
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: UE51591
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE51591%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [auto1.es] INFO: Scrape type for UE51591: 0
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: KK88543
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: SJ54893
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: UR77549
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: RH13684
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH13684%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [auto1.es] INFO: Scrape type for RH13684: 0
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: RR88978
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: VM33646
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM33646%27 HTTP/1.1" 200 None
2026-03-28 14:03:21 [auto1.es] INFO: Scrape type for VM33646: 0
2026-03-28 14:03:21 [auto1.es] INFO: Found listing with ID: TN33358
2026-03-28 14:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:22 [auto1.es] INFO: Channel: 24h | Page: 46 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: JR18467
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: WH79046
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH79046%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for WH79046: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: YH97828
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: ZR58264
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR58264%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for ZR58264: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: EG55234
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: JY61710
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: MZ20228
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: NF49332
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF49332%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for NF49332: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: GP02900
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP02900%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for GP02900: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: TJ92656
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: TJ35606
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: JL87579
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: CU50273
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: KA14000
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA14000%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for KA14000: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: LU77013
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU77013%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for LU77013: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: UN54067
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN54067%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for UN54067: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: EB66984
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: LE92322
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: FK94642
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: RF34421
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF34421%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for RF34421: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: MF83182
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF83182%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for MF83182: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: UJ15106
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ15106%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for UJ15106: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: SX47256
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX47256%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for SX47256: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: TL38815
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: RT35335
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT35335%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for RT35335: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: AY17458
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AY17458%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for AY17458: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: AX44077
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX44077%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for AX44077: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: LR05195
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR05195%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for LR05195: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: ED43827
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED43827%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for ED43827: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: WE77493
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE77493%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for WE77493: 0
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: TK05995
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: RE01082
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: VR51792
2026-03-28 14:03:22 [auto1.es] INFO: Found listing with ID: WW04715
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW04715%27 HTTP/1.1" 200 None
2026-03-28 14:03:22 [auto1.es] INFO: Scrape type for WW04715: 2
2026-03-28 14:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69dfa4ef-aaa8-535b-b999-be323f400299 with identifier: WW04715
2026-03-28 14:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69dfa4ef-aaa8-535b-b999-be323f400299 with scrape type 2
2026-03-28 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69dfa4ef-aaa8-535b-b999-be323f400299 with scrape type 2
2026-03-28 14:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 69dfa4ef-aaa8-535b-b999-be323f400299, identifier: WW04715
2026-03-28 14:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 69dfa4ef-aaa8-535b-b999-be323f400299 with identifier: WW04715
2026-03-28 14:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 69dfa4ef-aaa8-535b-b999-be323f400299 with identifier: WW04715
2026-03-28 14:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 69dfa4ef-aaa8-535b-b999-be323f400299 with identifier: WW04715 to the API
2026-03-28 14:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:18:53Z',
 'fuel_type': 'petrol',
 'id': '69dfa4ef-aaa8-535b-b999-be323f400299',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW04715',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 201526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2008}
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW04715%27 HTTP/1.1" 200 None
2026-03-28 14:03:23 [auto1.es] INFO: Saving data for WW04715: {'auction_closing_time': 1774714733.0, 'created_time': 1774620106.086915, 'last_price_update_time': 1774706603.155493}
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WW04715') HTTP/1.1" 204 0
2026-03-28 14:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:23 [auto1.es] INFO: Found listing with ID: LP98864
2026-03-28 14:03:23 [auto1.es] INFO: Found listing with ID: CL84602
2026-03-28 14:03:23 [auto1.es] INFO: Found listing with ID: CB44972
2026-03-28 14:03:23 [auto1.es] INFO: Found listing with ID: GB72499
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB72499%27 HTTP/1.1" 200 None
2026-03-28 14:03:23 [auto1.es] INFO: Scrape type for GB72499: 0
2026-03-28 14:03:23 [auto1.es] INFO: Found listing with ID: YG58121
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG58121%27 HTTP/1.1" 200 None
2026-03-28 14:03:23 [auto1.es] INFO: Scrape type for YG58121: 0
2026-03-28 14:03:23 [auto1.es] INFO: Found listing with ID: CM66780
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM66780%27 HTTP/1.1" 200 None
2026-03-28 14:03:23 [auto1.es] INFO: Scrape type for CM66780: 0
2026-03-28 14:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:24 [auto1.es] INFO: Channel: 24h | Page: 47 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: NJ18297
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: JP19484
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP19484%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for JP19484: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: FL72079
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL72079%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for FL72079: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: CD37802
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: KR53631
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR53631%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for KR53631: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: RH73314
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: FM03469
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM03469%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for FM03469: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: DK97910
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: TZ12338
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ12338%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for TZ12338: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: UE32558
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: BL42593
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: VV22800
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV22800%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for VV22800: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: JT33139
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT33139%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for JT33139: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: LV49477
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV49477%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for LV49477: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: CM70741
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: SM51869
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: DU33012
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: LN79000
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN79000%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for LN79000: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: PG51774
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG51774%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for PG51774: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: LA22899
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA22899%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for LA22899: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: LV62700
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: KT03520
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT03520%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for KT03520: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: PR26492
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR26492%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for PR26492: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: MA61689
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: NG44542
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: FT82115
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: EK45789
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK45789%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for EK45789: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: UA81124
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA81124%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for UA81124: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: KZ85278
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ85278%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for KZ85278: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: NN86390
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN86390%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for NN86390: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: MD24315
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: ER91055
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: MT58726
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT58726%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for MT58726: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: MX17134
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: RK31632
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: DH56387
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH56387%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for DH56387: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: JC23738
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: DF11976
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: PL96310
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL96310%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for PL96310: 0
2026-03-28 14:03:24 [auto1.es] INFO: Found listing with ID: FK36826
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK36826%27 HTTP/1.1" 200 None
2026-03-28 14:03:24 [auto1.es] INFO: Scrape type for FK36826: 0
2026-03-28 14:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:25 [auto1.es] INFO: Channel: 24h | Page: 48 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:25 [auto1.es] INFO: Found listing with ID: EV43622
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV43622%27 HTTP/1.1" 200 None
2026-03-28 14:03:25 [auto1.es] INFO: Scrape type for EV43622: 0
2026-03-28 14:03:25 [auto1.es] INFO: Found listing with ID: DR08098
2026-03-28 14:03:25 [auto1.es] INFO: Found listing with ID: VR55239
2026-03-28 14:03:25 [auto1.es] INFO: Found listing with ID: MA33029
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA33029%27 HTTP/1.1" 200 None
2026-03-28 14:03:25 [auto1.es] INFO: Scrape type for MA33029: 0
2026-03-28 14:03:25 [auto1.es] INFO: Found listing with ID: CF71670
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF71670%27 HTTP/1.1" 200 None
2026-03-28 14:03:25 [auto1.es] INFO: Scrape type for CF71670: 0
2026-03-28 14:03:25 [auto1.es] INFO: Found listing with ID: JM46031
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM46031%27 HTTP/1.1" 200 None
2026-03-28 14:03:25 [auto1.es] INFO: Scrape type for JM46031: 0
2026-03-28 14:03:25 [auto1.es] INFO: Found listing with ID: WL49874
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL49874%27 HTTP/1.1" 200 None
2026-03-28 14:03:25 [auto1.es] INFO: Scrape type for WL49874: 0
2026-03-28 14:03:25 [auto1.es] INFO: Found listing with ID: UR06074
2026-03-28 14:03:25 [auto1.es] INFO: Found listing with ID: DU03691
2026-03-28 14:03:25 [auto1.es] INFO: Found listing with ID: BK29060
2026-03-28 14:03:25 [auto1.es] INFO: Found listing with ID: NC38723
2026-03-28 14:03:25 [auto1.es] INFO: Found listing with ID: GA23722
2026-03-28 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA23722%27 HTTP/1.1" 200 None
2026-03-28 14:03:26 [auto1.es] INFO: Scrape type for GA23722: 2
2026-03-28 14:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c529234-f92c-5521-bc1a-e4779be70297 with identifier: GA23722
2026-03-28 14:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c529234-f92c-5521-bc1a-e4779be70297 with scrape type 2
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c529234-f92c-5521-bc1a-e4779be70297 with scrape type 2
2026-03-28 14:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9c529234-f92c-5521-bc1a-e4779be70297, identifier: GA23722
2026-03-28 14:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9c529234-f92c-5521-bc1a-e4779be70297 with identifier: GA23722
2026-03-28 14:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9c529234-f92c-5521-bc1a-e4779be70297 with identifier: GA23722
2026-03-28 14:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9c529234-f92c-5521-bc1a-e4779be70297 with identifier: GA23722 to the API
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:56:32Z',
 'fuel_type': 'diesel',
 'id': '9c529234-f92c-5521-bc1a-e4779be70297',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA23722',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Captiva',
 'odometer': 346588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-30',
 'seller_name': None,
 'title': 'Chevrolet Captiva 2.2 Diesel D LT 2WD',
 'transmission': 'manual',
 'trim': 'D LT 2WD',
 'year': 2011}
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA23722%27 HTTP/1.1" 200 None
2026-03-28 14:03:26 [auto1.es] INFO: Saving data for GA23722: {'auction_closing_time': 1774716992.0, 'created_time': 1774620061.253149, 'last_price_update_time': 1774706606.441492}
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GA23722') HTTP/1.1" 204 0
2026-03-28 14:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:26 [auto1.es] INFO: Found listing with ID: RE88096
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE88096%27 HTTP/1.1" 200 None
2026-03-28 14:03:26 [auto1.es] INFO: Scrape type for RE88096: 0
2026-03-28 14:03:26 [auto1.es] INFO: Found listing with ID: UB92538
2026-03-28 14:03:26 [auto1.es] INFO: Found listing with ID: VW16333
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW16333%27 HTTP/1.1" 200 None
2026-03-28 14:03:26 [auto1.es] INFO: Scrape type for VW16333: 2
2026-03-28 14:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1386791e-3a12-5076-8c30-962a4c1cf35b with identifier: VW16333
2026-03-28 14:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1386791e-3a12-5076-8c30-962a4c1cf35b with scrape type 2
2026-03-28 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1386791e-3a12-5076-8c30-962a4c1cf35b with scrape type 2
2026-03-28 14:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1386791e-3a12-5076-8c30-962a4c1cf35b, identifier: VW16333
2026-03-28 14:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1386791e-3a12-5076-8c30-962a4c1cf35b with identifier: VW16333
2026-03-28 14:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1386791e-3a12-5076-8c30-962a4c1cf35b with identifier: VW16333
2026-03-28 14:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1386791e-3a12-5076-8c30-962a4c1cf35b with identifier: VW16333 to the API
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:07:40Z',
 'fuel_type': 'petrol',
 'id': '1386791e-3a12-5076-8c30-962a4c1cf35b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW16333',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 91192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-28 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW16333%27 HTTP/1.1" 200 None
2026-03-28 14:03:27 [auto1.es] INFO: Saving data for VW16333: {'auction_closing_time': 1774714060.0, 'created_time': 1774620066.989078, 'last_price_update_time': 1774706607.004426}
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VW16333') HTTP/1.1" 204 0
2026-03-28 14:03:27 [auto1.es] INFO: Found listing with ID: LW24131
2026-03-28 14:03:27 [auto1.es] INFO: Found listing with ID: JH23969
2026-03-28 14:03:27 [auto1.es] INFO: Found listing with ID: GU02949
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU02949%27 HTTP/1.1" 200 None
2026-03-28 14:03:27 [auto1.es] INFO: Scrape type for GU02949: 2
2026-03-28 14:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5718faf-078f-5be1-96ac-33df6466f342 with identifier: GU02949
2026-03-28 14:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5718faf-078f-5be1-96ac-33df6466f342 with scrape type 2
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5718faf-078f-5be1-96ac-33df6466f342 with scrape type 2
2026-03-28 14:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b5718faf-078f-5be1-96ac-33df6466f342, identifier: GU02949
2026-03-28 14:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b5718faf-078f-5be1-96ac-33df6466f342 with identifier: GU02949
2026-03-28 14:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b5718faf-078f-5be1-96ac-33df6466f342 with identifier: GU02949
2026-03-28 14:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b5718faf-078f-5be1-96ac-33df6466f342 with identifier: GU02949 to the API
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:31:47Z',
 'fuel_type': 'diesel',
 'id': 'b5718faf-078f-5be1-96ac-33df6466f342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU02949',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '1007',
 'odometer': 102017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-29',
 'seller_name': None,
 'title': 'Peugeot 1007 1.6 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2007}
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU02949%27 HTTP/1.1" 200 None
2026-03-28 14:03:27 [auto1.es] INFO: Saving data for GU02949: {'auction_closing_time': 1774715507.0, 'created_time': 1774620062.807664, 'last_price_update_time': 1774706607.397588}
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GU02949') HTTP/1.1" 204 0
2026-03-28 14:03:27 [auto1.es] INFO: Found listing with ID: AD94776
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD94776%27 HTTP/1.1" 200 None
2026-03-28 14:03:27 [auto1.es] INFO: Scrape type for AD94776: 2
2026-03-28 14:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2b217eb-33db-58f0-94bc-7b125e273aba with identifier: AD94776
2026-03-28 14:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2b217eb-33db-58f0-94bc-7b125e273aba with scrape type 2
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2b217eb-33db-58f0-94bc-7b125e273aba with scrape type 2
2026-03-28 14:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d2b217eb-33db-58f0-94bc-7b125e273aba, identifier: AD94776
2026-03-28 14:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d2b217eb-33db-58f0-94bc-7b125e273aba with identifier: AD94776
2026-03-28 14:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d2b217eb-33db-58f0-94bc-7b125e273aba with identifier: AD94776
2026-03-28 14:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d2b217eb-33db-58f0-94bc-7b125e273aba with identifier: AD94776 to the API
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:38:21Z',
 'fuel_type': 'diesel',
 'id': 'd2b217eb-33db-58f0-94bc-7b125e273aba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD94776',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker Express',
 'odometer': 361702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-10',
 'seller_name': None,
 'title': 'Dacia Dokker Express 1.5 dCi Diesel Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2017}
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD94776%27 HTTP/1.1" 200 None
2026-03-28 14:03:27 [auto1.es] INFO: Saving data for AD94776: {'auction_closing_time': 1774715901.0, 'created_time': 1774620070.118874, 'last_price_update_time': 1774706607.821111}
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AD94776') HTTP/1.1" 204 0
2026-03-28 14:03:27 [auto1.es] INFO: Found listing with ID: FY67843
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY67843%27 HTTP/1.1" 200 None
2026-03-28 14:03:27 [auto1.es] INFO: Scrape type for FY67843: 2
2026-03-28 14:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd4cce29-4d8f-56f9-9aa6-bce65a0e6d2e with identifier: FY67843
2026-03-28 14:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd4cce29-4d8f-56f9-9aa6-bce65a0e6d2e with scrape type 2
2026-03-28 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd4cce29-4d8f-56f9-9aa6-bce65a0e6d2e with scrape type 2
2026-03-28 14:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fd4cce29-4d8f-56f9-9aa6-bce65a0e6d2e, identifier: FY67843
2026-03-28 14:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fd4cce29-4d8f-56f9-9aa6-bce65a0e6d2e with identifier: FY67843
2026-03-28 14:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fd4cce29-4d8f-56f9-9aa6-bce65a0e6d2e with identifier: FY67843
2026-03-28 14:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fd4cce29-4d8f-56f9-9aa6-bce65a0e6d2e with identifier: FY67843 to the API
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:51:31Z',
 'fuel_type': 'petrol',
 'id': 'fd4cce29-4d8f-56f9-9aa6-bce65a0e6d2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY67843',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 101974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-20',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.2 PureTech C-Series',
 'transmission': 'automatic',
 'trim': 'C-Series',
 'year': 2020}
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY67843%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [auto1.es] INFO: Saving data for FY67843: {'auction_closing_time': 1774716691.0, 'created_time': 1774620079.686181, 'last_price_update_time': 1774706608.202128}
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FY67843') HTTP/1.1" 204 0
2026-03-28 14:03:28 [auto1.es] INFO: Found listing with ID: CJ73946
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ73946%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [auto1.es] INFO: Scrape type for CJ73946: 2
2026-03-28 14:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e65d497-ca9e-5e80-8630-a45c23087f52 with identifier: CJ73946
2026-03-28 14:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e65d497-ca9e-5e80-8630-a45c23087f52 with scrape type 2
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e65d497-ca9e-5e80-8630-a45c23087f52 with scrape type 2
2026-03-28 14:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e65d497-ca9e-5e80-8630-a45c23087f52, identifier: CJ73946
2026-03-28 14:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e65d497-ca9e-5e80-8630-a45c23087f52 with identifier: CJ73946
2026-03-28 14:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e65d497-ca9e-5e80-8630-a45c23087f52 with identifier: CJ73946
2026-03-28 14:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8e65d497-ca9e-5e80-8630-a45c23087f52 with identifier: CJ73946 to the API
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:23:03Z',
 'fuel_type': 'diesel',
 'id': '8e65d497-ca9e-5e80-8630-a45c23087f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ73946',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 208467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-11',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ73946%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [auto1.es] INFO: Saving data for CJ73946: {'auction_closing_time': 1774714983.0, 'created_time': 1773127666.169105, 'last_price_update_time': 1774706608.598072}
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CJ73946') HTTP/1.1" 204 0
2026-03-28 14:03:28 [auto1.es] INFO: Found listing with ID: HW14857
2026-03-28 14:03:28 [auto1.es] INFO: Found listing with ID: YP76490
2026-03-28 14:03:28 [auto1.es] INFO: Found listing with ID: KD88168
2026-03-28 14:03:28 [auto1.es] INFO: Found listing with ID: MJ15003
2026-03-28 14:03:28 [auto1.es] INFO: Found listing with ID: BX46671
2026-03-28 14:03:28 [auto1.es] INFO: Found listing with ID: XH33697
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH33697%27 HTTP/1.1" 200 None
2026-03-28 14:03:28 [auto1.es] INFO: Scrape type for XH33697: 2
2026-03-28 14:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7d607e5-8eda-53cb-a6d0-4444865f9193 with identifier: XH33697
2026-03-28 14:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7d607e5-8eda-53cb-a6d0-4444865f9193 with scrape type 2
2026-03-28 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7d607e5-8eda-53cb-a6d0-4444865f9193 with scrape type 2
2026-03-28 14:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d7d607e5-8eda-53cb-a6d0-4444865f9193, identifier: XH33697
2026-03-28 14:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d7d607e5-8eda-53cb-a6d0-4444865f9193 with identifier: XH33697
2026-03-28 14:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d7d607e5-8eda-53cb-a6d0-4444865f9193 with identifier: XH33697
2026-03-28 14:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d7d607e5-8eda-53cb-a6d0-4444865f9193 with identifier: XH33697 to the API
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:38:00Z',
 'fuel_type': 'petrol',
 'id': 'd7d607e5-8eda-53cb-a6d0-4444865f9193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH33697',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 86198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'manual',
 'trim': 'GTI Performance BlueMotion',
 'year': 2017}
2026-03-28 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH33697%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [auto1.es] INFO: Saving data for XH33697: {'auction_closing_time': 1774715880.0, 'created_time': 1774620094.920503, 'last_price_update_time': 1774706609.007719}
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XH33697') HTTP/1.1" 204 0
2026-03-28 14:03:29 [auto1.es] INFO: Found listing with ID: AK05110
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK05110%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [auto1.es] INFO: Scrape type for AK05110: 0
2026-03-28 14:03:29 [auto1.es] INFO: Found listing with ID: KA10637
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA10637%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [auto1.es] INFO: Scrape type for KA10637: 2
2026-03-28 14:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33b5c195-c05a-5b89-9a3d-83bee0164cd3 with identifier: KA10637
2026-03-28 14:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33b5c195-c05a-5b89-9a3d-83bee0164cd3 with scrape type 2
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33b5c195-c05a-5b89-9a3d-83bee0164cd3 with scrape type 2
2026-03-28 14:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 33b5c195-c05a-5b89-9a3d-83bee0164cd3, identifier: KA10637
2026-03-28 14:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 33b5c195-c05a-5b89-9a3d-83bee0164cd3 with identifier: KA10637
2026-03-28 14:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 33b5c195-c05a-5b89-9a3d-83bee0164cd3 with identifier: KA10637
2026-03-28 14:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 33b5c195-c05a-5b89-9a3d-83bee0164cd3 with identifier: KA10637 to the API
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:37:45Z',
 'fuel_type': 'diesel',
 'id': '33b5c195-c05a-5b89-9a3d-83bee0164cd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA10637',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 260012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2010}
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA10637%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [auto1.es] INFO: Saving data for KA10637: {'auction_closing_time': 1774715865.0, 'created_time': 1774620076.757388, 'last_price_update_time': 1774706609.48749}
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KA10637') HTTP/1.1" 204 0
2026-03-28 14:03:29 [auto1.es] INFO: Found listing with ID: RK54634
2026-03-28 14:03:29 [auto1.es] INFO: Found listing with ID: YF73149
2026-03-28 14:03:29 [auto1.es] INFO: Found listing with ID: NM67545
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM67545%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [auto1.es] INFO: Scrape type for NM67545: 2
2026-03-28 14:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb702d63-ce1c-504e-a154-8914b746b0b7 with identifier: NM67545
2026-03-28 14:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb702d63-ce1c-504e-a154-8914b746b0b7 with scrape type 2
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb702d63-ce1c-504e-a154-8914b746b0b7 with scrape type 2
2026-03-28 14:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bb702d63-ce1c-504e-a154-8914b746b0b7, identifier: NM67545
2026-03-28 14:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bb702d63-ce1c-504e-a154-8914b746b0b7 with identifier: NM67545
2026-03-28 14:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bb702d63-ce1c-504e-a154-8914b746b0b7 with identifier: NM67545
2026-03-28 14:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bb702d63-ce1c-504e-a154-8914b746b0b7 with identifier: NM67545 to the API
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:45:01Z',
 'fuel_type': 'diesel',
 'id': 'bb702d63-ce1c-504e-a154-8914b746b0b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM67545',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 239039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI GTD',
 'transmission': 'automatic',
 'trim': 'GTD',
 'year': 2010}
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM67545%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [auto1.es] INFO: Saving data for NM67545: {'auction_closing_time': 1774716301.0, 'created_time': 1774620080.810341, 'last_price_update_time': 1774706609.855395}
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NM67545') HTTP/1.1" 204 0
2026-03-28 14:03:29 [auto1.es] INFO: Found listing with ID: FX35940
2026-03-28 14:03:29 [auto1.es] INFO: Found listing with ID: KA04822
2026-03-28 14:03:29 [auto1.es] INFO: Found listing with ID: YU55670
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU55670%27 HTTP/1.1" 200 None
2026-03-28 14:03:29 [auto1.es] INFO: Scrape type for YU55670: 2
2026-03-28 14:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca658baa-c43e-5494-8037-11ba9cf333ec with identifier: YU55670
2026-03-28 14:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca658baa-c43e-5494-8037-11ba9cf333ec with scrape type 2
2026-03-28 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca658baa-c43e-5494-8037-11ba9cf333ec with scrape type 2
2026-03-28 14:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ca658baa-c43e-5494-8037-11ba9cf333ec, identifier: YU55670
2026-03-28 14:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ca658baa-c43e-5494-8037-11ba9cf333ec with identifier: YU55670
2026-03-28 14:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ca658baa-c43e-5494-8037-11ba9cf333ec with identifier: YU55670
2026-03-28 14:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ca658baa-c43e-5494-8037-11ba9cf333ec with identifier: YU55670 to the API
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:20:57Z',
 'fuel_type': 'petrol',
 'id': 'ca658baa-c43e-5494-8037-11ba9cf333ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU55670',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 121869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-21',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU55670%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [auto1.es] INFO: Saving data for YU55670: {'auction_closing_time': 1774714857.0, 'created_time': 1773132483.073077, 'last_price_update_time': 1774706610.371974}
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YU55670') HTTP/1.1" 204 0
2026-03-28 14:03:30 [auto1.es] INFO: Found listing with ID: AR66930
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR66930%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [auto1.es] INFO: Scrape type for AR66930: 2
2026-03-28 14:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a163f81-ebc4-5c4c-a132-1a2df7a79fbe with identifier: AR66930
2026-03-28 14:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a163f81-ebc4-5c4c-a132-1a2df7a79fbe with scrape type 2
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a163f81-ebc4-5c4c-a132-1a2df7a79fbe with scrape type 2
2026-03-28 14:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9a163f81-ebc4-5c4c-a132-1a2df7a79fbe, identifier: AR66930
2026-03-28 14:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9a163f81-ebc4-5c4c-a132-1a2df7a79fbe with identifier: AR66930
2026-03-28 14:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9a163f81-ebc4-5c4c-a132-1a2df7a79fbe with identifier: AR66930
2026-03-28 14:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9a163f81-ebc4-5c4c-a132-1a2df7a79fbe with identifier: AR66930 to the API
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:52:42Z',
 'fuel_type': 'diesel',
 'id': '9a163f81-ebc4-5c4c-a132-1a2df7a79fbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR66930',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 35670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-25',
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR66930%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [auto1.es] INFO: Saving data for AR66930: {'auction_closing_time': 1774716762.0, 'created_time': 1774620064.074547, 'last_price_update_time': 1774706610.86913}
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AR66930') HTTP/1.1" 204 0
2026-03-28 14:03:30 [auto1.es] INFO: Found listing with ID: MS70085
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS70085%27 HTTP/1.1" 200 None
2026-03-28 14:03:30 [auto1.es] INFO: Scrape type for MS70085: 2
2026-03-28 14:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c5d3138-6924-592b-9c57-56ac43c899f5 with identifier: MS70085
2026-03-28 14:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c5d3138-6924-592b-9c57-56ac43c899f5 with scrape type 2
2026-03-28 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c5d3138-6924-592b-9c57-56ac43c899f5 with scrape type 2
2026-03-28 14:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9c5d3138-6924-592b-9c57-56ac43c899f5, identifier: MS70085
2026-03-28 14:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9c5d3138-6924-592b-9c57-56ac43c899f5 with identifier: MS70085
2026-03-28 14:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9c5d3138-6924-592b-9c57-56ac43c899f5 with identifier: MS70085
2026-03-28 14:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9c5d3138-6924-592b-9c57-56ac43c899f5 with identifier: MS70085 to the API
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:41:37Z',
 'fuel_type': 'diesel',
 'id': '9c5d3138-6924-592b-9c57-56ac43c899f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS70085',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Tivoli',
 'odometer': 224973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-22',
 'seller_name': None,
 'title': 'Ssangyong Tivoli 1.6 Turbodiesel Premium 4x4',
 'transmission': 'manual',
 'trim': 'Premium 4x4',
 'year': 2016}
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS70085%27 HTTP/1.1" 200 None
2026-03-28 14:03:31 [auto1.es] INFO: Saving data for MS70085: {'auction_closing_time': 1774716097.0, 'created_time': 1774620080.43047, 'last_price_update_time': 1774706611.499529}
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MS70085') HTTP/1.1" 204 0
2026-03-28 14:03:31 [auto1.es] INFO: Found listing with ID: EY91693
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY91693%27 HTTP/1.1" 200 None
2026-03-28 14:03:31 [auto1.es] INFO: Scrape type for EY91693: 2
2026-03-28 14:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ad0bd60-5d75-5b21-a314-bc6fb760a802 with identifier: EY91693
2026-03-28 14:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ad0bd60-5d75-5b21-a314-bc6fb760a802 with scrape type 2
2026-03-28 14:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ad0bd60-5d75-5b21-a314-bc6fb760a802 with scrape type 2
2026-03-28 14:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2ad0bd60-5d75-5b21-a314-bc6fb760a802, identifier: EY91693
2026-03-28 14:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2ad0bd60-5d75-5b21-a314-bc6fb760a802 with identifier: EY91693
2026-03-28 14:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2ad0bd60-5d75-5b21-a314-bc6fb760a802 with identifier: EY91693
2026-03-28 14:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2ad0bd60-5d75-5b21-a314-bc6fb760a802 with identifier: EY91693 to the API
2026-03-28 14:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:08:04Z',
 'fuel_type': 'diesel',
 'id': '2ad0bd60-5d75-5b21-a314-bc6fb760a802',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY91693',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 95017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-12',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY91693%27 HTTP/1.1" 200 None
2026-03-28 14:03:32 [auto1.es] INFO: Saving data for EY91693: {'auction_closing_time': 1774714084.0, 'created_time': 1773127840.445833, 'last_price_update_time': 1774706612.13369}
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EY91693') HTTP/1.1" 204 0
2026-03-28 14:03:32 [auto1.es] INFO: Found listing with ID: SK48295
2026-03-28 14:03:32 [auto1.es] INFO: Found listing with ID: RD09772
2026-03-28 14:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:34 [auto1.es] INFO: Channel: 24h | Page: 49 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:34 [auto1.es] INFO: Found listing with ID: DC98818
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC98818%27 HTTP/1.1" 200 None
2026-03-28 14:03:34 [auto1.es] INFO: Scrape type for DC98818: 2
2026-03-28 14:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ddcea36-050e-5589-8df4-8a279eed674a with identifier: DC98818
2026-03-28 14:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ddcea36-050e-5589-8df4-8a279eed674a with scrape type 2
2026-03-28 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ddcea36-050e-5589-8df4-8a279eed674a with scrape type 2
2026-03-28 14:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8ddcea36-050e-5589-8df4-8a279eed674a, identifier: DC98818
2026-03-28 14:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8ddcea36-050e-5589-8df4-8a279eed674a with identifier: DC98818
2026-03-28 14:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8ddcea36-050e-5589-8df4-8a279eed674a with identifier: DC98818
2026-03-28 14:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8ddcea36-050e-5589-8df4-8a279eed674a with identifier: DC98818 to the API
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:34:50Z',
 'fuel_type': 'diesel',
 'id': '8ddcea36-050e-5589-8df4-8a279eed674a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC98818',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 170287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-29',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2015}
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC98818%27 HTTP/1.1" 200 None
2026-03-28 14:03:34 [auto1.es] INFO: Saving data for DC98818: {'auction_closing_time': 1774715690.0, 'created_time': 1774620065.8008, 'last_price_update_time': 1774706614.758958}
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DC98818') HTTP/1.1" 204 0
2026-03-28 14:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:34 [auto1.es] INFO: Found listing with ID: FG46245
2026-03-28 14:03:34 [auto1.es] INFO: Found listing with ID: ZC78414
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC78414%27 HTTP/1.1" 200 None
2026-03-28 14:03:34 [auto1.es] INFO: Scrape type for ZC78414: 2
2026-03-28 14:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a21d740-9551-5e79-ad5f-97aee230f2c8 with identifier: ZC78414
2026-03-28 14:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a21d740-9551-5e79-ad5f-97aee230f2c8 with scrape type 2
2026-03-28 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a21d740-9551-5e79-ad5f-97aee230f2c8 with scrape type 2
2026-03-28 14:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9a21d740-9551-5e79-ad5f-97aee230f2c8, identifier: ZC78414
2026-03-28 14:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9a21d740-9551-5e79-ad5f-97aee230f2c8 with identifier: ZC78414
2026-03-28 14:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9a21d740-9551-5e79-ad5f-97aee230f2c8 with identifier: ZC78414
2026-03-28 14:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9a21d740-9551-5e79-ad5f-97aee230f2c8 with identifier: ZC78414 to the API
2026-03-28 14:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:25:08Z',
 'fuel_type': 'petrol',
 'id': '9a21d740-9551-5e79-ad5f-97aee230f2c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC78414',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 99679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-12',
 'seller_name': None,
 'title': 'Citroen C5 2.0 Premier',
 'transmission': 'manual',
 'trim': 'Premier',
 'year': 2005}
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC78414%27 HTTP/1.1" 200 None
2026-03-28 14:03:35 [auto1.es] INFO: Saving data for ZC78414: {'auction_closing_time': 1774715108.0, 'created_time': 1774001899.793096, 'last_price_update_time': 1774706615.175809}
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZC78414') HTTP/1.1" 204 0
2026-03-28 14:03:35 [auto1.es] INFO: Found listing with ID: SV12911
2026-03-28 14:03:35 [auto1.es] INFO: Found listing with ID: SW56869
2026-03-28 14:03:35 [auto1.es] INFO: Found listing with ID: HB55085
2026-03-28 14:03:35 [auto1.es] INFO: Found listing with ID: KB02477
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB02477%27 HTTP/1.1" 200 None
2026-03-28 14:03:35 [auto1.es] INFO: Scrape type for KB02477: 2
2026-03-28 14:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b4cf193-6141-5cfe-8da3-f6a198aee4df with identifier: KB02477
2026-03-28 14:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b4cf193-6141-5cfe-8da3-f6a198aee4df with scrape type 2
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b4cf193-6141-5cfe-8da3-f6a198aee4df with scrape type 2
2026-03-28 14:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7b4cf193-6141-5cfe-8da3-f6a198aee4df, identifier: KB02477
2026-03-28 14:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7b4cf193-6141-5cfe-8da3-f6a198aee4df with identifier: KB02477
2026-03-28 14:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7b4cf193-6141-5cfe-8da3-f6a198aee4df with identifier: KB02477
2026-03-28 14:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7b4cf193-6141-5cfe-8da3-f6a198aee4df with identifier: KB02477 to the API
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:41:59Z',
 'fuel_type': 'petrol',
 'id': '7b4cf193-6141-5cfe-8da3-f6a198aee4df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB02477',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 88965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-26',
 'seller_name': None,
 'title': 'Toyota Corolla 1.6 Compact Sol',
 'transmission': 'manual',
 'trim': 'Compact Sol',
 'year': 2005}
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB02477%27 HTTP/1.1" 200 None
2026-03-28 14:03:35 [auto1.es] INFO: Saving data for KB02477: {'auction_closing_time': 1774716119.0, 'created_time': 1773843142.224435, 'last_price_update_time': 1774706615.530367}
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KB02477') HTTP/1.1" 204 0
2026-03-28 14:03:35 [auto1.es] INFO: Found listing with ID: XY62505
2026-03-28 14:03:35 [auto1.es] INFO: Found listing with ID: VC51295
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC51295%27 HTTP/1.1" 200 None
2026-03-28 14:03:35 [auto1.es] INFO: Scrape type for VC51295: 2
2026-03-28 14:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a63730d5-dd06-523c-a268-f9cac4cbae5d with identifier: VC51295
2026-03-28 14:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a63730d5-dd06-523c-a268-f9cac4cbae5d with scrape type 2
2026-03-28 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a63730d5-dd06-523c-a268-f9cac4cbae5d with scrape type 2
2026-03-28 14:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a63730d5-dd06-523c-a268-f9cac4cbae5d, identifier: VC51295
2026-03-28 14:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a63730d5-dd06-523c-a268-f9cac4cbae5d with identifier: VC51295
2026-03-28 14:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a63730d5-dd06-523c-a268-f9cac4cbae5d with identifier: VC51295
2026-03-28 14:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a63730d5-dd06-523c-a268-f9cac4cbae5d with identifier: VC51295 to the API
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:37:23Z',
 'fuel_type': 'diesel',
 'id': 'a63730d5-dd06-523c-a268-f9cac4cbae5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC51295',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 171175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2009}
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC51295%27 HTTP/1.1" 200 None
2026-03-28 14:03:35 [auto1.es] INFO: Saving data for VC51295: {'auction_closing_time': 1774715843.0, 'created_time': 1774620104.387614, 'last_price_update_time': 1774706615.923853}
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VC51295') HTTP/1.1" 204 0
2026-03-28 14:03:36 [auto1.es] INFO: Found listing with ID: ZU80420
2026-03-28 14:03:36 [auto1.es] INFO: Found listing with ID: CX94622
2026-03-28 14:03:36 [auto1.es] INFO: Found listing with ID: CV01854
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV01854%27 HTTP/1.1" 200 None
2026-03-28 14:03:36 [auto1.es] INFO: Scrape type for CV01854: 2
2026-03-28 14:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dab811f-8fdc-55f4-8aea-8196cd84998d with identifier: CV01854
2026-03-28 14:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dab811f-8fdc-55f4-8aea-8196cd84998d with scrape type 2
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dab811f-8fdc-55f4-8aea-8196cd84998d with scrape type 2
2026-03-28 14:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7dab811f-8fdc-55f4-8aea-8196cd84998d, identifier: CV01854
2026-03-28 14:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7dab811f-8fdc-55f4-8aea-8196cd84998d with identifier: CV01854
2026-03-28 14:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7dab811f-8fdc-55f4-8aea-8196cd84998d with identifier: CV01854
2026-03-28 14:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7dab811f-8fdc-55f4-8aea-8196cd84998d with identifier: CV01854 to the API
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:52:21Z',
 'fuel_type': 'diesel',
 'id': '7dab811f-8fdc-55f4-8aea-8196cd84998d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV01854',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 172539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-08',
 'seller_name': None,
 'title': 'BMW 2er 216d Gran Tourer',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV01854%27 HTTP/1.1" 200 None
2026-03-28 14:03:36 [auto1.es] INFO: Saving data for CV01854: {'auction_closing_time': 1774716741.0, 'created_time': 1773126778.785738, 'last_price_update_time': 1774706616.441667}
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CV01854') HTTP/1.1" 204 0
2026-03-28 14:03:36 [auto1.es] INFO: Found listing with ID: NH75257
2026-03-28 14:03:36 [auto1.es] INFO: Found listing with ID: MC91810
2026-03-28 14:03:36 [auto1.es] INFO: Found listing with ID: XX41705
2026-03-28 14:03:36 [auto1.es] INFO: Found listing with ID: WC11174
2026-03-28 14:03:36 [auto1.es] INFO: Found listing with ID: TX02907
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX02907%27 HTTP/1.1" 200 None
2026-03-28 14:03:36 [auto1.es] INFO: Scrape type for TX02907: 2
2026-03-28 14:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d070d0f-0994-5065-828a-bc80875160c2 with identifier: TX02907
2026-03-28 14:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d070d0f-0994-5065-828a-bc80875160c2 with scrape type 2
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d070d0f-0994-5065-828a-bc80875160c2 with scrape type 2
2026-03-28 14:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3d070d0f-0994-5065-828a-bc80875160c2, identifier: TX02907
2026-03-28 14:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3d070d0f-0994-5065-828a-bc80875160c2 with identifier: TX02907
2026-03-28 14:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3d070d0f-0994-5065-828a-bc80875160c2 with identifier: TX02907
2026-03-28 14:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3d070d0f-0994-5065-828a-bc80875160c2 with identifier: TX02907 to the API
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:28:25Z',
 'fuel_type': 'diesel',
 'id': '3d070d0f-0994-5065-828a-bc80875160c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX02907',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 247385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2008}
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX02907%27 HTTP/1.1" 200 None
2026-03-28 14:03:36 [auto1.es] INFO: Saving data for TX02907: {'auction_closing_time': 1774715305.0, 'created_time': 1774620093.899448, 'last_price_update_time': 1774706616.8286}
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TX02907') HTTP/1.1" 204 0
2026-03-28 14:03:36 [auto1.es] INFO: Found listing with ID: GT49964
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT49964%27 HTTP/1.1" 200 None
2026-03-28 14:03:36 [auto1.es] INFO: Scrape type for GT49964: 2
2026-03-28 14:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eb13acc-70bd-59f8-b8f5-9504484b7cf8 with identifier: GT49964
2026-03-28 14:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eb13acc-70bd-59f8-b8f5-9504484b7cf8 with scrape type 2
2026-03-28 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eb13acc-70bd-59f8-b8f5-9504484b7cf8 with scrape type 2
2026-03-28 14:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6eb13acc-70bd-59f8-b8f5-9504484b7cf8, identifier: GT49964
2026-03-28 14:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6eb13acc-70bd-59f8-b8f5-9504484b7cf8 with identifier: GT49964
2026-03-28 14:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6eb13acc-70bd-59f8-b8f5-9504484b7cf8 with identifier: GT49964
2026-03-28 14:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6eb13acc-70bd-59f8-b8f5-9504484b7cf8 with identifier: GT49964 to the API
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 173,
 'expiration_date': '2026-03-28T16:55:00Z',
 'fuel_type': 'diesel',
 'id': '6eb13acc-70bd-59f8-b8f5-9504484b7cf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT49964',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Land Cruiser',
 'odometer': 226493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-26',
 'seller_name': None,
 'title': 'Toyota Land Cruiser 3.0 D-4D VX',
 'transmission': 'manual',
 'trim': 'VX',
 'year': 2006}
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT49964%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [auto1.es] INFO: Saving data for GT49964: {'auction_closing_time': 1774716900.0, 'created_time': 1773238297.852439, 'last_price_update_time': 1774706617.208695}
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GT49964') HTTP/1.1" 204 0
2026-03-28 14:03:37 [auto1.es] INFO: Found listing with ID: RU11910
2026-03-28 14:03:37 [auto1.es] INFO: Found listing with ID: MR81111
2026-03-28 14:03:37 [auto1.es] INFO: Found listing with ID: AG64385
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG64385%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [auto1.es] INFO: Scrape type for AG64385: 2
2026-03-28 14:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc0d029c-9043-525e-8ace-a11d08c7861e with identifier: AG64385
2026-03-28 14:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc0d029c-9043-525e-8ace-a11d08c7861e with scrape type 2
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc0d029c-9043-525e-8ace-a11d08c7861e with scrape type 2
2026-03-28 14:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bc0d029c-9043-525e-8ace-a11d08c7861e, identifier: AG64385
2026-03-28 14:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bc0d029c-9043-525e-8ace-a11d08c7861e with identifier: AG64385
2026-03-28 14:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bc0d029c-9043-525e-8ace-a11d08c7861e with identifier: AG64385
2026-03-28 14:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bc0d029c-9043-525e-8ace-a11d08c7861e with identifier: AG64385 to the API
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:25:56Z',
 'fuel_type': 'diesel',
 'id': 'bc0d029c-9043-525e-8ace-a11d08c7861e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG64385',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 127494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2022}
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG64385%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [auto1.es] INFO: Saving data for AG64385: {'auction_closing_time': 1774715156.0, 'created_time': 1774382558.747755, 'last_price_update_time': 1774706617.603879}
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AG64385') HTTP/1.1" 204 0
2026-03-28 14:03:37 [auto1.es] INFO: Found listing with ID: DE89755
2026-03-28 14:03:37 [auto1.es] INFO: Found listing with ID: FD55064
2026-03-28 14:03:37 [auto1.es] INFO: Found listing with ID: ZZ21581
2026-03-28 14:03:37 [auto1.es] INFO: Found listing with ID: UN59874
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN59874%27 HTTP/1.1" 200 None
2026-03-28 14:03:37 [auto1.es] INFO: Scrape type for UN59874: 2
2026-03-28 14:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c0ccb85-bf31-52cc-a9f2-a8c1badf4edf with identifier: UN59874
2026-03-28 14:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c0ccb85-bf31-52cc-a9f2-a8c1badf4edf with scrape type 2
2026-03-28 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c0ccb85-bf31-52cc-a9f2-a8c1badf4edf with scrape type 2
2026-03-28 14:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7c0ccb85-bf31-52cc-a9f2-a8c1badf4edf, identifier: UN59874
2026-03-28 14:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7c0ccb85-bf31-52cc-a9f2-a8c1badf4edf with identifier: UN59874
2026-03-28 14:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7c0ccb85-bf31-52cc-a9f2-a8c1badf4edf with identifier: UN59874
2026-03-28 14:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7c0ccb85-bf31-52cc-a9f2-a8c1badf4edf with identifier: UN59874 to the API
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:04:20Z',
 'fuel_type': 'petrol',
 'id': '7c0ccb85-bf31-52cc-a9f2-a8c1badf4edf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN59874',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 72511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-01',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN59874%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [auto1.es] INFO: Saving data for UN59874: {'auction_closing_time': 1774713860.0, 'created_time': 1773950467.161421, 'last_price_update_time': 1774706618.100782}
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UN59874') HTTP/1.1" 204 0
2026-03-28 14:03:38 [auto1.es] INFO: Found listing with ID: TS70412
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS70412%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [auto1.es] INFO: Scrape type for TS70412: 2
2026-03-28 14:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 826a6fe1-4c3c-5bcc-b3ab-566c02fe5202 with identifier: TS70412
2026-03-28 14:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 826a6fe1-4c3c-5bcc-b3ab-566c02fe5202 with scrape type 2
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 826a6fe1-4c3c-5bcc-b3ab-566c02fe5202 with scrape type 2
2026-03-28 14:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 826a6fe1-4c3c-5bcc-b3ab-566c02fe5202, identifier: TS70412
2026-03-28 14:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 826a6fe1-4c3c-5bcc-b3ab-566c02fe5202 with identifier: TS70412
2026-03-28 14:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 826a6fe1-4c3c-5bcc-b3ab-566c02fe5202 with identifier: TS70412
2026-03-28 14:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 826a6fe1-4c3c-5bcc-b3ab-566c02fe5202 with identifier: TS70412 to the API
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:34:34Z',
 'fuel_type': 'diesel',
 'id': '826a6fe1-4c3c-5bcc-b3ab-566c02fe5202',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS70412',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 181619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-18',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Sport Pack',
 'transmission': 'manual',
 'trim': 'Sport Pack',
 'year': 2009}
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS70412%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [auto1.es] INFO: Saving data for TS70412: {'auction_closing_time': 1774715674.0, 'created_time': 1774620135.34753, 'last_price_update_time': 1774706618.483183}
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TS70412') HTTP/1.1" 204 0
2026-03-28 14:03:38 [auto1.es] INFO: Found listing with ID: LB05915
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB05915%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [auto1.es] INFO: Scrape type for LB05915: 2
2026-03-28 14:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f56515f-fc4e-57c2-9a6b-90fbbad9d0a5 with identifier: LB05915
2026-03-28 14:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f56515f-fc4e-57c2-9a6b-90fbbad9d0a5 with scrape type 2
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f56515f-fc4e-57c2-9a6b-90fbbad9d0a5 with scrape type 2
2026-03-28 14:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f56515f-fc4e-57c2-9a6b-90fbbad9d0a5, identifier: LB05915
2026-03-28 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f56515f-fc4e-57c2-9a6b-90fbbad9d0a5 with identifier: LB05915
2026-03-28 14:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f56515f-fc4e-57c2-9a6b-90fbbad9d0a5 with identifier: LB05915
2026-03-28 14:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f56515f-fc4e-57c2-9a6b-90fbbad9d0a5 with identifier: LB05915 to the API
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:48:13Z',
 'fuel_type': 'diesel',
 'id': '6f56515f-fc4e-57c2-9a6b-90fbbad9d0a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB05915',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 150131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-10',
 'seller_name': None,
 'title': 'Audi A4 45 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2019}
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB05915%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [auto1.es] INFO: Saving data for LB05915: {'auction_closing_time': 1774716493.0, 'created_time': 1773950494.187907, 'last_price_update_time': 1774706618.922939}
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LB05915') HTTP/1.1" 204 0
2026-03-28 14:03:38 [auto1.es] INFO: Found listing with ID: GU38907
2026-03-28 14:03:38 [auto1.es] INFO: Found listing with ID: ZD47887
2026-03-28 14:03:38 [auto1.es] INFO: Found listing with ID: RX29075
2026-03-28 14:03:38 [auto1.es] INFO: Found listing with ID: DD64860
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD64860%27 HTTP/1.1" 200 None
2026-03-28 14:03:38 [auto1.es] INFO: Scrape type for DD64860: 2
2026-03-28 14:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a024a8c1-01eb-5bf4-a800-6db9e4c26c77 with identifier: DD64860
2026-03-28 14:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a024a8c1-01eb-5bf4-a800-6db9e4c26c77 with scrape type 2
2026-03-28 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a024a8c1-01eb-5bf4-a800-6db9e4c26c77 with scrape type 2
2026-03-28 14:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a024a8c1-01eb-5bf4-a800-6db9e4c26c77, identifier: DD64860
2026-03-28 14:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a024a8c1-01eb-5bf4-a800-6db9e4c26c77 with identifier: DD64860
2026-03-28 14:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a024a8c1-01eb-5bf4-a800-6db9e4c26c77 with identifier: DD64860
2026-03-28 14:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a024a8c1-01eb-5bf4-a800-6db9e4c26c77 with identifier: DD64860 to the API
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:36:31Z',
 'fuel_type': 'diesel',
 'id': 'a024a8c1-01eb-5bf4-a800-6db9e4c26c77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD64860',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 29059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE Luxury',
 'transmission': 'automatic',
 'trim': 'HSE Luxury',
 'year': 2020}
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD64860%27 HTTP/1.1" 200 None
2026-03-28 14:03:39 [auto1.es] INFO: Saving data for DD64860: {'auction_closing_time': 1774715791.0, 'created_time': 1773126783.77192, 'last_price_update_time': 1774706619.38172}
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DD64860') HTTP/1.1" 204 0
2026-03-28 14:03:39 [auto1.es] INFO: Found listing with ID: YC67276
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC67276%27 HTTP/1.1" 200 None
2026-03-28 14:03:39 [auto1.es] INFO: Scrape type for YC67276: 2
2026-03-28 14:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2a0b07f-3bde-575d-8d0e-e4abd14f91a5 with identifier: YC67276
2026-03-28 14:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2a0b07f-3bde-575d-8d0e-e4abd14f91a5 with scrape type 2
2026-03-28 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2a0b07f-3bde-575d-8d0e-e4abd14f91a5 with scrape type 2
2026-03-28 14:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c2a0b07f-3bde-575d-8d0e-e4abd14f91a5, identifier: YC67276
2026-03-28 14:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c2a0b07f-3bde-575d-8d0e-e4abd14f91a5 with identifier: YC67276
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 14:03:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c2a0b07f-3bde-575d-8d0e-e4abd14f91a5 with identifier: YC67276
2026-03-28 14:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c2a0b07f-3bde-575d-8d0e-e4abd14f91a5 with identifier: YC67276 to the API
2026-03-28 14:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:04:25Z',
 'fuel_type': 'electro',
 'id': 'c2a0b07f-3bde-575d-8d0e-e4abd14f91a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC67276',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'iX3',
 'odometer': 107122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seller_name': None,
 'title': 'BMW iX3 electric drive 210 kW Impressive',
 'transmission': 'automatic',
 'trim': 'Impressive',
 'year': 2022}
2026-03-28 14:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC67276%27 HTTP/1.1" 200 None
2026-03-28 14:03:40 [auto1.es] INFO: Saving data for YC67276: {'auction_closing_time': 1774713865.0, 'created_time': 1773126779.764619, 'last_price_update_time': 1774706620.865932}
2026-03-28 14:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YC67276') HTTP/1.1" 204 0
2026-03-28 14:03:40 [auto1.es] INFO: Channel: 24h | Page: 50 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:40 [auto1.es] INFO: Found listing with ID: BT53297
2026-03-28 14:03:40 [auto1.es] INFO: Found listing with ID: EY80222
2026-03-28 14:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY80222%27 HTTP/1.1" 200 None
2026-03-28 14:03:40 [auto1.es] INFO: Scrape type for EY80222: 2
2026-03-28 14:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f025d9f-bd05-5a28-b6ae-9f984aaf6d72 with identifier: EY80222
2026-03-28 14:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f025d9f-bd05-5a28-b6ae-9f984aaf6d72 with scrape type 2
2026-03-28 14:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f025d9f-bd05-5a28-b6ae-9f984aaf6d72 with scrape type 2
2026-03-28 14:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9f025d9f-bd05-5a28-b6ae-9f984aaf6d72, identifier: EY80222
2026-03-28 14:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9f025d9f-bd05-5a28-b6ae-9f984aaf6d72 with identifier: EY80222
2026-03-28 14:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9f025d9f-bd05-5a28-b6ae-9f984aaf6d72 with identifier: EY80222
2026-03-28 14:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9f025d9f-bd05-5a28-b6ae-9f984aaf6d72 with identifier: EY80222 to the API
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:02Z',
 'fuel_type': 'diesel',
 'id': '9f025d9f-bd05-5a28-b6ae-9f984aaf6d72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY80222',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 131877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-07',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI advanced',
 'transmission': 'manual',
 'trim': 'advanced',
 'year': 2022}
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY80222%27 HTTP/1.1" 200 None
2026-03-28 14:03:41 [auto1.es] INFO: Saving data for EY80222: {'auction_closing_time': 1774717022.0, 'created_time': 1774382792.487108, 'last_price_update_time': 1774706621.328216}
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EY80222') HTTP/1.1" 204 0
2026-03-28 14:03:41 [auto1.es] INFO: Found listing with ID: MK48449
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK48449%27 HTTP/1.1" 200 None
2026-03-28 14:03:41 [auto1.es] INFO: Scrape type for MK48449: 2
2026-03-28 14:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b969c609-8508-5653-99ea-674b65cee636 with identifier: MK48449
2026-03-28 14:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b969c609-8508-5653-99ea-674b65cee636 with scrape type 2
2026-03-28 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b969c609-8508-5653-99ea-674b65cee636 with scrape type 2
2026-03-28 14:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b969c609-8508-5653-99ea-674b65cee636, identifier: MK48449
2026-03-28 14:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:41 [auto1.es] INFO: Found listing with ID: GJ06814
2026-03-28 14:03:41 [auto1.es] INFO: Found listing with ID: YJ20703
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ20703%27 HTTP/1.1" 200 None
2026-03-28 14:03:41 [auto1.es] INFO: Scrape type for YJ20703: 2
2026-03-28 14:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea4f1aa-d7d6-5a69-bbff-2acd5ff9e9c1 with identifier: YJ20703
2026-03-28 14:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea4f1aa-d7d6-5a69-bbff-2acd5ff9e9c1 with scrape type 2
2026-03-28 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ea4f1aa-d7d6-5a69-bbff-2acd5ff9e9c1 with scrape type 2
2026-03-28 14:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2ea4f1aa-d7d6-5a69-bbff-2acd5ff9e9c1, identifier: YJ20703
2026-03-28 14:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b969c609-8508-5653-99ea-674b65cee636 with identifier: MK48449
2026-03-28 14:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b969c609-8508-5653-99ea-674b65cee636 with identifier: MK48449
2026-03-28 14:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b969c609-8508-5653-99ea-674b65cee636 with identifier: MK48449 to the API
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:44:36Z',
 'fuel_type': 'petrol',
 'id': 'b969c609-8508-5653-99ea-674b65cee636',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK48449',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 170486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-02-24',
 'seller_name': None,
 'title': 'Peugeot 307 1.6 Esplanade',
 'transmission': 'manual',
 'trim': 'Esplanade',
 'year': 2002}
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK48449%27 HTTP/1.1" 200 None
2026-03-28 14:03:41 [auto1.es] INFO: Saving data for MK48449: {'auction_closing_time': 1774716276.0, 'created_time': 1774620134.345352, 'last_price_update_time': 1774706621.875443}
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MK48449') HTTP/1.1" 204 0
2026-03-28 14:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2ea4f1aa-d7d6-5a69-bbff-2acd5ff9e9c1 with identifier: YJ20703
2026-03-28 14:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2ea4f1aa-d7d6-5a69-bbff-2acd5ff9e9c1 with identifier: YJ20703
2026-03-28 14:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2ea4f1aa-d7d6-5a69-bbff-2acd5ff9e9c1 with identifier: YJ20703 to the API
2026-03-28 14:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:52:49Z',
 'fuel_type': 'petrol',
 'id': '2ea4f1aa-d7d6-5a69-bbff-2acd5ff9e9c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ20703',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 122933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-19',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 e-THP Live Edition',
 'transmission': 'manual',
 'trim': 'Live Edition',
 'year': 2016}
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ20703%27 HTTP/1.1" 200 None
2026-03-28 14:03:42 [auto1.es] INFO: Saving data for YJ20703: {'auction_closing_time': 1774716769.0, 'created_time': 1774620119.729082, 'last_price_update_time': 1774706622.201168}
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ20703') HTTP/1.1" 204 0
2026-03-28 14:03:42 [auto1.es] INFO: Found listing with ID: XA71436
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA71436%27 HTTP/1.1" 200 None
2026-03-28 14:03:42 [auto1.es] INFO: Scrape type for XA71436: 2
2026-03-28 14:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c99f3d5-b7ec-5e6a-9329-701284a90f9a with identifier: XA71436
2026-03-28 14:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c99f3d5-b7ec-5e6a-9329-701284a90f9a with scrape type 2
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c99f3d5-b7ec-5e6a-9329-701284a90f9a with scrape type 2
2026-03-28 14:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2c99f3d5-b7ec-5e6a-9329-701284a90f9a, identifier: XA71436
2026-03-28 14:03:42 [auto1.es] INFO: Found listing with ID: LF19420
2026-03-28 14:03:42 [auto1.es] INFO: Found listing with ID: RK37999
2026-03-28 14:03:42 [auto1.es] INFO: Found listing with ID: VB75549
2026-03-28 14:03:42 [auto1.es] INFO: Found listing with ID: YV46157
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV46157%27 HTTP/1.1" 200 None
2026-03-28 14:03:42 [auto1.es] INFO: Scrape type for YV46157: 2
2026-03-28 14:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbb5751f-e1fe-56e9-8802-560094ec907e with identifier: YV46157
2026-03-28 14:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbb5751f-e1fe-56e9-8802-560094ec907e with scrape type 2
2026-03-28 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbb5751f-e1fe-56e9-8802-560094ec907e with scrape type 2
2026-03-28 14:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bbb5751f-e1fe-56e9-8802-560094ec907e, identifier: YV46157
2026-03-28 14:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2c99f3d5-b7ec-5e6a-9329-701284a90f9a with identifier: XA71436
2026-03-28 14:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2c99f3d5-b7ec-5e6a-9329-701284a90f9a with identifier: XA71436
2026-03-28 14:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2c99f3d5-b7ec-5e6a-9329-701284a90f9a with identifier: XA71436 to the API
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:19:21Z',
 'fuel_type': 'diesel',
 'id': '2c99f3d5-b7ec-5e6a-9329-701284a90f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA71436',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 172022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-04',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA71436%27 HTTP/1.1" 200 None
2026-03-28 14:03:42 [auto1.es] INFO: Saving data for XA71436: {'auction_closing_time': 1774714761.0, 'created_time': 1774620107.728859, 'last_price_update_time': 1774706622.690461}
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XA71436') HTTP/1.1" 204 0
2026-03-28 14:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bbb5751f-e1fe-56e9-8802-560094ec907e with identifier: YV46157
2026-03-28 14:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bbb5751f-e1fe-56e9-8802-560094ec907e with identifier: YV46157
2026-03-28 14:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bbb5751f-e1fe-56e9-8802-560094ec907e with identifier: YV46157 to the API
2026-03-28 14:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:44:46Z',
 'fuel_type': 'diesel',
 'id': 'bbb5751f-e1fe-56e9-8802-560094ec907e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV46157',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 199259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV46157%27 HTTP/1.1" 200 None
2026-03-28 14:03:43 [auto1.es] INFO: Saving data for YV46157: {'auction_closing_time': 1774716286.0, 'created_time': 1774382777.913476, 'last_price_update_time': 1774706623.837949}
2026-03-28 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YV46157') HTTP/1.1" 204 0
2026-03-28 14:03:43 [auto1.es] INFO: Found listing with ID: VV60127
2026-03-28 14:03:43 [auto1.es] INFO: Found listing with ID: RD28906
2026-03-28 14:03:43 [auto1.es] INFO: Found listing with ID: YC39574
2026-03-28 14:03:43 [auto1.es] INFO: Found listing with ID: ET46210
2026-03-28 14:03:43 [auto1.es] INFO: Found listing with ID: WG59071
2026-03-28 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG59071%27 HTTP/1.1" 200 None
2026-03-28 14:03:43 [auto1.es] INFO: Scrape type for WG59071: 2
2026-03-28 14:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with identifier: WG59071
2026-03-28 14:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with scrape type 2
2026-03-28 14:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with scrape type 2
2026-03-28 14:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b, identifier: WG59071
2026-03-28 14:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with identifier: WG59071
2026-03-28 14:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with identifier: WG59071
2026-03-28 14:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with identifier: WG59071 to the API
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:37:30Z',
 'fuel_type': 'diesel',
 'id': 'e1af7fb0-b7e0-547e-9d3e-754b8837bd8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG59071',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 112361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-21',
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG59071%27 HTTP/1.1" 200 None
2026-03-28 14:03:44 [auto1.es] INFO: Saving data for WG59071: {'auction_closing_time': 1774715850.0, 'created_time': 1773126693.423226, 'last_price_update_time': 1774706624.351853}
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WG59071') HTTP/1.1" 204 0
2026-03-28 14:03:44 [auto1.es] INFO: Found listing with ID: TF20925
2026-03-28 14:03:44 [auto1.es] INFO: Found listing with ID: JG54829
2026-03-28 14:03:44 [auto1.es] INFO: Found listing with ID: AS80806
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS80806%27 HTTP/1.1" 200 None
2026-03-28 14:03:44 [auto1.es] INFO: Scrape type for AS80806: 2
2026-03-28 14:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb231219-4961-52b1-ac6e-3f29be88edc4 with identifier: AS80806
2026-03-28 14:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb231219-4961-52b1-ac6e-3f29be88edc4 with scrape type 2
2026-03-28 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb231219-4961-52b1-ac6e-3f29be88edc4 with scrape type 2
2026-03-28 14:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fb231219-4961-52b1-ac6e-3f29be88edc4, identifier: AS80806
2026-03-28 14:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fb231219-4961-52b1-ac6e-3f29be88edc4 with identifier: AS80806
2026-03-28 14:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fb231219-4961-52b1-ac6e-3f29be88edc4 with identifier: AS80806
2026-03-28 14:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fb231219-4961-52b1-ac6e-3f29be88edc4 with identifier: AS80806 to the API
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:30:48Z',
 'fuel_type': 'diesel',
 'id': 'fb231219-4961-52b1-ac6e-3f29be88edc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS80806',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 183626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seller_name': None,
 'title': 'Audi Q2 30 TDI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2022}
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS80806%27 HTTP/1.1" 200 None
2026-03-28 14:03:44 [auto1.es] INFO: Saving data for AS80806: {'auction_closing_time': 1774715448.0, 'created_time': 1774382638.94376, 'last_price_update_time': 1774706624.878979}
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AS80806') HTTP/1.1" 204 0
2026-03-28 14:03:44 [auto1.es] INFO: Found listing with ID: ZG70058
2026-03-28 14:03:44 [auto1.es] INFO: Found listing with ID: YH51023
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH51023%27 HTTP/1.1" 200 None
2026-03-28 14:03:44 [auto1.es] INFO: Scrape type for YH51023: 2
2026-03-28 14:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e8f46e0-d1bf-5685-bbbc-e4da3716f386 with identifier: YH51023
2026-03-28 14:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e8f46e0-d1bf-5685-bbbc-e4da3716f386 with scrape type 2
2026-03-28 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e8f46e0-d1bf-5685-bbbc-e4da3716f386 with scrape type 2
2026-03-28 14:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5e8f46e0-d1bf-5685-bbbc-e4da3716f386, identifier: YH51023
2026-03-28 14:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5e8f46e0-d1bf-5685-bbbc-e4da3716f386 with identifier: YH51023
2026-03-28 14:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5e8f46e0-d1bf-5685-bbbc-e4da3716f386 with identifier: YH51023
2026-03-28 14:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5e8f46e0-d1bf-5685-bbbc-e4da3716f386 with identifier: YH51023 to the API
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:18:47Z',
 'fuel_type': 'diesel',
 'id': '5e8f46e0-d1bf-5685-bbbc-e4da3716f386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH51023',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 157241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seller_name': None,
 'title': 'Renault Talisman 1.7 BLUE dCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2020}
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH51023%27 HTTP/1.1" 200 None
2026-03-28 14:03:45 [auto1.es] INFO: Saving data for YH51023: {'auction_closing_time': 1774714727.0, 'created_time': 1773126697.43446, 'last_price_update_time': 1774706625.337861}
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YH51023') HTTP/1.1" 204 0
2026-03-28 14:03:45 [auto1.es] INFO: Found listing with ID: CJ84501
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ84501%27 HTTP/1.1" 200 None
2026-03-28 14:03:45 [auto1.es] INFO: Scrape type for CJ84501: 2
2026-03-28 14:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9114cad-3620-5c92-b341-a614ec414363 with identifier: CJ84501
2026-03-28 14:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9114cad-3620-5c92-b341-a614ec414363 with scrape type 2
2026-03-28 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9114cad-3620-5c92-b341-a614ec414363 with scrape type 2
2026-03-28 14:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c9114cad-3620-5c92-b341-a614ec414363, identifier: CJ84501
2026-03-28 14:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c9114cad-3620-5c92-b341-a614ec414363 with identifier: CJ84501
2026-03-28 14:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c9114cad-3620-5c92-b341-a614ec414363 with identifier: CJ84501
2026-03-28 14:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c9114cad-3620-5c92-b341-a614ec414363 with identifier: CJ84501 to the API
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:43:47Z',
 'fuel_type': 'diesel',
 'id': 'c9114cad-3620-5c92-b341-a614ec414363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ84501',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 171197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seller_name': None,
 'title': 'Renault Talisman 1.7 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2020}
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ84501%27 HTTP/1.1" 200 None
2026-03-28 14:03:45 [auto1.es] INFO: Saving data for CJ84501: {'auction_closing_time': 1774716227.0, 'created_time': 1773126782.824778, 'last_price_update_time': 1774706625.75257}
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CJ84501') HTTP/1.1" 204 0
2026-03-28 14:03:45 [auto1.es] INFO: Found listing with ID: ZT56570
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT56570%27 HTTP/1.1" 200 None
2026-03-28 14:03:45 [auto1.es] INFO: Scrape type for ZT56570: 2
2026-03-28 14:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4d06c91-de99-5e5c-b030-067e93829156 with identifier: ZT56570
2026-03-28 14:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4d06c91-de99-5e5c-b030-067e93829156 with scrape type 2
2026-03-28 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4d06c91-de99-5e5c-b030-067e93829156 with scrape type 2
2026-03-28 14:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b4d06c91-de99-5e5c-b030-067e93829156, identifier: ZT56570
2026-03-28 14:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b4d06c91-de99-5e5c-b030-067e93829156 with identifier: ZT56570
2026-03-28 14:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b4d06c91-de99-5e5c-b030-067e93829156 with identifier: ZT56570
2026-03-28 14:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b4d06c91-de99-5e5c-b030-067e93829156 with identifier: ZT56570 to the API
2026-03-28 14:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:32:32Z',
 'fuel_type': 'petrol',
 'id': 'b4d06c91-de99-5e5c-b030-067e93829156',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT56570',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-TYPE',
 'odometer': 39917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seller_name': None,
 'title': 'Jaguar F-TYPE 30t R-Dynamic',
 'transmission': 'automatic',
 'trim': 'R-Dynamic',
 'year': 2021}
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT56570%27 HTTP/1.1" 200 None
2026-03-28 14:03:46 [auto1.es] INFO: Saving data for ZT56570: {'auction_closing_time': 1774715552.0, 'created_time': 1773129916.366759, 'last_price_update_time': 1774706626.255179}
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZT56570') HTTP/1.1" 204 0
2026-03-28 14:03:46 [auto1.es] INFO: Found listing with ID: XN30812
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN30812%27 HTTP/1.1" 200 None
2026-03-28 14:03:46 [auto1.es] INFO: Scrape type for XN30812: 2
2026-03-28 14:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a28f267-36f6-5e6c-a4a9-d07263483300 with identifier: XN30812
2026-03-28 14:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a28f267-36f6-5e6c-a4a9-d07263483300 with scrape type 2
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a28f267-36f6-5e6c-a4a9-d07263483300 with scrape type 2
2026-03-28 14:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0a28f267-36f6-5e6c-a4a9-d07263483300, identifier: XN30812
2026-03-28 14:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0a28f267-36f6-5e6c-a4a9-d07263483300 with identifier: XN30812
2026-03-28 14:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0a28f267-36f6-5e6c-a4a9-d07263483300 with identifier: XN30812
2026-03-28 14:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0a28f267-36f6-5e6c-a4a9-d07263483300 with identifier: XN30812 to the API
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:23:21Z',
 'fuel_type': 'petrol',
 'id': '0a28f267-36f6-5e6c-a4a9-d07263483300',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN30812',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 102103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-19',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN30812%27 HTTP/1.1" 200 None
2026-03-28 14:03:46 [auto1.es] INFO: Saving data for XN30812: {'auction_closing_time': 1774715001.0, 'created_time': 1774036923.917749, 'last_price_update_time': 1774706626.675394}
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XN30812') HTTP/1.1" 204 0
2026-03-28 14:03:46 [auto1.es] INFO: Found listing with ID: HH76274
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH76274%27 HTTP/1.1" 200 None
2026-03-28 14:03:46 [auto1.es] INFO: Scrape type for HH76274: 2
2026-03-28 14:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9c9835f-ec3c-59a3-85fc-6030fb4bc855 with identifier: HH76274
2026-03-28 14:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9c9835f-ec3c-59a3-85fc-6030fb4bc855 with scrape type 2
2026-03-28 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9c9835f-ec3c-59a3-85fc-6030fb4bc855 with scrape type 2
2026-03-28 14:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e9c9835f-ec3c-59a3-85fc-6030fb4bc855, identifier: HH76274
2026-03-28 14:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e9c9835f-ec3c-59a3-85fc-6030fb4bc855 with identifier: HH76274
2026-03-28 14:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e9c9835f-ec3c-59a3-85fc-6030fb4bc855 with identifier: HH76274
2026-03-28 14:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e9c9835f-ec3c-59a3-85fc-6030fb4bc855 with identifier: HH76274 to the API
2026-03-28 14:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:04:47Z',
 'fuel_type': 'diesel',
 'id': 'e9c9835f-ec3c-59a3-85fc-6030fb4bc855',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH76274',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 232646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-19',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2005}
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH76274%27 HTTP/1.1" 200 None
2026-03-28 14:03:47 [auto1.es] INFO: Saving data for HH76274: {'auction_closing_time': 1774713887.0, 'created_time': 1774620120.955208, 'last_price_update_time': 1774706627.861584}
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HH76274') HTTP/1.1" 204 0
2026-03-28 14:03:47 [auto1.es] INFO: Found listing with ID: LJ17115
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ17115%27 HTTP/1.1" 200 None
2026-03-28 14:03:47 [auto1.es] INFO: Scrape type for LJ17115: 2
2026-03-28 14:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d7c9da-df11-5a74-8470-10585266253e with identifier: LJ17115
2026-03-28 14:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d7c9da-df11-5a74-8470-10585266253e with scrape type 2
2026-03-28 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83d7c9da-df11-5a74-8470-10585266253e with scrape type 2
2026-03-28 14:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 83d7c9da-df11-5a74-8470-10585266253e, identifier: LJ17115
2026-03-28 14:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 83d7c9da-df11-5a74-8470-10585266253e with identifier: LJ17115
2026-03-28 14:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 83d7c9da-df11-5a74-8470-10585266253e with identifier: LJ17115
2026-03-28 14:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 83d7c9da-df11-5a74-8470-10585266253e with identifier: LJ17115 to the API
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:11:49Z',
 'fuel_type': 'diesel',
 'id': '83d7c9da-df11-5a74-8470-10585266253e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ17115',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 115404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2010}
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ17115%27 HTTP/1.1" 200 None
2026-03-28 14:03:48 [auto1.es] INFO: Saving data for LJ17115: {'auction_closing_time': 1774714309.0, 'created_time': 1774620121.549835, 'last_price_update_time': 1774706628.281617}
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LJ17115') HTTP/1.1" 204 0
2026-03-28 14:03:48 [auto1.es] INFO: Channel: 24h | Page: 51 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:48 [auto1.es] INFO: Found listing with ID: FG05757
2026-03-28 14:03:48 [auto1.es] INFO: Found listing with ID: DB89419
2026-03-28 14:03:48 [auto1.es] INFO: Found listing with ID: LA57781
2026-03-28 14:03:48 [auto1.es] INFO: Found listing with ID: RD28331
2026-03-28 14:03:48 [auto1.es] INFO: Found listing with ID: KK99044
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK99044%27 HTTP/1.1" 200 None
2026-03-28 14:03:48 [auto1.es] INFO: Scrape type for KK99044: 0
2026-03-28 14:03:48 [auto1.es] INFO: Found listing with ID: TW26676
2026-03-28 14:03:48 [auto1.es] INFO: Found listing with ID: GP55698
2026-03-28 14:03:48 [auto1.es] INFO: Found listing with ID: RG56357
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG56357%27 HTTP/1.1" 200 None
2026-03-28 14:03:48 [auto1.es] INFO: Scrape type for RG56357: 2
2026-03-28 14:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51d3605f-ecb5-5fe4-8f92-b17bd7667ff4 with identifier: RG56357
2026-03-28 14:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51d3605f-ecb5-5fe4-8f92-b17bd7667ff4 with scrape type 2
2026-03-28 14:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51d3605f-ecb5-5fe4-8f92-b17bd7667ff4 with scrape type 2
2026-03-28 14:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 51d3605f-ecb5-5fe4-8f92-b17bd7667ff4, identifier: RG56357
2026-03-28 14:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 51d3605f-ecb5-5fe4-8f92-b17bd7667ff4 with identifier: RG56357
2026-03-28 14:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 51d3605f-ecb5-5fe4-8f92-b17bd7667ff4 with identifier: RG56357
2026-03-28 14:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 51d3605f-ecb5-5fe4-8f92-b17bd7667ff4 with identifier: RG56357 to the API
2026-03-28 14:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:53Z',
 'fuel_type': 'diesel',
 'id': '51d3605f-ecb5-5fe4-8f92-b17bd7667ff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG56357',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 148503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-17',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Style Go',
 'transmission': 'automatic',
 'trim': 'Style Go',
 'year': 2022}
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG56357%27 HTTP/1.1" 200 None
2026-03-28 14:03:49 [auto1.es] INFO: Saving data for RG56357: {'auction_closing_time': 1774715213.0, 'created_time': 1773126706.122498, 'last_price_update_time': 1774706629.261435}
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RG56357') HTTP/1.1" 204 0
2026-03-28 14:03:49 [auto1.es] INFO: Found listing with ID: GL31739
2026-03-28 14:03:49 [auto1.es] INFO: Found listing with ID: ZB83445
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB83445%27 HTTP/1.1" 200 None
2026-03-28 14:03:49 [auto1.es] INFO: Scrape type for ZB83445: 2
2026-03-28 14:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e477789a-64d8-5ecc-806c-30aa8e4e7f48 with identifier: ZB83445
2026-03-28 14:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e477789a-64d8-5ecc-806c-30aa8e4e7f48 with scrape type 2
2026-03-28 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e477789a-64d8-5ecc-806c-30aa8e4e7f48 with scrape type 2
2026-03-28 14:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e477789a-64d8-5ecc-806c-30aa8e4e7f48, identifier: ZB83445
2026-03-28 14:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:49 [auto1.es] INFO: Found listing with ID: SW63270
2026-03-28 14:03:49 [auto1.es] INFO: Found listing with ID: FH92259
2026-03-28 14:03:49 [auto1.es] INFO: Found listing with ID: WN06367
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN06367%27 HTTP/1.1" 200 None
2026-03-28 14:03:49 [auto1.es] INFO: Scrape type for WN06367: 2
2026-03-28 14:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2cea72-e1c1-5586-a5fc-8b9164b87f02 with identifier: WN06367
2026-03-28 14:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2cea72-e1c1-5586-a5fc-8b9164b87f02 with scrape type 2
2026-03-28 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f2cea72-e1c1-5586-a5fc-8b9164b87f02 with scrape type 2
2026-03-28 14:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f2cea72-e1c1-5586-a5fc-8b9164b87f02, identifier: WN06367
2026-03-28 14:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e477789a-64d8-5ecc-806c-30aa8e4e7f48 with identifier: ZB83445
2026-03-28 14:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e477789a-64d8-5ecc-806c-30aa8e4e7f48 with identifier: ZB83445
2026-03-28 14:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e477789a-64d8-5ecc-806c-30aa8e4e7f48 with identifier: ZB83445 to the API
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 404,
 'expiration_date': '2026-03-28T16:40:26Z',
 'fuel_type': 'hybrid',
 'id': 'e477789a-64d8-5ecc-806c-30aa8e4e7f48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB83445',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 68726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-16',
 'seller_name': None,
 'title': 'Jaguar F-Pace P400e Plug-in Hybrid R-Dynamic S AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S AWD',
 'year': 2023}
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB83445%27 HTTP/1.1" 200 None
2026-03-28 14:03:49 [auto1.es] INFO: Saving data for ZB83445: {'auction_closing_time': 1774716026.0, 'created_time': 1773126716.410035, 'last_price_update_time': 1774706629.937906}
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZB83445') HTTP/1.1" 204 0
2026-03-28 14:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f2cea72-e1c1-5586-a5fc-8b9164b87f02 with identifier: WN06367
2026-03-28 14:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f2cea72-e1c1-5586-a5fc-8b9164b87f02 with identifier: WN06367
2026-03-28 14:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f2cea72-e1c1-5586-a5fc-8b9164b87f02 with identifier: WN06367 to the API
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:02:17Z',
 'fuel_type': 'diesel',
 'id': '2f2cea72-e1c1-5586-a5fc-8b9164b87f02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN06367',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 193929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-21',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Blue-HDi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN06367%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [auto1.es] INFO: Saving data for WN06367: {'auction_closing_time': 1774713737.0, 'created_time': 1774620133.894847, 'last_price_update_time': 1774706630.252101}
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WN06367') HTTP/1.1" 204 0
2026-03-28 14:03:50 [auto1.es] INFO: Found listing with ID: EE09579
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE09579%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [auto1.es] INFO: Scrape type for EE09579: 2
2026-03-28 14:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de03b25-9840-53e0-bd39-2a16bd6f13f5 with identifier: EE09579
2026-03-28 14:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de03b25-9840-53e0-bd39-2a16bd6f13f5 with scrape type 2
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de03b25-9840-53e0-bd39-2a16bd6f13f5 with scrape type 2
2026-03-28 14:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9de03b25-9840-53e0-bd39-2a16bd6f13f5, identifier: EE09579
2026-03-28 14:03:50 [auto1.es] INFO: Found listing with ID: HM29961
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM29961%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [auto1.es] INFO: Scrape type for HM29961: 2
2026-03-28 14:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d78549-629c-5608-914c-1f6a16428dcf with identifier: HM29961
2026-03-28 14:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d78549-629c-5608-914c-1f6a16428dcf with scrape type 2
2026-03-28 14:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83d78549-629c-5608-914c-1f6a16428dcf with scrape type 2
2026-03-28 14:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 83d78549-629c-5608-914c-1f6a16428dcf, identifier: HM29961
2026-03-28 14:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9de03b25-9840-53e0-bd39-2a16bd6f13f5 with identifier: EE09579
2026-03-28 14:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9de03b25-9840-53e0-bd39-2a16bd6f13f5 with identifier: EE09579
2026-03-28 14:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9de03b25-9840-53e0-bd39-2a16bd6f13f5 with identifier: EE09579 to the API
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:50:44Z',
 'fuel_type': 'diesel',
 'id': '9de03b25-9840-53e0-bd39-2a16bd6f13f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE09579',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 172857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-08',
 'seller_name': None,
 'title': 'Jaguar XF 2.2 D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE09579%27 HTTP/1.1" 200 None
2026-03-28 14:03:50 [auto1.es] INFO: Saving data for EE09579: {'auction_closing_time': 1774716644.0, 'created_time': 1773324206.270484, 'last_price_update_time': 1774706630.737366}
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EE09579') HTTP/1.1" 204 0
2026-03-28 14:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 83d78549-629c-5608-914c-1f6a16428dcf with identifier: HM29961
2026-03-28 14:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 83d78549-629c-5608-914c-1f6a16428dcf with identifier: HM29961
2026-03-28 14:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 83d78549-629c-5608-914c-1f6a16428dcf with identifier: HM29961 to the API
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-28T16:36:05Z',
 'fuel_type': 'petrol',
 'id': '83d78549-629c-5608-914c-1f6a16428dcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM29961',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 32171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-21',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2024}
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM29961%27 HTTP/1.1" 200 None
2026-03-28 14:03:51 [auto1.es] INFO: Saving data for HM29961: {'auction_closing_time': 1774715765.0, 'created_time': 1773126791.966278, 'last_price_update_time': 1774706631.04452}
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HM29961') HTTP/1.1" 204 0
2026-03-28 14:03:51 [auto1.es] INFO: Found listing with ID: ZL80540
2026-03-28 14:03:51 [auto1.es] INFO: Found listing with ID: PY12516
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY12516%27 HTTP/1.1" 200 None
2026-03-28 14:03:51 [auto1.es] INFO: Scrape type for PY12516: 2
2026-03-28 14:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ae83bf7-2414-5f25-bb74-a9bc47f9995c with identifier: PY12516
2026-03-28 14:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ae83bf7-2414-5f25-bb74-a9bc47f9995c with scrape type 2
2026-03-28 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ae83bf7-2414-5f25-bb74-a9bc47f9995c with scrape type 2
2026-03-28 14:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0ae83bf7-2414-5f25-bb74-a9bc47f9995c, identifier: PY12516
2026-03-28 14:03:51 [auto1.es] INFO: Found listing with ID: XC57294
2026-03-28 14:03:51 [auto1.es] INFO: Found listing with ID: EU98432
2026-03-28 14:03:51 [auto1.es] INFO: Found listing with ID: RY15229
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY15229%27 HTTP/1.1" 200 None
2026-03-28 14:03:51 [auto1.es] INFO: Scrape type for RY15229: 2
2026-03-28 14:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 742e8cc1-1519-59f7-a54d-33c70fd4da45 with identifier: RY15229
2026-03-28 14:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 742e8cc1-1519-59f7-a54d-33c70fd4da45 with scrape type 2
2026-03-28 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 742e8cc1-1519-59f7-a54d-33c70fd4da45 with scrape type 2
2026-03-28 14:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 742e8cc1-1519-59f7-a54d-33c70fd4da45, identifier: RY15229
2026-03-28 14:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0ae83bf7-2414-5f25-bb74-a9bc47f9995c with identifier: PY12516
2026-03-28 14:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0ae83bf7-2414-5f25-bb74-a9bc47f9995c with identifier: PY12516
2026-03-28 14:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0ae83bf7-2414-5f25-bb74-a9bc47f9995c with identifier: PY12516 to the API
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:34:09Z',
 'fuel_type': 'petrol',
 'id': '0ae83bf7-2414-5f25-bb74-a9bc47f9995c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY12516',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 75003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Edition One',
 'transmission': 'automatic',
 'trim': 'Edition One',
 'year': 2021}
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY12516%27 HTTP/1.1" 200 None
2026-03-28 14:03:51 [auto1.es] INFO: Saving data for PY12516: {'auction_closing_time': 1774715649.0, 'created_time': 1773129579.937657, 'last_price_update_time': 1774706631.654144}
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PY12516') HTTP/1.1" 204 0
2026-03-28 14:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 742e8cc1-1519-59f7-a54d-33c70fd4da45 with identifier: RY15229
2026-03-28 14:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 742e8cc1-1519-59f7-a54d-33c70fd4da45 with identifier: RY15229
2026-03-28 14:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 742e8cc1-1519-59f7-a54d-33c70fd4da45 with identifier: RY15229 to the API
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:33:39Z',
 'fuel_type': 'diesel',
 'id': '742e8cc1-1519-59f7-a54d-33c70fd4da45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY15229',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 106179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY15229%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [auto1.es] INFO: Saving data for RY15229: {'auction_closing_time': 1774715619.0, 'created_time': 1773126714.793409, 'last_price_update_time': 1774706632.073313}
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RY15229') HTTP/1.1" 204 0
2026-03-28 14:03:52 [auto1.es] INFO: Found listing with ID: ZY07880
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY07880%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [auto1.es] INFO: Scrape type for ZY07880: 2
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39a30902-f1df-56c8-ba25-d7165295095b with identifier: ZY07880
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a30902-f1df-56c8-ba25-d7165295095b with scrape type 2
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39a30902-f1df-56c8-ba25-d7165295095b with scrape type 2
2026-03-28 14:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 39a30902-f1df-56c8-ba25-d7165295095b, identifier: ZY07880
2026-03-28 14:03:52 [auto1.es] INFO: Found listing with ID: DW75083
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW75083%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [auto1.es] INFO: Scrape type for DW75083: 2
2026-03-28 14:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd8e77df-c05a-5572-aebb-05cc143e352a with identifier: DW75083
2026-03-28 14:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd8e77df-c05a-5572-aebb-05cc143e352a with scrape type 2
2026-03-28 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd8e77df-c05a-5572-aebb-05cc143e352a with scrape type 2
2026-03-28 14:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dd8e77df-c05a-5572-aebb-05cc143e352a, identifier: DW75083
2026-03-28 14:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 39a30902-f1df-56c8-ba25-d7165295095b with identifier: ZY07880
2026-03-28 14:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 39a30902-f1df-56c8-ba25-d7165295095b with identifier: ZY07880
2026-03-28 14:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 39a30902-f1df-56c8-ba25-d7165295095b with identifier: ZY07880 to the API
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:44:38Z',
 'fuel_type': 'diesel',
 'id': '39a30902-f1df-56c8-ba25-d7165295095b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY07880',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 163305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2019}
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY07880%27 HTTP/1.1" 200 None
2026-03-28 14:03:52 [auto1.es] INFO: Saving data for ZY07880: {'auction_closing_time': 1774716278.0, 'created_time': 1774620153.36266, 'last_price_update_time': 1774706632.593871}
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZY07880') HTTP/1.1" 204 0
2026-03-28 14:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dd8e77df-c05a-5572-aebb-05cc143e352a with identifier: DW75083
2026-03-28 14:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dd8e77df-c05a-5572-aebb-05cc143e352a with identifier: DW75083
2026-03-28 14:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dd8e77df-c05a-5572-aebb-05cc143e352a with identifier: DW75083 to the API
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:10:22Z',
 'fuel_type': 'diesel',
 'id': 'dd8e77df-c05a-5572-aebb-05cc143e352a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW75083',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 50872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-27',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW75083%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [auto1.es] INFO: Saving data for DW75083: {'auction_closing_time': 1774714222.0, 'created_time': 1774382565.853608, 'last_price_update_time': 1774706633.0859}
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DW75083') HTTP/1.1" 204 0
2026-03-28 14:03:53 [auto1.es] INFO: Found listing with ID: UG14230
2026-03-28 14:03:53 [auto1.es] INFO: Found listing with ID: WD56273
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD56273%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [auto1.es] INFO: Scrape type for WD56273: 2
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb4e2f42-c549-5b4f-bec7-e4f78eae0510 with identifier: WD56273
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb4e2f42-c549-5b4f-bec7-e4f78eae0510 with scrape type 2
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb4e2f42-c549-5b4f-bec7-e4f78eae0510 with scrape type 2
2026-03-28 14:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cb4e2f42-c549-5b4f-bec7-e4f78eae0510, identifier: WD56273
2026-03-28 14:03:53 [auto1.es] INFO: Found listing with ID: RL87551
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL87551%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [auto1.es] INFO: Scrape type for RL87551: 2
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7b1470a-43e9-5a7a-b2b9-fd9c09ec0ada with identifier: RL87551
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7b1470a-43e9-5a7a-b2b9-fd9c09ec0ada with scrape type 2
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7b1470a-43e9-5a7a-b2b9-fd9c09ec0ada with scrape type 2
2026-03-28 14:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a7b1470a-43e9-5a7a-b2b9-fd9c09ec0ada, identifier: RL87551
2026-03-28 14:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cb4e2f42-c549-5b4f-bec7-e4f78eae0510 with identifier: WD56273
2026-03-28 14:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cb4e2f42-c549-5b4f-bec7-e4f78eae0510 with identifier: WD56273
2026-03-28 14:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cb4e2f42-c549-5b4f-bec7-e4f78eae0510 with identifier: WD56273 to the API
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:03:14Z',
 'fuel_type': 'petrol',
 'id': 'cb4e2f42-c549-5b4f-bec7-e4f78eae0510',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD56273',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 167480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-07-28',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 280 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 1999}
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD56273%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [auto1.es] INFO: Saving data for WD56273: {'auction_closing_time': 1774713794.0, 'created_time': 1774620132.814276, 'last_price_update_time': 1774706633.609181}
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WD56273') HTTP/1.1" 204 0
2026-03-28 14:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a7b1470a-43e9-5a7a-b2b9-fd9c09ec0ada with identifier: RL87551
2026-03-28 14:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a7b1470a-43e9-5a7a-b2b9-fd9c09ec0ada with identifier: RL87551
2026-03-28 14:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a7b1470a-43e9-5a7a-b2b9-fd9c09ec0ada with identifier: RL87551 to the API
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:38:22Z',
 'fuel_type': 'diesel',
 'id': 'a7b1470a-43e9-5a7a-b2b9-fd9c09ec0ada',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL87551',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 204147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-30',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Equilibre',
 'transmission': 'manual',
 'trim': 'Equilibre',
 'year': 2023}
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL87551%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [auto1.es] INFO: Saving data for RL87551: {'auction_closing_time': 1774715902.0, 'created_time': 1774382593.436946, 'last_price_update_time': 1774706633.935139}
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RL87551') HTTP/1.1" 204 0
2026-03-28 14:03:53 [auto1.es] INFO: Found listing with ID: WJ13059
2026-03-28 14:03:53 [auto1.es] INFO: Found listing with ID: PB42278
2026-03-28 14:03:53 [auto1.es] INFO: Found listing with ID: GH53615
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH53615%27 HTTP/1.1" 200 None
2026-03-28 14:03:53 [auto1.es] INFO: Scrape type for GH53615: 2
2026-03-28 14:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65e6570f-3788-55ab-9ffc-15c957f83a12 with identifier: GH53615
2026-03-28 14:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65e6570f-3788-55ab-9ffc-15c957f83a12 with scrape type 2
2026-03-28 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65e6570f-3788-55ab-9ffc-15c957f83a12 with scrape type 2
2026-03-28 14:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 65e6570f-3788-55ab-9ffc-15c957f83a12, identifier: GH53615
2026-03-28 14:03:54 [auto1.es] INFO: Found listing with ID: KN45266
2026-03-28 14:03:54 [auto1.es] INFO: Found listing with ID: EL62965
2026-03-28 14:03:54 [auto1.es] INFO: Found listing with ID: XG96540
2026-03-28 14:03:54 [auto1.es] INFO: Found listing with ID: AB25333
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB25333%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [auto1.es] INFO: Scrape type for AB25333: 2
2026-03-28 14:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6491708e-515d-5acc-beb5-b84102feba28 with identifier: AB25333
2026-03-28 14:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6491708e-515d-5acc-beb5-b84102feba28 with scrape type 2
2026-03-28 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6491708e-515d-5acc-beb5-b84102feba28 with scrape type 2
2026-03-28 14:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6491708e-515d-5acc-beb5-b84102feba28, identifier: AB25333
2026-03-28 14:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 65e6570f-3788-55ab-9ffc-15c957f83a12 with identifier: GH53615
2026-03-28 14:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 65e6570f-3788-55ab-9ffc-15c957f83a12 with identifier: GH53615
2026-03-28 14:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 65e6570f-3788-55ab-9ffc-15c957f83a12 with identifier: GH53615 to the API
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:08:20Z',
 'fuel_type': 'diesel',
 'id': '65e6570f-3788-55ab-9ffc-15c957f83a12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH53615',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 132314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.5 CDTI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2021}
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH53615%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [auto1.es] INFO: Saving data for GH53615: {'auction_closing_time': 1774714100.0, 'created_time': 1773126992.169227, 'last_price_update_time': 1774706634.565721}
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GH53615') HTTP/1.1" 204 0
2026-03-28 14:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6491708e-515d-5acc-beb5-b84102feba28 with identifier: AB25333
2026-03-28 14:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6491708e-515d-5acc-beb5-b84102feba28 with identifier: AB25333
2026-03-28 14:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6491708e-515d-5acc-beb5-b84102feba28 with identifier: AB25333 to the API
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:23:18Z',
 'fuel_type': 'petrol',
 'id': '6491708e-515d-5acc-beb5-b84102feba28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB25333',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 47436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seller_name': None,
 'title': 'Mazda CX-30 2.0 SKYACTIV-G Mild-Hybrid Evolution 2WD',
 'transmission': 'manual',
 'trim': 'Evolution 2WD',
 'year': 2020}
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB25333%27 HTTP/1.1" 200 None
2026-03-28 14:03:54 [auto1.es] INFO: Saving data for AB25333: {'auction_closing_time': 1774714998.0, 'created_time': 1774382618.117572, 'last_price_update_time': 1774706634.980333}
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AB25333') HTTP/1.1" 204 0
2026-03-28 14:03:54 [auto1.es] INFO: Found listing with ID: TD30027
2026-03-28 14:03:54 [auto1.es] INFO: Found listing with ID: FA27463
2026-03-28 14:03:54 [auto1.es] INFO: Found listing with ID: MR66674
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR66674%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [auto1.es] INFO: Scrape type for MR66674: 2
2026-03-28 14:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e6dc678-4887-5475-8dca-e3bb8beb3962 with identifier: MR66674
2026-03-28 14:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e6dc678-4887-5475-8dca-e3bb8beb3962 with scrape type 2
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e6dc678-4887-5475-8dca-e3bb8beb3962 with scrape type 2
2026-03-28 14:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4e6dc678-4887-5475-8dca-e3bb8beb3962, identifier: MR66674
2026-03-28 14:03:55 [auto1.es] INFO: Found listing with ID: WG96659
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG96659%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [auto1.es] INFO: Scrape type for WG96659: 2
2026-03-28 14:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1065ac7f-4a44-590e-8b46-ea784f83026b with identifier: WG96659
2026-03-28 14:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1065ac7f-4a44-590e-8b46-ea784f83026b with scrape type 2
2026-03-28 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1065ac7f-4a44-590e-8b46-ea784f83026b with scrape type 2
2026-03-28 14:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1065ac7f-4a44-590e-8b46-ea784f83026b, identifier: WG96659
2026-03-28 14:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4e6dc678-4887-5475-8dca-e3bb8beb3962 with identifier: MR66674
2026-03-28 14:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4e6dc678-4887-5475-8dca-e3bb8beb3962 with identifier: MR66674
2026-03-28 14:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4e6dc678-4887-5475-8dca-e3bb8beb3962 with identifier: MR66674 to the API
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:34:52Z',
 'fuel_type': 'hybrid',
 'id': '4e6dc678-4887-5475-8dca-e3bb8beb3962',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR66674',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 21861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-10',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2024}
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR66674%27 HTTP/1.1" 200 None
2026-03-28 14:03:55 [auto1.es] INFO: Saving data for MR66674: {'auction_closing_time': 1774715692.0, 'created_time': 1774361202.732484, 'last_price_update_time': 1774706635.751477}
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MR66674') HTTP/1.1" 204 0
2026-03-28 14:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1065ac7f-4a44-590e-8b46-ea784f83026b with identifier: WG96659
2026-03-28 14:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1065ac7f-4a44-590e-8b46-ea784f83026b with identifier: WG96659
2026-03-28 14:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1065ac7f-4a44-590e-8b46-ea784f83026b with identifier: WG96659 to the API
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:51:06Z',
 'fuel_type': 'hybrid',
 'id': '1065ac7f-4a44-590e-8b46-ea784f83026b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG96659',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 122534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-22',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Hybrid Tech',
 'transmission': 'automatic',
 'trim': 'Tech',
 'year': 2023}
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG96659%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [auto1.es] INFO: Saving data for WG96659: {'auction_closing_time': 1774716666.0, 'created_time': 1774382630.944538, 'last_price_update_time': 1774706636.060995}
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WG96659') HTTP/1.1" 204 0
2026-03-28 14:03:56 [auto1.es] INFO: Found listing with ID: FA20187
2026-03-28 14:03:56 [auto1.es] INFO: Found listing with ID: XB66018
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB66018%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [auto1.es] INFO: Scrape type for XB66018: 2
2026-03-28 14:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6492a2a-195b-59c4-bb12-e4fb67cac783 with identifier: XB66018
2026-03-28 14:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6492a2a-195b-59c4-bb12-e4fb67cac783 with scrape type 2
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6492a2a-195b-59c4-bb12-e4fb67cac783 with scrape type 2
2026-03-28 14:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6492a2a-195b-59c4-bb12-e4fb67cac783, identifier: XB66018
2026-03-28 14:03:56 [auto1.es] INFO: Found listing with ID: JM59673
2026-03-28 14:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6492a2a-195b-59c4-bb12-e4fb67cac783 with identifier: XB66018
2026-03-28 14:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6492a2a-195b-59c4-bb12-e4fb67cac783 with identifier: XB66018
2026-03-28 14:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6492a2a-195b-59c4-bb12-e4fb67cac783 with identifier: XB66018 to the API
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:39:19Z',
 'fuel_type': 'diesel',
 'id': 'd6492a2a-195b-59c4-bb12-e4fb67cac783',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB66018',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 273608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-18',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Confort Expression',
 'transmission': 'manual',
 'trim': 'Confort Expression',
 'year': 2007}
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB66018%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [auto1.es] INFO: Saving data for XB66018: {'auction_closing_time': 1774715959.0, 'created_time': 1774620130.504375, 'last_price_update_time': 1774706636.485461}
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XB66018') HTTP/1.1" 204 0
2026-03-28 14:03:56 [auto1.es] INFO: Found listing with ID: ES48862
2026-03-28 14:03:56 [auto1.es] INFO: Found listing with ID: AN82065
2026-03-28 14:03:56 [auto1.es] INFO: Found listing with ID: AP65187
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP65187%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [auto1.es] INFO: Scrape type for AP65187: 2
2026-03-28 14:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 048425dc-a8ea-54e1-9ba9-97ea2836c591 with identifier: AP65187
2026-03-28 14:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 048425dc-a8ea-54e1-9ba9-97ea2836c591 with scrape type 2
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 048425dc-a8ea-54e1-9ba9-97ea2836c591 with scrape type 2
2026-03-28 14:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 048425dc-a8ea-54e1-9ba9-97ea2836c591, identifier: AP65187
2026-03-28 14:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 048425dc-a8ea-54e1-9ba9-97ea2836c591 with identifier: AP65187
2026-03-28 14:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 048425dc-a8ea-54e1-9ba9-97ea2836c591 with identifier: AP65187
2026-03-28 14:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 048425dc-a8ea-54e1-9ba9-97ea2836c591 with identifier: AP65187 to the API
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:14:44Z',
 'fuel_type': 'diesel',
 'id': '048425dc-a8ea-54e1-9ba9-97ea2836c591',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP65187',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 143248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-17',
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2018}
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP65187%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [auto1.es] INFO: Saving data for AP65187: {'auction_closing_time': 1774714484.0, 'created_time': 1774620130.084221, 'last_price_update_time': 1774706636.898256}
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AP65187') HTTP/1.1" 204 0
2026-03-28 14:03:56 [auto1.es] INFO: Found listing with ID: EZ05662
2026-03-28 14:03:56 [auto1.es] INFO: Found listing with ID: GR17806
2026-03-28 14:03:56 [auto1.es] INFO: Found listing with ID: PW69748
2026-03-28 14:03:56 [auto1.es] INFO: Found listing with ID: LM78815
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM78815%27 HTTP/1.1" 200 None
2026-03-28 14:03:56 [auto1.es] INFO: Scrape type for LM78815: 2
2026-03-28 14:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38959b5a-cafe-5caa-8552-18453ba60717 with identifier: LM78815
2026-03-28 14:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38959b5a-cafe-5caa-8552-18453ba60717 with scrape type 2
2026-03-28 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38959b5a-cafe-5caa-8552-18453ba60717 with scrape type 2
2026-03-28 14:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38959b5a-cafe-5caa-8552-18453ba60717, identifier: LM78815
2026-03-28 14:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38959b5a-cafe-5caa-8552-18453ba60717 with identifier: LM78815
2026-03-28 14:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38959b5a-cafe-5caa-8552-18453ba60717 with identifier: LM78815
2026-03-28 14:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 38959b5a-cafe-5caa-8552-18453ba60717 with identifier: LM78815 to the API
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:57:14Z',
 'fuel_type': 'petrol',
 'id': '38959b5a-cafe-5caa-8552-18453ba60717',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM78815',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 94012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM78815%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [auto1.es] INFO: Saving data for LM78815: {'auction_closing_time': 1774717034.0, 'created_time': 1773126878.15939, 'last_price_update_time': 1774706637.346321}
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LM78815') HTTP/1.1" 204 0
2026-03-28 14:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:03:57 [auto1.es] INFO: Found listing with ID: XP48517
2026-03-28 14:03:57 [auto1.es] INFO: Found listing with ID: DD74793
2026-03-28 14:03:57 [auto1.es] INFO: Found listing with ID: VF19120
2026-03-28 14:03:57 [auto1.es] INFO: Found listing with ID: NM32585
2026-03-28 14:03:57 [auto1.es] INFO: Found listing with ID: PY80888
2026-03-28 14:03:57 [auto1.es] INFO: Found listing with ID: RA61754
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA61754%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [auto1.es] INFO: Scrape type for RA61754: 2
2026-03-28 14:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39c68cf8-2a4e-5cc3-9064-ae31362a316b with identifier: RA61754
2026-03-28 14:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c68cf8-2a4e-5cc3-9064-ae31362a316b with scrape type 2
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39c68cf8-2a4e-5cc3-9064-ae31362a316b with scrape type 2
2026-03-28 14:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 39c68cf8-2a4e-5cc3-9064-ae31362a316b, identifier: RA61754
2026-03-28 14:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 39c68cf8-2a4e-5cc3-9064-ae31362a316b with identifier: RA61754
2026-03-28 14:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 39c68cf8-2a4e-5cc3-9064-ae31362a316b with identifier: RA61754
2026-03-28 14:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 39c68cf8-2a4e-5cc3-9064-ae31362a316b with identifier: RA61754 to the API
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:33:31Z',
 'fuel_type': 'diesel',
 'id': '39c68cf8-2a4e-5cc3-9064-ae31362a316b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA61754',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 142066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2020}
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA61754%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [auto1.es] INFO: Saving data for RA61754: {'auction_closing_time': 1774715611.0, 'created_time': 1774382533.729368, 'last_price_update_time': 1774706637.841546}
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RA61754') HTTP/1.1" 204 0
2026-03-28 14:03:57 [auto1.es] INFO: Found listing with ID: TS18952
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS18952%27 HTTP/1.1" 200 None
2026-03-28 14:03:57 [auto1.es] INFO: Scrape type for TS18952: 2
2026-03-28 14:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60543c97-6116-5eeb-b75d-a5fbe33196de with identifier: TS18952
2026-03-28 14:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60543c97-6116-5eeb-b75d-a5fbe33196de with scrape type 2
2026-03-28 14:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60543c97-6116-5eeb-b75d-a5fbe33196de with scrape type 2
2026-03-28 14:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 60543c97-6116-5eeb-b75d-a5fbe33196de, identifier: TS18952
2026-03-28 14:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 60543c97-6116-5eeb-b75d-a5fbe33196de with identifier: TS18952
2026-03-28 14:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 60543c97-6116-5eeb-b75d-a5fbe33196de with identifier: TS18952
2026-03-28 14:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 60543c97-6116-5eeb-b75d-a5fbe33196de with identifier: TS18952 to the API
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:32:26Z',
 'fuel_type': 'diesel',
 'id': '60543c97-6116-5eeb-b75d-a5fbe33196de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS18952',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 108027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi GT Pack',
 'transmission': 'manual',
 'trim': 'GT Pack',
 'year': 2021}
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS18952%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [auto1.es] INFO: Saving data for TS18952: {'auction_closing_time': 1774715546.0, 'created_time': 1773145606.770356, 'last_price_update_time': 1774706638.448189}
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TS18952') HTTP/1.1" 204 0
2026-03-28 14:03:58 [auto1.es] INFO: Channel: 24h | Page: 52 | totalHits: 2696 | hits on page: 40
2026-03-28 14:03:58 [auto1.es] INFO: Found listing with ID: GG84553
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG84553%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [auto1.es] INFO: Scrape type for GG84553: 2
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51e13a77-6339-5562-85a2-a03f2bd99d02 with identifier: GG84553
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51e13a77-6339-5562-85a2-a03f2bd99d02 with scrape type 2
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51e13a77-6339-5562-85a2-a03f2bd99d02 with scrape type 2
2026-03-28 14:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 51e13a77-6339-5562-85a2-a03f2bd99d02, identifier: GG84553
2026-03-28 14:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 51e13a77-6339-5562-85a2-a03f2bd99d02 with identifier: GG84553
2026-03-28 14:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 51e13a77-6339-5562-85a2-a03f2bd99d02 with identifier: GG84553
2026-03-28 14:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 51e13a77-6339-5562-85a2-a03f2bd99d02 with identifier: GG84553 to the API
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:44:58Z',
 'fuel_type': 'petrol',
 'id': '51e13a77-6339-5562-85a2-a03f2bd99d02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG84553',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 167356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG84553%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [auto1.es] INFO: Saving data for GG84553: {'auction_closing_time': 1774716298.0, 'created_time': 1774620128.558498, 'last_price_update_time': 1774706638.841495}
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GG84553') HTTP/1.1" 204 0
2026-03-28 14:03:58 [auto1.es] INFO: Found listing with ID: RC43522
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC43522%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [auto1.es] INFO: Scrape type for RC43522: 2
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7601a30-88e4-5bd0-82b3-9e7d8fb346fc with identifier: RC43522
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7601a30-88e4-5bd0-82b3-9e7d8fb346fc with scrape type 2
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7601a30-88e4-5bd0-82b3-9e7d8fb346fc with scrape type 2
2026-03-28 14:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f7601a30-88e4-5bd0-82b3-9e7d8fb346fc, identifier: RC43522
2026-03-28 14:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:03:58 [auto1.es] INFO: Found listing with ID: VY77417
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY77417%27 HTTP/1.1" 200 None
2026-03-28 14:03:58 [auto1.es] INFO: Scrape type for VY77417: 2
2026-03-28 14:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bfd7156-5b62-5fb6-9296-6a2af7d222c2 with identifier: VY77417
2026-03-28 14:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bfd7156-5b62-5fb6-9296-6a2af7d222c2 with scrape type 2
2026-03-28 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bfd7156-5b62-5fb6-9296-6a2af7d222c2 with scrape type 2
2026-03-28 14:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7bfd7156-5b62-5fb6-9296-6a2af7d222c2, identifier: VY77417
2026-03-28 14:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f7601a30-88e4-5bd0-82b3-9e7d8fb346fc with identifier: RC43522
2026-03-28 14:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f7601a30-88e4-5bd0-82b3-9e7d8fb346fc with identifier: RC43522
2026-03-28 14:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f7601a30-88e4-5bd0-82b3-9e7d8fb346fc with identifier: RC43522 to the API
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:49:45Z',
 'fuel_type': 'petrol',
 'id': 'f7601a30-88e4-5bd0-82b3-9e7d8fb346fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC43522',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Cascada',
 'odometer': 80578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-31',
 'seller_name': None,
 'title': 'Opel Cascada 1.6 SIDI Turbo Excellence',
 'transmission': 'automatic',
 'trim': 'Excellence',
 'year': 2014}
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC43522%27 HTTP/1.1" 200 None
2026-03-28 14:03:59 [auto1.es] INFO: Saving data for RC43522: {'auction_closing_time': 1774716585.0, 'created_time': 1774620129.680655, 'last_price_update_time': 1774706639.317916}
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RC43522') HTTP/1.1" 204 0
2026-03-28 14:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7bfd7156-5b62-5fb6-9296-6a2af7d222c2 with identifier: VY77417
2026-03-28 14:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7bfd7156-5b62-5fb6-9296-6a2af7d222c2 with identifier: VY77417
2026-03-28 14:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7bfd7156-5b62-5fb6-9296-6a2af7d222c2 with identifier: VY77417 to the API
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:42Z',
 'fuel_type': 'diesel',
 'id': '7bfd7156-5b62-5fb6-9296-6a2af7d222c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY77417',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 221136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-11',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2023}
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY77417%27 HTTP/1.1" 200 None
2026-03-28 14:03:59 [auto1.es] INFO: Saving data for VY77417: {'auction_closing_time': 1774716342.0, 'created_time': 1773126710.304708, 'last_price_update_time': 1774706639.598312}
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VY77417') HTTP/1.1" 204 0
2026-03-28 14:03:59 [auto1.es] INFO: Found listing with ID: EH10088
2026-03-28 14:03:59 [auto1.es] INFO: Found listing with ID: FB98424
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB98424%27 HTTP/1.1" 200 None
2026-03-28 14:03:59 [auto1.es] INFO: Scrape type for FB98424: 2
2026-03-28 14:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4398642-3d4f-5470-a91f-1e64de8b2685 with identifier: FB98424
2026-03-28 14:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4398642-3d4f-5470-a91f-1e64de8b2685 with scrape type 2
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4398642-3d4f-5470-a91f-1e64de8b2685 with scrape type 2
2026-03-28 14:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b4398642-3d4f-5470-a91f-1e64de8b2685, identifier: FB98424
2026-03-28 14:03:59 [auto1.es] INFO: Found listing with ID: LS36094
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS36094%27 HTTP/1.1" 200 None
2026-03-28 14:03:59 [auto1.es] INFO: Scrape type for LS36094: 2
2026-03-28 14:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e26f83f-9c65-54a4-a17d-c298c8eac81a with identifier: LS36094
2026-03-28 14:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e26f83f-9c65-54a4-a17d-c298c8eac81a with scrape type 2
2026-03-28 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e26f83f-9c65-54a4-a17d-c298c8eac81a with scrape type 2
2026-03-28 14:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1e26f83f-9c65-54a4-a17d-c298c8eac81a, identifier: LS36094
2026-03-28 14:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b4398642-3d4f-5470-a91f-1e64de8b2685 with identifier: FB98424
2026-03-28 14:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b4398642-3d4f-5470-a91f-1e64de8b2685 with identifier: FB98424
2026-03-28 14:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b4398642-3d4f-5470-a91f-1e64de8b2685 with identifier: FB98424 to the API
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-28T16:16:50Z',
 'fuel_type': 'hybrid',
 'id': 'b4398642-3d4f-5470-a91f-1e64de8b2685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB98424',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 60112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-30',
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 T4 4xe Plug-in Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2022}
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB98424%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [auto1.es] INFO: Saving data for FB98424: {'auction_closing_time': 1774714610.0, 'created_time': 1774620152.49373, 'last_price_update_time': 1774706640.103426}
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FB98424') HTTP/1.1" 204 0
2026-03-28 14:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1e26f83f-9c65-54a4-a17d-c298c8eac81a with identifier: LS36094
2026-03-28 14:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1e26f83f-9c65-54a4-a17d-c298c8eac81a with identifier: LS36094
2026-03-28 14:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1e26f83f-9c65-54a4-a17d-c298c8eac81a with identifier: LS36094 to the API
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-28T16:14:27Z',
 'fuel_type': 'diesel',
 'id': '1e26f83f-9c65-54a4-a17d-c298c8eac81a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS36094',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 114398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-08',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Emotion",
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2013}
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS36094%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [auto1.es] INFO: Saving data for LS36094: {'auction_closing_time': 1774714467.0, 'created_time': 1774620130.982039, 'last_price_update_time': 1774706640.475388}
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LS36094') HTTP/1.1" 204 0
2026-03-28 14:04:00 [auto1.es] INFO: Found listing with ID: GA24285
2026-03-28 14:04:00 [auto1.es] INFO: Found listing with ID: EL53937
2026-03-28 14:04:00 [auto1.es] INFO: Found listing with ID: SL87514
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL87514%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [auto1.es] INFO: Scrape type for SL87514: 2
2026-03-28 14:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72a1e848-af33-57fb-bed1-9efc6269f5b1 with identifier: SL87514
2026-03-28 14:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72a1e848-af33-57fb-bed1-9efc6269f5b1 with scrape type 2
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72a1e848-af33-57fb-bed1-9efc6269f5b1 with scrape type 2
2026-03-28 14:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 72a1e848-af33-57fb-bed1-9efc6269f5b1, identifier: SL87514
2026-03-28 14:04:00 [auto1.es] INFO: Found listing with ID: YW75502
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW75502%27 HTTP/1.1" 200 None
2026-03-28 14:04:00 [auto1.es] INFO: Scrape type for YW75502: 2
2026-03-28 14:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f3b8441-e57e-5d18-ad95-a87ce7e476e4 with identifier: YW75502
2026-03-28 14:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f3b8441-e57e-5d18-ad95-a87ce7e476e4 with scrape type 2
2026-03-28 14:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f3b8441-e57e-5d18-ad95-a87ce7e476e4 with scrape type 2
2026-03-28 14:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4f3b8441-e57e-5d18-ad95-a87ce7e476e4, identifier: YW75502
2026-03-28 14:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 72a1e848-af33-57fb-bed1-9efc6269f5b1 with identifier: SL87514
2026-03-28 14:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 72a1e848-af33-57fb-bed1-9efc6269f5b1 with identifier: SL87514
2026-03-28 14:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 72a1e848-af33-57fb-bed1-9efc6269f5b1 with identifier: SL87514 to the API
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:14:54Z',
 'fuel_type': 'diesel',
 'id': '72a1e848-af33-57fb-bed1-9efc6269f5b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL87514',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 289106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-27',
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2017}
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL87514%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [auto1.es] INFO: Saving data for SL87514: {'auction_closing_time': 1774714494.0, 'created_time': 1774036919.0207691, 'last_price_update_time': 1774706641.040932}
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SL87514') HTTP/1.1" 204 0
2026-03-28 14:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4f3b8441-e57e-5d18-ad95-a87ce7e476e4 with identifier: YW75502
2026-03-28 14:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4f3b8441-e57e-5d18-ad95-a87ce7e476e4 with identifier: YW75502
2026-03-28 14:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4f3b8441-e57e-5d18-ad95-a87ce7e476e4 with identifier: YW75502 to the API
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:05:16Z',
 'fuel_type': 'diesel',
 'id': '4f3b8441-e57e-5d18-ad95-a87ce7e476e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW75502',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 167208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Super Q4',
 'transmission': 'automatic',
 'trim': 'Super Q4',
 'year': 2018}
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW75502%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [auto1.es] INFO: Saving data for YW75502: {'auction_closing_time': 1774713916.0, 'created_time': 1773248740.219351, 'last_price_update_time': 1774706641.365744}
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YW75502') HTTP/1.1" 204 0
2026-03-28 14:04:01 [auto1.es] INFO: Found listing with ID: MN81981
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN81981%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [auto1.es] INFO: Scrape type for MN81981: 2
2026-03-28 14:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d405232d-9c8a-53bc-b902-53bf2a6a021c with identifier: MN81981
2026-03-28 14:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d405232d-9c8a-53bc-b902-53bf2a6a021c with scrape type 2
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d405232d-9c8a-53bc-b902-53bf2a6a021c with scrape type 2
2026-03-28 14:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d405232d-9c8a-53bc-b902-53bf2a6a021c, identifier: MN81981
2026-03-28 14:04:01 [auto1.es] INFO: Found listing with ID: CR47918
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR47918%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [auto1.es] INFO: Scrape type for CR47918: 2
2026-03-28 14:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcd9e69b-5ffe-5514-9dd0-7be4e0d81342 with identifier: CR47918
2026-03-28 14:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcd9e69b-5ffe-5514-9dd0-7be4e0d81342 with scrape type 2
2026-03-28 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcd9e69b-5ffe-5514-9dd0-7be4e0d81342 with scrape type 2
2026-03-28 14:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bcd9e69b-5ffe-5514-9dd0-7be4e0d81342, identifier: CR47918
2026-03-28 14:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d405232d-9c8a-53bc-b902-53bf2a6a021c with identifier: MN81981
2026-03-28 14:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d405232d-9c8a-53bc-b902-53bf2a6a021c with identifier: MN81981
2026-03-28 14:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d405232d-9c8a-53bc-b902-53bf2a6a021c with identifier: MN81981 to the API
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:59:34Z',
 'fuel_type': 'diesel',
 'id': 'd405232d-9c8a-53bc-b902-53bf2a6a021c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN81981',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 172716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-04',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN81981%27 HTTP/1.1" 200 None
2026-03-28 14:04:01 [auto1.es] INFO: Saving data for MN81981: {'auction_closing_time': 1774717174.0, 'created_time': 1773126949.499026, 'last_price_update_time': 1774706641.893511}
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MN81981') HTTP/1.1" 204 0
2026-03-28 14:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bcd9e69b-5ffe-5514-9dd0-7be4e0d81342 with identifier: CR47918
2026-03-28 14:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bcd9e69b-5ffe-5514-9dd0-7be4e0d81342 with identifier: CR47918
2026-03-28 14:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bcd9e69b-5ffe-5514-9dd0-7be4e0d81342 with identifier: CR47918 to the API
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:55:01Z',
 'fuel_type': 'diesel',
 'id': 'bcd9e69b-5ffe-5514-9dd0-7be4e0d81342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR47918',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 151656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-08',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Concept",
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2023}
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR47918%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [auto1.es] INFO: Saving data for CR47918: {'auction_closing_time': 1774716901.0, 'created_time': 1773126714.07789, 'last_price_update_time': 1774706642.22451}
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CR47918') HTTP/1.1" 204 0
2026-03-28 14:04:02 [auto1.es] INFO: Found listing with ID: RG01927
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG01927%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [auto1.es] INFO: Scrape type for RG01927: 2
2026-03-28 14:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bb82790-b1be-5411-9b10-bfe637e4a234 with identifier: RG01927
2026-03-28 14:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bb82790-b1be-5411-9b10-bfe637e4a234 with scrape type 2
2026-03-28 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bb82790-b1be-5411-9b10-bfe637e4a234 with scrape type 2
2026-03-28 14:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7bb82790-b1be-5411-9b10-bfe637e4a234, identifier: RG01927
2026-03-28 14:04:02 [auto1.es] INFO: Found listing with ID: HF65167
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF65167%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [auto1.es] INFO: Scrape type for HF65167: 2
2026-03-28 14:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af09b0a0-895d-586b-bc53-cf36d8e76eba with identifier: HF65167
2026-03-28 14:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af09b0a0-895d-586b-bc53-cf36d8e76eba with scrape type 2
2026-03-28 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af09b0a0-895d-586b-bc53-cf36d8e76eba with scrape type 2
2026-03-28 14:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af09b0a0-895d-586b-bc53-cf36d8e76eba, identifier: HF65167
2026-03-28 14:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7bb82790-b1be-5411-9b10-bfe637e4a234 with identifier: RG01927
2026-03-28 14:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7bb82790-b1be-5411-9b10-bfe637e4a234 with identifier: RG01927
2026-03-28 14:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7bb82790-b1be-5411-9b10-bfe637e4a234 with identifier: RG01927 to the API
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:24:26Z',
 'fuel_type': 'petrol',
 'id': '7bb82790-b1be-5411-9b10-bfe637e4a234',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG01927',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 30908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seller_name': None,
 'title': 'Kia Rio 1.0 TGDI Mild-Hybrid Concept',
 'transmission': 'automatic',
 'trim': 'Concept',
 'year': 2022}
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG01927%27 HTTP/1.1" 200 None
2026-03-28 14:04:02 [auto1.es] INFO: Saving data for RG01927: {'auction_closing_time': 1774715066.0, 'created_time': 1773126971.460922, 'last_price_update_time': 1774706642.768551}
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RG01927') HTTP/1.1" 204 0
2026-03-28 14:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af09b0a0-895d-586b-bc53-cf36d8e76eba with identifier: HF65167
2026-03-28 14:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af09b0a0-895d-586b-bc53-cf36d8e76eba with identifier: HF65167
2026-03-28 14:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af09b0a0-895d-586b-bc53-cf36d8e76eba with identifier: HF65167 to the API
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:55:43Z',
 'fuel_type': 'diesel',
 'id': 'af09b0a0-895d-586b-bc53-cf36d8e76eba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF65167',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 278092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-24',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2008}
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF65167%27 HTTP/1.1" 200 None
2026-03-28 14:04:03 [auto1.es] INFO: Saving data for HF65167: {'auction_closing_time': 1774716943.0, 'created_time': 1774620144.725295, 'last_price_update_time': 1774706643.049013}
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HF65167') HTTP/1.1" 204 0
2026-03-28 14:04:03 [auto1.es] INFO: Found listing with ID: WE77223
2026-03-28 14:04:03 [auto1.es] INFO: Found listing with ID: SL38190
2026-03-28 14:04:03 [auto1.es] INFO: Found listing with ID: KT38971
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT38971%27 HTTP/1.1" 200 None
2026-03-28 14:04:03 [auto1.es] INFO: Scrape type for KT38971: 2
2026-03-28 14:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0158f513-a5a7-5ae0-b679-c145cb20e453 with identifier: KT38971
2026-03-28 14:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0158f513-a5a7-5ae0-b679-c145cb20e453 with scrape type 2
2026-03-28 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0158f513-a5a7-5ae0-b679-c145cb20e453 with scrape type 2
2026-03-28 14:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0158f513-a5a7-5ae0-b679-c145cb20e453, identifier: KT38971
2026-03-28 14:04:03 [auto1.es] INFO: Found listing with ID: GG33729
2026-03-28 14:04:03 [auto1.es] INFO: Found listing with ID: RD19726
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD19726%27 HTTP/1.1" 200 None
2026-03-28 14:04:03 [auto1.es] INFO: Scrape type for RD19726: 2
2026-03-28 14:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d970894e-a931-57a2-ada4-e9528d89f809 with identifier: RD19726
2026-03-28 14:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d970894e-a931-57a2-ada4-e9528d89f809 with scrape type 2
2026-03-28 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d970894e-a931-57a2-ada4-e9528d89f809 with scrape type 2
2026-03-28 14:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d970894e-a931-57a2-ada4-e9528d89f809, identifier: RD19726
2026-03-28 14:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0158f513-a5a7-5ae0-b679-c145cb20e453 with identifier: KT38971
2026-03-28 14:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0158f513-a5a7-5ae0-b679-c145cb20e453 with identifier: KT38971
2026-03-28 14:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0158f513-a5a7-5ae0-b679-c145cb20e453 with identifier: KT38971 to the API
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:01:18Z',
 'fuel_type': 'hybrid',
 'id': '0158f513-a5a7-5ae0-b679-c145cb20e453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT38971',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 24969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-22',
 'seller_name': None,
 'title': 'MINI Countryman Cooper SE ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2023}
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT38971%27 HTTP/1.1" 200 None
2026-03-28 14:04:03 [auto1.es] INFO: Saving data for KT38971: {'auction_closing_time': 1774713678.0, 'created_time': 1773126725.329791, 'last_price_update_time': 1774706643.919987}
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KT38971') HTTP/1.1" 204 0
2026-03-28 14:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d970894e-a931-57a2-ada4-e9528d89f809 with identifier: RD19726
2026-03-28 14:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d970894e-a931-57a2-ada4-e9528d89f809 with identifier: RD19726
2026-03-28 14:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d970894e-a931-57a2-ada4-e9528d89f809 with identifier: RD19726 to the API
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:09:20Z',
 'fuel_type': 'diesel',
 'id': 'd970894e-a931-57a2-ada4-e9528d89f809',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD19726',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 125108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Trend Plus',
 'transmission': 'manual',
 'trim': 'Trend Plus',
 'year': 2022}
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD19726%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [auto1.es] INFO: Saving data for RD19726: {'auction_closing_time': 1774714160.0, 'created_time': 1773126727.813498, 'last_price_update_time': 1774706644.534877}
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD19726') HTTP/1.1" 204 0
2026-03-28 14:04:04 [auto1.es] INFO: Found listing with ID: PW28611
2026-03-28 14:04:04 [auto1.es] INFO: Found listing with ID: LZ88229
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ88229%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [auto1.es] INFO: Scrape type for LZ88229: 2
2026-03-28 14:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0102c636-650d-56a8-a23a-5872c463e301 with identifier: LZ88229
2026-03-28 14:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0102c636-650d-56a8-a23a-5872c463e301 with scrape type 2
2026-03-28 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0102c636-650d-56a8-a23a-5872c463e301 with scrape type 2
2026-03-28 14:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0102c636-650d-56a8-a23a-5872c463e301, identifier: LZ88229
2026-03-28 14:04:04 [auto1.es] INFO: Found listing with ID: FJ71193
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ71193%27 HTTP/1.1" 200 None
2026-03-28 14:04:04 [auto1.es] INFO: Scrape type for FJ71193: 2
2026-03-28 14:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77d6914a-aad1-59bf-ab0c-058327696da8 with identifier: FJ71193
2026-03-28 14:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77d6914a-aad1-59bf-ab0c-058327696da8 with scrape type 2
2026-03-28 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77d6914a-aad1-59bf-ab0c-058327696da8 with scrape type 2
2026-03-28 14:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 77d6914a-aad1-59bf-ab0c-058327696da8, identifier: FJ71193
2026-03-28 14:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0102c636-650d-56a8-a23a-5872c463e301 with identifier: LZ88229
2026-03-28 14:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0102c636-650d-56a8-a23a-5872c463e301 with identifier: LZ88229
2026-03-28 14:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0102c636-650d-56a8-a23a-5872c463e301 with identifier: LZ88229 to the API
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:07:54Z',
 'fuel_type': 'diesel',
 'id': '0102c636-650d-56a8-a23a-5872c463e301',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ88229',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 81384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-24',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ88229%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [auto1.es] INFO: Saving data for LZ88229: {'auction_closing_time': 1774714074.0, 'created_time': 1774382526.589069, 'last_price_update_time': 1774706645.037646}
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LZ88229') HTTP/1.1" 204 0
2026-03-28 14:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 77d6914a-aad1-59bf-ab0c-058327696da8 with identifier: FJ71193
2026-03-28 14:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 77d6914a-aad1-59bf-ab0c-058327696da8 with identifier: FJ71193
2026-03-28 14:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 77d6914a-aad1-59bf-ab0c-058327696da8 with identifier: FJ71193 to the API
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:42Z',
 'fuel_type': 'diesel',
 'id': '77d6914a-aad1-59bf-ab0c-058327696da8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ71193',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 214549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ71193%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [auto1.es] INFO: Saving data for FJ71193: {'auction_closing_time': 1774714062.0, 'created_time': 1774361371.484264, 'last_price_update_time': 1774706645.30093}
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FJ71193') HTTP/1.1" 204 0
2026-03-28 14:04:05 [auto1.es] INFO: Found listing with ID: YM10014
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM10014%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [auto1.es] INFO: Scrape type for YM10014: 2
2026-03-28 14:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d1f3f35-0803-53a6-b72a-b19e417f0bcf with identifier: YM10014
2026-03-28 14:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1f3f35-0803-53a6-b72a-b19e417f0bcf with scrape type 2
2026-03-28 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d1f3f35-0803-53a6-b72a-b19e417f0bcf with scrape type 2
2026-03-28 14:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6d1f3f35-0803-53a6-b72a-b19e417f0bcf, identifier: YM10014
2026-03-28 14:04:05 [auto1.es] INFO: Found listing with ID: JX94297
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX94297%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [auto1.es] INFO: Scrape type for JX94297: 2
2026-03-28 14:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 042d06e3-bd6d-57d0-9082-05cc01051565 with identifier: JX94297
2026-03-28 14:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 042d06e3-bd6d-57d0-9082-05cc01051565 with scrape type 2
2026-03-28 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 042d06e3-bd6d-57d0-9082-05cc01051565 with scrape type 2
2026-03-28 14:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 042d06e3-bd6d-57d0-9082-05cc01051565, identifier: JX94297
2026-03-28 14:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6d1f3f35-0803-53a6-b72a-b19e417f0bcf with identifier: YM10014
2026-03-28 14:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6d1f3f35-0803-53a6-b72a-b19e417f0bcf with identifier: YM10014
2026-03-28 14:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6d1f3f35-0803-53a6-b72a-b19e417f0bcf with identifier: YM10014 to the API
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:38:02Z',
 'fuel_type': 'diesel',
 'id': '6d1f3f35-0803-53a6-b72a-b19e417f0bcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM10014',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 112577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-23',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM10014%27 HTTP/1.1" 200 None
2026-03-28 14:04:05 [auto1.es] INFO: Saving data for YM10014: {'auction_closing_time': 1774715882.0, 'created_time': 1774382542.440749, 'last_price_update_time': 1774706645.787047}
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YM10014') HTTP/1.1" 204 0
2026-03-28 14:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 042d06e3-bd6d-57d0-9082-05cc01051565 with identifier: JX94297
2026-03-28 14:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 042d06e3-bd6d-57d0-9082-05cc01051565 with identifier: JX94297
2026-03-28 14:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 042d06e3-bd6d-57d0-9082-05cc01051565 with identifier: JX94297 to the API
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:48:48Z',
 'fuel_type': 'diesel',
 'id': '042d06e3-bd6d-57d0-9082-05cc01051565',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX94297',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 278115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX94297%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [auto1.es] INFO: Saving data for JX94297: {'auction_closing_time': 1774716528.0, 'created_time': 1774350276.498469, 'last_price_update_time': 1774706646.072021}
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JX94297') HTTP/1.1" 204 0
2026-03-28 14:04:06 [auto1.es] INFO: Found listing with ID: BM84951
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM84951%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [auto1.es] INFO: Scrape type for BM84951: 2
2026-03-28 14:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4ba11a1-d313-5bb7-bb1a-4f9c2c9b9482 with identifier: BM84951
2026-03-28 14:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4ba11a1-d313-5bb7-bb1a-4f9c2c9b9482 with scrape type 2
2026-03-28 14:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4ba11a1-d313-5bb7-bb1a-4f9c2c9b9482 with scrape type 2
2026-03-28 14:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b4ba11a1-d313-5bb7-bb1a-4f9c2c9b9482, identifier: BM84951
2026-03-28 14:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b4ba11a1-d313-5bb7-bb1a-4f9c2c9b9482 with identifier: BM84951
2026-03-28 14:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b4ba11a1-d313-5bb7-bb1a-4f9c2c9b9482 with identifier: BM84951
2026-03-28 14:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b4ba11a1-d313-5bb7-bb1a-4f9c2c9b9482 with identifier: BM84951 to the API
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:14:19Z',
 'fuel_type': 'diesel',
 'id': 'b4ba11a1-d313-5bb7-bb1a-4f9c2c9b9482',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM84951',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 226494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'Volvo V60 2.0 B4 Mild-Hybrid Momentum Pro',
 'transmission': 'automatic',
 'trim': 'Momentum Pro',
 'year': 2021}
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM84951%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [auto1.es] INFO: Saving data for BM84951: {'auction_closing_time': 1774714459.0, 'created_time': 1773248805.261221, 'last_price_update_time': 1774706646.45851}
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BM84951') HTTP/1.1" 204 0
2026-03-28 14:04:06 [auto1.es] INFO: Channel: 24h | Page: 53 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:06 [auto1.es] INFO: Found listing with ID: FX21213
2026-03-28 14:04:06 [auto1.es] INFO: Found listing with ID: JG12549
2026-03-28 14:04:06 [auto1.es] INFO: Found listing with ID: HK65705
2026-03-28 14:04:06 [auto1.es] INFO: Found listing with ID: WN81450
2026-03-28 14:04:06 [auto1.es] INFO: Found listing with ID: TG06683
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG06683%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [auto1.es] INFO: Scrape type for TG06683: 2
2026-03-28 14:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2167831c-3f22-5409-8de0-ccd47e668d0a with identifier: TG06683
2026-03-28 14:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2167831c-3f22-5409-8de0-ccd47e668d0a with scrape type 2
2026-03-28 14:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2167831c-3f22-5409-8de0-ccd47e668d0a with scrape type 2
2026-03-28 14:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2167831c-3f22-5409-8de0-ccd47e668d0a, identifier: TG06683
2026-03-28 14:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2167831c-3f22-5409-8de0-ccd47e668d0a with identifier: TG06683
2026-03-28 14:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2167831c-3f22-5409-8de0-ccd47e668d0a with identifier: TG06683
2026-03-28 14:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2167831c-3f22-5409-8de0-ccd47e668d0a with identifier: TG06683 to the API
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:34:34Z',
 'fuel_type': 'diesel',
 'id': '2167831c-3f22-5409-8de0-ccd47e668d0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG06683',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 165200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG06683%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [auto1.es] INFO: Saving data for TG06683: {'auction_closing_time': 1774715674.0, 'created_time': 1774360910.829578, 'last_price_update_time': 1774706646.850532}
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TG06683') HTTP/1.1" 204 0
2026-03-28 14:04:06 [auto1.es] INFO: Found listing with ID: RF22633
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF22633%27 HTTP/1.1" 200 None
2026-03-28 14:04:06 [auto1.es] INFO: Scrape type for RF22633: 0
2026-03-28 14:04:06 [auto1.es] INFO: Found listing with ID: TB59452
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB59452%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [auto1.es] INFO: Scrape type for TB59452: 2
2026-03-28 14:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cf16034-9085-51d9-bcca-dee34e271e2f with identifier: TB59452
2026-03-28 14:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cf16034-9085-51d9-bcca-dee34e271e2f with scrape type 2
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cf16034-9085-51d9-bcca-dee34e271e2f with scrape type 2
2026-03-28 14:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9cf16034-9085-51d9-bcca-dee34e271e2f, identifier: TB59452
2026-03-28 14:04:07 [auto1.es] INFO: Found listing with ID: RK21190
2026-03-28 14:04:07 [auto1.es] INFO: Found listing with ID: AL55124
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL55124%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [auto1.es] INFO: Scrape type for AL55124: 2
2026-03-28 14:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7e7660c-5768-5dbe-a05a-b1c1e1595cf4 with identifier: AL55124
2026-03-28 14:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7e7660c-5768-5dbe-a05a-b1c1e1595cf4 with scrape type 2
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7e7660c-5768-5dbe-a05a-b1c1e1595cf4 with scrape type 2
2026-03-28 14:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b7e7660c-5768-5dbe-a05a-b1c1e1595cf4, identifier: AL55124
2026-03-28 14:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9cf16034-9085-51d9-bcca-dee34e271e2f with identifier: TB59452
2026-03-28 14:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9cf16034-9085-51d9-bcca-dee34e271e2f with identifier: TB59452
2026-03-28 14:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9cf16034-9085-51d9-bcca-dee34e271e2f with identifier: TB59452 to the API
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 381,
 'expiration_date': '2026-03-28T16:23:29Z',
 'fuel_type': 'hybrid',
 'id': '9cf16034-9085-51d9-bcca-dee34e271e2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB59452',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 147285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 eHybrid Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2020}
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB59452%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [auto1.es] INFO: Saving data for TB59452: {'auction_closing_time': 1774715009.0, 'created_time': 1773900354.077046, 'last_price_update_time': 1774706647.559762}
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB59452') HTTP/1.1" 204 0
2026-03-28 14:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b7e7660c-5768-5dbe-a05a-b1c1e1595cf4 with identifier: AL55124
2026-03-28 14:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b7e7660c-5768-5dbe-a05a-b1c1e1595cf4 with identifier: AL55124
2026-03-28 14:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b7e7660c-5768-5dbe-a05a-b1c1e1595cf4 with identifier: AL55124 to the API
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:22:54Z',
 'fuel_type': 'diesel',
 'id': 'b7e7660c-5768-5dbe-a05a-b1c1e1595cf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL55124',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 139996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-02',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL55124%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [auto1.es] INFO: Saving data for AL55124: {'auction_closing_time': 1774714974.0, 'created_time': 1774382769.668088, 'last_price_update_time': 1774706647.834378}
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AL55124') HTTP/1.1" 204 0
2026-03-28 14:04:07 [auto1.es] INFO: Found listing with ID: JG20309
2026-03-28 14:04:07 [auto1.es] INFO: Found listing with ID: LF34637
2026-03-28 14:04:07 [auto1.es] INFO: Found listing with ID: TA37328
2026-03-28 14:04:07 [auto1.es] INFO: Found listing with ID: KS63423
2026-03-28 14:04:07 [auto1.es] INFO: Found listing with ID: MW76524
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW76524%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [auto1.es] INFO: Scrape type for MW76524: 2
2026-03-28 14:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96ed6887-b2ce-589e-922e-3b8be9623fcc with identifier: MW76524
2026-03-28 14:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96ed6887-b2ce-589e-922e-3b8be9623fcc with scrape type 2
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96ed6887-b2ce-589e-922e-3b8be9623fcc with scrape type 2
2026-03-28 14:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 96ed6887-b2ce-589e-922e-3b8be9623fcc, identifier: MW76524
2026-03-28 14:04:07 [auto1.es] INFO: Found listing with ID: BX87783
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX87783%27 HTTP/1.1" 200 None
2026-03-28 14:04:07 [auto1.es] INFO: Scrape type for BX87783: 2
2026-03-28 14:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af236ab4-a023-57ac-a849-2b6703331a06 with identifier: BX87783
2026-03-28 14:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af236ab4-a023-57ac-a849-2b6703331a06 with scrape type 2
2026-03-28 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af236ab4-a023-57ac-a849-2b6703331a06 with scrape type 2
2026-03-28 14:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af236ab4-a023-57ac-a849-2b6703331a06, identifier: BX87783
2026-03-28 14:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 96ed6887-b2ce-589e-922e-3b8be9623fcc with identifier: MW76524
2026-03-28 14:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 96ed6887-b2ce-589e-922e-3b8be9623fcc with identifier: MW76524
2026-03-28 14:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 96ed6887-b2ce-589e-922e-3b8be9623fcc with identifier: MW76524 to the API
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:06:51Z',
 'fuel_type': 'petrol',
 'id': '96ed6887-b2ce-589e-922e-3b8be9623fcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW76524',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 111528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-28',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2007}
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW76524%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [auto1.es] INFO: Saving data for MW76524: {'auction_closing_time': 1774714011.0, 'created_time': 1773345884.464322, 'last_price_update_time': 1774706648.45676}
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MW76524') HTTP/1.1" 204 0
2026-03-28 14:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af236ab4-a023-57ac-a849-2b6703331a06 with identifier: BX87783
2026-03-28 14:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af236ab4-a023-57ac-a849-2b6703331a06 with identifier: BX87783
2026-03-28 14:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af236ab4-a023-57ac-a849-2b6703331a06 with identifier: BX87783 to the API
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:38:44Z',
 'fuel_type': 'diesel',
 'id': 'af236ab4-a023-57ac-a849-2b6703331a06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX87783',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 63606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX87783%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [auto1.es] INFO: Saving data for BX87783: {'auction_closing_time': 1774715924.0, 'created_time': 1774382758.838525, 'last_price_update_time': 1774706648.751488}
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BX87783') HTTP/1.1" 204 0
2026-03-28 14:04:08 [auto1.es] INFO: Found listing with ID: SU90916
2026-03-28 14:04:08 [auto1.es] INFO: Found listing with ID: YJ60609
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ60609%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [auto1.es] INFO: Scrape type for YJ60609: 2
2026-03-28 14:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8357dffa-ac29-501a-943a-5722231078c7 with identifier: YJ60609
2026-03-28 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8357dffa-ac29-501a-943a-5722231078c7 with scrape type 2
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8357dffa-ac29-501a-943a-5722231078c7 with scrape type 2
2026-03-28 14:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8357dffa-ac29-501a-943a-5722231078c7, identifier: YJ60609
2026-03-28 14:04:08 [auto1.es] INFO: Found listing with ID: UN21453
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN21453%27 HTTP/1.1" 200 None
2026-03-28 14:04:08 [auto1.es] INFO: Scrape type for UN21453: 2
2026-03-28 14:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c642c621-6979-58f7-91cf-0e116c08f4f0 with identifier: UN21453
2026-03-28 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c642c621-6979-58f7-91cf-0e116c08f4f0 with scrape type 2
2026-03-28 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c642c621-6979-58f7-91cf-0e116c08f4f0 with scrape type 2
2026-03-28 14:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c642c621-6979-58f7-91cf-0e116c08f4f0, identifier: UN21453
2026-03-28 14:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8357dffa-ac29-501a-943a-5722231078c7 with identifier: YJ60609
2026-03-28 14:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8357dffa-ac29-501a-943a-5722231078c7 with identifier: YJ60609
2026-03-28 14:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8357dffa-ac29-501a-943a-5722231078c7 with identifier: YJ60609 to the API
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:19:11Z',
 'fuel_type': 'hybrid',
 'id': '8357dffa-ac29-501a-943a-5722231078c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ60609',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 73279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-18',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ60609%27 HTTP/1.1" 200 None
2026-03-28 14:04:09 [auto1.es] INFO: Saving data for YJ60609: {'auction_closing_time': 1774714751.0, 'created_time': 1773432232.473807, 'last_price_update_time': 1774706649.263035}
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ60609') HTTP/1.1" 204 0
2026-03-28 14:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c642c621-6979-58f7-91cf-0e116c08f4f0 with identifier: UN21453
2026-03-28 14:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c642c621-6979-58f7-91cf-0e116c08f4f0 with identifier: UN21453
2026-03-28 14:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c642c621-6979-58f7-91cf-0e116c08f4f0 with identifier: UN21453 to the API
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:09:22Z',
 'fuel_type': 'diesel',
 'id': 'c642c621-6979-58f7-91cf-0e116c08f4f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN21453',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 159741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2013}
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN21453%27 HTTP/1.1" 200 None
2026-03-28 14:04:09 [auto1.es] INFO: Saving data for UN21453: {'auction_closing_time': 1774714162.0, 'created_time': 1774620148.169826, 'last_price_update_time': 1774706649.640015}
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UN21453') HTTP/1.1" 204 0
2026-03-28 14:04:09 [auto1.es] INFO: Found listing with ID: TB20827
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB20827%27 HTTP/1.1" 200 None
2026-03-28 14:04:09 [auto1.es] INFO: Scrape type for TB20827: 2
2026-03-28 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abae9e4c-aa7f-54dd-b113-0d2608cfe11d with identifier: TB20827
2026-03-28 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abae9e4c-aa7f-54dd-b113-0d2608cfe11d with scrape type 2
2026-03-28 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abae9e4c-aa7f-54dd-b113-0d2608cfe11d with scrape type 2
2026-03-28 14:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: abae9e4c-aa7f-54dd-b113-0d2608cfe11d, identifier: TB20827
2026-03-28 14:04:09 [auto1.es] INFO: Found listing with ID: KF67108
2026-03-28 14:04:09 [auto1.es] INFO: Found listing with ID: HN15529
2026-03-28 14:04:09 [auto1.es] INFO: Found listing with ID: WZ09714
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ09714%27 HTTP/1.1" 200 None
2026-03-28 14:04:09 [auto1.es] INFO: Scrape type for WZ09714: 2
2026-03-28 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f16b60d6-7d86-505d-8143-32769c10ac97 with identifier: WZ09714
2026-03-28 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f16b60d6-7d86-505d-8143-32769c10ac97 with scrape type 2
2026-03-28 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f16b60d6-7d86-505d-8143-32769c10ac97 with scrape type 2
2026-03-28 14:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f16b60d6-7d86-505d-8143-32769c10ac97, identifier: WZ09714
2026-03-28 14:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: abae9e4c-aa7f-54dd-b113-0d2608cfe11d with identifier: TB20827
2026-03-28 14:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: abae9e4c-aa7f-54dd-b113-0d2608cfe11d with identifier: TB20827
2026-03-28 14:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: abae9e4c-aa7f-54dd-b113-0d2608cfe11d with identifier: TB20827 to the API
2026-03-28 14:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:24:18Z',
 'fuel_type': 'diesel',
 'id': 'abae9e4c-aa7f-54dd-b113-0d2608cfe11d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB20827',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 124532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB20827%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [auto1.es] INFO: Saving data for TB20827: {'auction_closing_time': 1774715058.0, 'created_time': 1773432240.702911, 'last_price_update_time': 1774706650.143889}
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB20827') HTTP/1.1" 204 0
2026-03-28 14:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f16b60d6-7d86-505d-8143-32769c10ac97 with identifier: WZ09714
2026-03-28 14:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f16b60d6-7d86-505d-8143-32769c10ac97 with identifier: WZ09714
2026-03-28 14:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f16b60d6-7d86-505d-8143-32769c10ac97 with identifier: WZ09714 to the API
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:00:15Z',
 'fuel_type': 'diesel',
 'id': 'f16b60d6-7d86-505d-8143-32769c10ac97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ09714',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 191127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seller_name': None,
 'title': 'Renault Talisman 1.7 BLUE dCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2020}
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ09714%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [auto1.es] INFO: Saving data for WZ09714: {'auction_closing_time': 1774713615.0, 'created_time': 1774361227.446374, 'last_price_update_time': 1774706650.433264}
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WZ09714') HTTP/1.1" 204 0
2026-03-28 14:04:10 [auto1.es] INFO: Found listing with ID: JR41621
2026-03-28 14:04:10 [auto1.es] INFO: Found listing with ID: RR11017
2026-03-28 14:04:10 [auto1.es] INFO: Found listing with ID: HC78450
2026-03-28 14:04:10 [auto1.es] INFO: Found listing with ID: VE86539
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE86539%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [auto1.es] INFO: Scrape type for VE86539: 2
2026-03-28 14:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be79a643-6c59-51e3-ac89-d093d9d260e1 with identifier: VE86539
2026-03-28 14:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be79a643-6c59-51e3-ac89-d093d9d260e1 with scrape type 2
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be79a643-6c59-51e3-ac89-d093d9d260e1 with scrape type 2
2026-03-28 14:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be79a643-6c59-51e3-ac89-d093d9d260e1, identifier: VE86539
2026-03-28 14:04:10 [scrapy.extensions.logstats] INFO: Crawled 163 pages (at 13 pages/min), scraped 231 items (at 93 items/min)
2026-03-28 14:04:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-28 14:04:10 [auto1.es] INFO: Found listing with ID: GT72542
2026-03-28 14:04:10 [auto1.es] INFO: Found listing with ID: NC85422
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC85422%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [auto1.es] INFO: Scrape type for NC85422: 2
2026-03-28 14:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52035ab6-ce81-5a44-9bff-2148054a7ef3 with identifier: NC85422
2026-03-28 14:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52035ab6-ce81-5a44-9bff-2148054a7ef3 with scrape type 2
2026-03-28 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52035ab6-ce81-5a44-9bff-2148054a7ef3 with scrape type 2
2026-03-28 14:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 52035ab6-ce81-5a44-9bff-2148054a7ef3, identifier: NC85422
2026-03-28 14:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be79a643-6c59-51e3-ac89-d093d9d260e1 with identifier: VE86539
2026-03-28 14:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be79a643-6c59-51e3-ac89-d093d9d260e1 with identifier: VE86539
2026-03-28 14:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be79a643-6c59-51e3-ac89-d093d9d260e1 with identifier: VE86539 to the API
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:16:14Z',
 'fuel_type': 'diesel',
 'id': 'be79a643-6c59-51e3-ac89-d093d9d260e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE86539',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 165940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-24',
 'seller_name': None,
 'title': 'MINI Clubman Cooper SD ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2017}
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE86539%27 HTTP/1.1" 200 None
2026-03-28 14:04:10 [auto1.es] INFO: Saving data for VE86539: {'auction_closing_time': 1774714574.0, 'created_time': 1773432311.135029, 'last_price_update_time': 1774706650.983894}
2026-03-28 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VE86539') HTTP/1.1" 204 0
2026-03-28 14:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 52035ab6-ce81-5a44-9bff-2148054a7ef3 with identifier: NC85422
2026-03-28 14:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 52035ab6-ce81-5a44-9bff-2148054a7ef3 with identifier: NC85422
2026-03-28 14:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 52035ab6-ce81-5a44-9bff-2148054a7ef3 with identifier: NC85422 to the API
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:34:32Z',
 'fuel_type': 'diesel',
 'id': '52035ab6-ce81-5a44-9bff-2148054a7ef3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC85422',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 159811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seller_name': None,
 'title': 'Renault Talisman 1.7 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2020}
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC85422%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [auto1.es] INFO: Saving data for NC85422: {'auction_closing_time': 1774715672.0, 'created_time': 1773126972.934198, 'last_price_update_time': 1774706651.263312}
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NC85422') HTTP/1.1" 204 0
2026-03-28 14:04:11 [auto1.es] INFO: Found listing with ID: SB05981
2026-03-28 14:04:11 [auto1.es] INFO: Found listing with ID: GH64040
2026-03-28 14:04:11 [auto1.es] INFO: Found listing with ID: US21221
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US21221%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [auto1.es] INFO: Scrape type for US21221: 2
2026-03-28 14:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba4a314a-4816-5ee6-9844-7132171f7ed0 with identifier: US21221
2026-03-28 14:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba4a314a-4816-5ee6-9844-7132171f7ed0 with scrape type 2
2026-03-28 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba4a314a-4816-5ee6-9844-7132171f7ed0 with scrape type 2
2026-03-28 14:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ba4a314a-4816-5ee6-9844-7132171f7ed0, identifier: US21221
2026-03-28 14:04:11 [auto1.es] INFO: Found listing with ID: NG03443
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG03443%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [auto1.es] INFO: Scrape type for NG03443: 2
2026-03-28 14:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68b59ce-78f1-539e-8a70-382ae6e2de2e with identifier: NG03443
2026-03-28 14:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68b59ce-78f1-539e-8a70-382ae6e2de2e with scrape type 2
2026-03-28 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68b59ce-78f1-539e-8a70-382ae6e2de2e with scrape type 2
2026-03-28 14:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d68b59ce-78f1-539e-8a70-382ae6e2de2e, identifier: NG03443
2026-03-28 14:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ba4a314a-4816-5ee6-9844-7132171f7ed0 with identifier: US21221
2026-03-28 14:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ba4a314a-4816-5ee6-9844-7132171f7ed0 with identifier: US21221
2026-03-28 14:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ba4a314a-4816-5ee6-9844-7132171f7ed0 with identifier: US21221 to the API
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:30:21Z',
 'fuel_type': 'diesel',
 'id': 'ba4a314a-4816-5ee6-9844-7132171f7ed0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US21221',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 73294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'BMW X3 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2020}
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US21221%27 HTTP/1.1" 200 None
2026-03-28 14:04:11 [auto1.es] INFO: Saving data for US21221: {'auction_closing_time': 1774715421.0, 'created_time': 1773432278.848295, 'last_price_update_time': 1774706651.762404}
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='US21221') HTTP/1.1" 204 0
2026-03-28 14:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d68b59ce-78f1-539e-8a70-382ae6e2de2e with identifier: NG03443
2026-03-28 14:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d68b59ce-78f1-539e-8a70-382ae6e2de2e with identifier: NG03443
2026-03-28 14:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d68b59ce-78f1-539e-8a70-382ae6e2de2e with identifier: NG03443 to the API
2026-03-28 14:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 457,
 'expiration_date': '2026-03-28T16:54:15Z',
 'fuel_type': 'hybrid',
 'id': 'd68b59ce-78f1-539e-8a70-382ae6e2de2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG03443',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Explorer',
 'odometer': 78904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-08',
 'seller_name': None,
 'title': 'Ford Explorer 3.0 Plug-in Hybrid 4x4 ST-Line',
 'transmission': 'automatic',
 'trim': '4x4 ST-Line',
 'year': 2021}
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG03443%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [auto1.es] INFO: Saving data for NG03443: {'auction_closing_time': 1774716855.0, 'created_time': 1774361221.247703, 'last_price_update_time': 1774706652.1565}
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NG03443') HTTP/1.1" 204 0
2026-03-28 14:04:12 [auto1.es] INFO: Found listing with ID: SB85910
2026-03-28 14:04:12 [auto1.es] INFO: Found listing with ID: WZ08736
2026-03-28 14:04:12 [auto1.es] INFO: Found listing with ID: YH80645
2026-03-28 14:04:12 [auto1.es] INFO: Found listing with ID: FW08254
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW08254%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [auto1.es] INFO: Scrape type for FW08254: 2
2026-03-28 14:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d67dbab-c6cb-5951-a2b3-c789a24f0903 with identifier: FW08254
2026-03-28 14:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d67dbab-c6cb-5951-a2b3-c789a24f0903 with scrape type 2
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d67dbab-c6cb-5951-a2b3-c789a24f0903 with scrape type 2
2026-03-28 14:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5d67dbab-c6cb-5951-a2b3-c789a24f0903, identifier: FW08254
2026-03-28 14:04:12 [auto1.es] INFO: Found listing with ID: ZM94527
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM94527%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [auto1.es] INFO: Scrape type for ZM94527: 2
2026-03-28 14:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bebf548d-2e19-51a0-a9ea-e641b76dbd5f with identifier: ZM94527
2026-03-28 14:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bebf548d-2e19-51a0-a9ea-e641b76dbd5f with scrape type 2
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bebf548d-2e19-51a0-a9ea-e641b76dbd5f with scrape type 2
2026-03-28 14:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bebf548d-2e19-51a0-a9ea-e641b76dbd5f, identifier: ZM94527
2026-03-28 14:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5d67dbab-c6cb-5951-a2b3-c789a24f0903 with identifier: FW08254
2026-03-28 14:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5d67dbab-c6cb-5951-a2b3-c789a24f0903 with identifier: FW08254
2026-03-28 14:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5d67dbab-c6cb-5951-a2b3-c789a24f0903 with identifier: FW08254 to the API
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:28:03Z',
 'fuel_type': 'diesel',
 'id': '5d67dbab-c6cb-5951-a2b3-c789a24f0903',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW08254',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 79579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2021}
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW08254%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [auto1.es] INFO: Saving data for FW08254: {'auction_closing_time': 1774715283.0, 'created_time': 1773432316.761987, 'last_price_update_time': 1774706652.637626}
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FW08254') HTTP/1.1" 204 0
2026-03-28 14:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bebf548d-2e19-51a0-a9ea-e641b76dbd5f with identifier: ZM94527
2026-03-28 14:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bebf548d-2e19-51a0-a9ea-e641b76dbd5f with identifier: ZM94527
2026-03-28 14:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bebf548d-2e19-51a0-a9ea-e641b76dbd5f with identifier: ZM94527 to the API
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:33:29Z',
 'fuel_type': 'petrol',
 'id': 'bebf548d-2e19-51a0-a9ea-e641b76dbd5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM94527',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 155173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-02',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.4 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2007}
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM94527%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [auto1.es] INFO: Saving data for ZM94527: {'auction_closing_time': 1774715609.0, 'created_time': 1774620134.803556, 'last_price_update_time': 1774706652.907362}
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZM94527') HTTP/1.1" 204 0
2026-03-28 14:04:12 [auto1.es] INFO: Found listing with ID: PK70837
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK70837%27 HTTP/1.1" 200 None
2026-03-28 14:04:12 [auto1.es] INFO: Scrape type for PK70837: 2
2026-03-28 14:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5ed72be-5d96-5107-a3c8-89e35858c3a0 with identifier: PK70837
2026-03-28 14:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5ed72be-5d96-5107-a3c8-89e35858c3a0 with scrape type 2
2026-03-28 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5ed72be-5d96-5107-a3c8-89e35858c3a0 with scrape type 2
2026-03-28 14:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e5ed72be-5d96-5107-a3c8-89e35858c3a0, identifier: PK70837
2026-03-28 14:04:13 [auto1.es] INFO: Found listing with ID: ZY05184
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY05184%27 HTTP/1.1" 200 None
2026-03-28 14:04:13 [auto1.es] INFO: Scrape type for ZY05184: 2
2026-03-28 14:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82da5359-2fc7-52ce-9c5e-7eb3c2ae0c9b with identifier: ZY05184
2026-03-28 14:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82da5359-2fc7-52ce-9c5e-7eb3c2ae0c9b with scrape type 2
2026-03-28 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82da5359-2fc7-52ce-9c5e-7eb3c2ae0c9b with scrape type 2
2026-03-28 14:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 82da5359-2fc7-52ce-9c5e-7eb3c2ae0c9b, identifier: ZY05184
2026-03-28 14:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e5ed72be-5d96-5107-a3c8-89e35858c3a0 with identifier: PK70837
2026-03-28 14:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e5ed72be-5d96-5107-a3c8-89e35858c3a0 with identifier: PK70837
2026-03-28 14:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e5ed72be-5d96-5107-a3c8-89e35858c3a0 with identifier: PK70837 to the API
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:19:26Z',
 'fuel_type': 'diesel',
 'id': 'e5ed72be-5d96-5107-a3c8-89e35858c3a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK70837',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 266376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Porsche Cayenne Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK70837%27 HTTP/1.1" 200 None
2026-03-28 14:04:13 [auto1.es] INFO: Saving data for PK70837: {'auction_closing_time': 1774714766.0, 'created_time': 1773345735.039192, 'last_price_update_time': 1774706653.390147}
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PK70837') HTTP/1.1" 204 0
2026-03-28 14:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 82da5359-2fc7-52ce-9c5e-7eb3c2ae0c9b with identifier: ZY05184
2026-03-28 14:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 82da5359-2fc7-52ce-9c5e-7eb3c2ae0c9b with identifier: ZY05184
2026-03-28 14:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 82da5359-2fc7-52ce-9c5e-7eb3c2ae0c9b with identifier: ZY05184 to the API
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:45Z',
 'fuel_type': 'diesel',
 'id': '82da5359-2fc7-52ce-9c5e-7eb3c2ae0c9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY05184',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 243182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-09',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY05184%27 HTTP/1.1" 200 None
2026-03-28 14:04:13 [auto1.es] INFO: Saving data for ZY05184: {'auction_closing_time': 1774713885.0, 'created_time': 1774620147.736497, 'last_price_update_time': 1774706653.681688}
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZY05184') HTTP/1.1" 204 0
2026-03-28 14:04:13 [auto1.es] INFO: Found listing with ID: EG02791
2026-03-28 14:04:13 [auto1.es] INFO: Found listing with ID: DF32061
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF32061%27 HTTP/1.1" 200 None
2026-03-28 14:04:13 [auto1.es] INFO: Scrape type for DF32061: 2
2026-03-28 14:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7263f2e-0b04-5ef3-8c65-32d3bae167e7 with identifier: DF32061
2026-03-28 14:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7263f2e-0b04-5ef3-8c65-32d3bae167e7 with scrape type 2
2026-03-28 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7263f2e-0b04-5ef3-8c65-32d3bae167e7 with scrape type 2
2026-03-28 14:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d7263f2e-0b04-5ef3-8c65-32d3bae167e7, identifier: DF32061
2026-03-28 14:04:13 [auto1.es] INFO: Found listing with ID: XB60101
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB60101%27 HTTP/1.1" 200 None
2026-03-28 14:04:13 [auto1.es] INFO: Scrape type for XB60101: 2
2026-03-28 14:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9f6ac4d-92e1-57de-a5a2-8df539af999b with identifier: XB60101
2026-03-28 14:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9f6ac4d-92e1-57de-a5a2-8df539af999b with scrape type 2
2026-03-28 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9f6ac4d-92e1-57de-a5a2-8df539af999b with scrape type 2
2026-03-28 14:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e9f6ac4d-92e1-57de-a5a2-8df539af999b, identifier: XB60101
2026-03-28 14:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d7263f2e-0b04-5ef3-8c65-32d3bae167e7 with identifier: DF32061
2026-03-28 14:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d7263f2e-0b04-5ef3-8c65-32d3bae167e7 with identifier: DF32061
2026-03-28 14:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d7263f2e-0b04-5ef3-8c65-32d3bae167e7 with identifier: DF32061 to the API
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:44:54Z',
 'fuel_type': 'diesel',
 'id': 'd7263f2e-0b04-5ef3-8c65-32d3bae167e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF32061',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 248088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-20',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2013}
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF32061%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [auto1.es] INFO: Saving data for DF32061: {'auction_closing_time': 1774716294.0, 'created_time': 1774620151.409291, 'last_price_update_time': 1774706654.165715}
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DF32061') HTTP/1.1" 204 0
2026-03-28 14:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e9f6ac4d-92e1-57de-a5a2-8df539af999b with identifier: XB60101
2026-03-28 14:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e9f6ac4d-92e1-57de-a5a2-8df539af999b with identifier: XB60101
2026-03-28 14:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e9f6ac4d-92e1-57de-a5a2-8df539af999b with identifier: XB60101 to the API
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:08:37Z',
 'fuel_type': 'hybrid',
 'id': 'e9f6ac4d-92e1-57de-a5a2-8df539af999b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB60101',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 158928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-31',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB60101%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [auto1.es] INFO: Saving data for XB60101: {'auction_closing_time': 1774714117.0, 'created_time': 1774361197.46418, 'last_price_update_time': 1774706654.467552}
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XB60101') HTTP/1.1" 204 0
2026-03-28 14:04:14 [auto1.es] INFO: Found listing with ID: JA56838
2026-03-28 14:04:14 [auto1.es] INFO: Found listing with ID: ZH85985
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH85985%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [auto1.es] INFO: Scrape type for ZH85985: 2
2026-03-28 14:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4bfce91-99d9-5cad-87d0-c4e7ff19d4dd with identifier: ZH85985
2026-03-28 14:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4bfce91-99d9-5cad-87d0-c4e7ff19d4dd with scrape type 2
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4bfce91-99d9-5cad-87d0-c4e7ff19d4dd with scrape type 2
2026-03-28 14:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c4bfce91-99d9-5cad-87d0-c4e7ff19d4dd, identifier: ZH85985
2026-03-28 14:04:14 [auto1.es] INFO: Found listing with ID: MD81888
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD81888%27 HTTP/1.1" 200 None
2026-03-28 14:04:14 [auto1.es] INFO: Scrape type for MD81888: 2
2026-03-28 14:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c44cec78-b8e7-52f0-b828-b59d1443c356 with identifier: MD81888
2026-03-28 14:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c44cec78-b8e7-52f0-b828-b59d1443c356 with scrape type 2
2026-03-28 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c44cec78-b8e7-52f0-b828-b59d1443c356 with scrape type 2
2026-03-28 14:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c44cec78-b8e7-52f0-b828-b59d1443c356, identifier: MD81888
2026-03-28 14:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c4bfce91-99d9-5cad-87d0-c4e7ff19d4dd with identifier: ZH85985
2026-03-28 14:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c4bfce91-99d9-5cad-87d0-c4e7ff19d4dd with identifier: ZH85985
2026-03-28 14:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c4bfce91-99d9-5cad-87d0-c4e7ff19d4dd with identifier: ZH85985 to the API
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:32Z',
 'fuel_type': 'diesel',
 'id': 'c4bfce91-99d9-5cad-87d0-c4e7ff19d4dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH85985',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 330898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-31',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH85985%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [auto1.es] INFO: Saving data for ZH85985: {'auction_closing_time': 1774715672.0, 'created_time': 1774620140.870798, 'last_price_update_time': 1774706655.036091}
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZH85985') HTTP/1.1" 204 0
2026-03-28 14:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c44cec78-b8e7-52f0-b828-b59d1443c356 with identifier: MD81888
2026-03-28 14:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c44cec78-b8e7-52f0-b828-b59d1443c356 with identifier: MD81888
2026-03-28 14:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c44cec78-b8e7-52f0-b828-b59d1443c356 with identifier: MD81888 to the API
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:58:22Z',
 'fuel_type': 'diesel',
 'id': 'c44cec78-b8e7-52f0-b828-b59d1443c356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD81888',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 239700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-29',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD81888%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [auto1.es] INFO: Saving data for MD81888: {'auction_closing_time': 1774717102.0, 'created_time': 1774037157.915987, 'last_price_update_time': 1774706655.41038}
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MD81888') HTTP/1.1" 204 0
2026-03-28 14:04:15 [auto1.es] INFO: Found listing with ID: YD78878
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD78878%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [auto1.es] INFO: Scrape type for YD78878: 2
2026-03-28 14:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28368dee-42c1-5f22-a067-abdf2ef60587 with identifier: YD78878
2026-03-28 14:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28368dee-42c1-5f22-a067-abdf2ef60587 with scrape type 2
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28368dee-42c1-5f22-a067-abdf2ef60587 with scrape type 2
2026-03-28 14:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 28368dee-42c1-5f22-a067-abdf2ef60587, identifier: YD78878
2026-03-28 14:04:15 [auto1.es] INFO: Found listing with ID: DS53595
2026-03-28 14:04:15 [auto1.es] INFO: Found listing with ID: JK89410
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK89410%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [auto1.es] INFO: Scrape type for JK89410: 2
2026-03-28 14:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3465d0fd-9d13-5d57-9795-d13a865f9c3e with identifier: JK89410
2026-03-28 14:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3465d0fd-9d13-5d57-9795-d13a865f9c3e with scrape type 2
2026-03-28 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3465d0fd-9d13-5d57-9795-d13a865f9c3e with scrape type 2
2026-03-28 14:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3465d0fd-9d13-5d57-9795-d13a865f9c3e, identifier: JK89410
2026-03-28 14:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 28368dee-42c1-5f22-a067-abdf2ef60587 with identifier: YD78878
2026-03-28 14:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 28368dee-42c1-5f22-a067-abdf2ef60587 with identifier: YD78878
2026-03-28 14:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 28368dee-42c1-5f22-a067-abdf2ef60587 with identifier: YD78878 to the API
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:36:14Z',
 'fuel_type': 'petrol',
 'id': '28368dee-42c1-5f22-a067-abdf2ef60587',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD78878',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 303347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-23',
 'seller_name': None,
 'title': 'Toyota Auris 1.6 Luna',
 'transmission': 'manual',
 'trim': 'Luna',
 'year': 2008}
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD78878%27 HTTP/1.1" 200 None
2026-03-28 14:04:15 [auto1.es] INFO: Saving data for YD78878: {'auction_closing_time': 1774715774.0, 'created_time': 1774620150.582138, 'last_price_update_time': 1774706655.957019}
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YD78878') HTTP/1.1" 204 0
2026-03-28 14:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3465d0fd-9d13-5d57-9795-d13a865f9c3e with identifier: JK89410
2026-03-28 14:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3465d0fd-9d13-5d57-9795-d13a865f9c3e with identifier: JK89410
2026-03-28 14:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3465d0fd-9d13-5d57-9795-d13a865f9c3e with identifier: JK89410 to the API
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:05:26Z',
 'fuel_type': 'petrol',
 'id': '3465d0fd-9d13-5d57-9795-d13a865f9c3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK89410',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 51833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-06',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK89410%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [auto1.es] INFO: Saving data for JK89410: {'auction_closing_time': 1774713926.0, 'created_time': 1774361207.653457, 'last_price_update_time': 1774706656.252266}
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JK89410') HTTP/1.1" 204 0
2026-03-28 14:04:16 [auto1.es] INFO: Found listing with ID: BB57842
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB57842%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [auto1.es] INFO: Scrape type for BB57842: 2
2026-03-28 14:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce824588-3e77-517e-b8a4-55fecf870a27 with identifier: BB57842
2026-03-28 14:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce824588-3e77-517e-b8a4-55fecf870a27 with scrape type 2
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce824588-3e77-517e-b8a4-55fecf870a27 with scrape type 2
2026-03-28 14:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce824588-3e77-517e-b8a4-55fecf870a27, identifier: BB57842
2026-03-28 14:04:16 [auto1.es] INFO: Found listing with ID: KT73774
2026-03-28 14:04:16 [auto1.es] INFO: Found listing with ID: DN57812
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN57812%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [auto1.es] INFO: Scrape type for DN57812: 2
2026-03-28 14:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f69e1dc-8d09-5cbd-9dc4-87b8c064898c with identifier: DN57812
2026-03-28 14:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f69e1dc-8d09-5cbd-9dc4-87b8c064898c with scrape type 2
2026-03-28 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f69e1dc-8d09-5cbd-9dc4-87b8c064898c with scrape type 2
2026-03-28 14:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f69e1dc-8d09-5cbd-9dc4-87b8c064898c, identifier: DN57812
2026-03-28 14:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce824588-3e77-517e-b8a4-55fecf870a27 with identifier: BB57842
2026-03-28 14:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce824588-3e77-517e-b8a4-55fecf870a27 with identifier: BB57842
2026-03-28 14:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce824588-3e77-517e-b8a4-55fecf870a27 with identifier: BB57842 to the API
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:51:39Z',
 'fuel_type': 'petrol',
 'id': 'ce824588-3e77-517e-b8a4-55fecf870a27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB57842',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 35534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-02',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 T-GDI N Line',
 'transmission': 'manual',
 'trim': 'N Line',
 'year': 2023}
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB57842%27 HTTP/1.1" 200 None
2026-03-28 14:04:16 [auto1.es] INFO: Saving data for BB57842: {'auction_closing_time': 1774716699.0, 'created_time': 1773345783.418289, 'last_price_update_time': 1774706656.774676}
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BB57842') HTTP/1.1" 204 0
2026-03-28 14:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f69e1dc-8d09-5cbd-9dc4-87b8c064898c with identifier: DN57812
2026-03-28 14:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f69e1dc-8d09-5cbd-9dc4-87b8c064898c with identifier: DN57812
2026-03-28 14:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f69e1dc-8d09-5cbd-9dc4-87b8c064898c with identifier: DN57812 to the API
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 309,
 'expiration_date': '2026-03-28T16:29:59Z',
 'fuel_type': 'hybrid',
 'id': '2f69e1dc-8d09-5cbd-9dc4-87b8c064898c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN57812',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 38820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport P300e Hybrid SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2021}
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN57812%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [auto1.es] INFO: Saving data for DN57812: {'auction_closing_time': 1774715399.0, 'created_time': 1774361349.206688, 'last_price_update_time': 1774706657.07059}
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DN57812') HTTP/1.1" 204 0
2026-03-28 14:04:17 [auto1.es] INFO: Found listing with ID: FP11877
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP11877%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [auto1.es] INFO: Scrape type for FP11877: 2
2026-03-28 14:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2828c9ec-a01b-54f1-9aa7-cb6fe20ca6cf with identifier: FP11877
2026-03-28 14:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2828c9ec-a01b-54f1-9aa7-cb6fe20ca6cf with scrape type 2
2026-03-28 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2828c9ec-a01b-54f1-9aa7-cb6fe20ca6cf with scrape type 2
2026-03-28 14:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2828c9ec-a01b-54f1-9aa7-cb6fe20ca6cf, identifier: FP11877
2026-03-28 14:04:17 [auto1.es] INFO: Found listing with ID: GF25247
2026-03-28 14:04:17 [auto1.es] INFO: Found listing with ID: GY71785
2026-03-28 14:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2828c9ec-a01b-54f1-9aa7-cb6fe20ca6cf with identifier: FP11877
2026-03-28 14:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2828c9ec-a01b-54f1-9aa7-cb6fe20ca6cf with identifier: FP11877
2026-03-28 14:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2828c9ec-a01b-54f1-9aa7-cb6fe20ca6cf with identifier: FP11877 to the API
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:23:35Z',
 'fuel_type': 'hybrid',
 'id': '2828c9ec-a01b-54f1-9aa7-cb6fe20ca6cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP11877',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 25227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300de 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2024}
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP11877%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [auto1.es] INFO: Saving data for FP11877: {'auction_closing_time': 1774715015.0, 'created_time': 1774382777.592765, 'last_price_update_time': 1774706657.488962}
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FP11877') HTTP/1.1" 204 0
2026-03-28 14:04:17 [auto1.es] INFO: Channel: 24h | Page: 54 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:17 [auto1.es] INFO: Found listing with ID: XS07722
2026-03-28 14:04:17 [auto1.es] INFO: Found listing with ID: SM50481
2026-03-28 14:04:17 [auto1.es] INFO: Found listing with ID: AM60182
2026-03-28 14:04:17 [auto1.es] INFO: Found listing with ID: WR08352
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR08352%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [auto1.es] INFO: Scrape type for WR08352: 2
2026-03-28 14:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc47d7e6-9522-584c-8872-e29e8b32bda2 with identifier: WR08352
2026-03-28 14:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc47d7e6-9522-584c-8872-e29e8b32bda2 with scrape type 2
2026-03-28 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc47d7e6-9522-584c-8872-e29e8b32bda2 with scrape type 2
2026-03-28 14:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cc47d7e6-9522-584c-8872-e29e8b32bda2, identifier: WR08352
2026-03-28 14:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cc47d7e6-9522-584c-8872-e29e8b32bda2 with identifier: WR08352
2026-03-28 14:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cc47d7e6-9522-584c-8872-e29e8b32bda2 with identifier: WR08352
2026-03-28 14:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cc47d7e6-9522-584c-8872-e29e8b32bda2 with identifier: WR08352 to the API
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:21:51Z',
 'fuel_type': 'diesel',
 'id': 'cc47d7e6-9522-584c-8872-e29e8b32bda2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR08352',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-13',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2022}
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR08352%27 HTTP/1.1" 200 None
2026-03-28 14:04:17 [auto1.es] INFO: Saving data for WR08352: {'auction_closing_time': 1774714911.0, 'created_time': 1773127079.807136, 'last_price_update_time': 1774706657.917837}
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WR08352') HTTP/1.1" 204 0
2026-03-28 14:04:18 [auto1.es] INFO: Found listing with ID: TP19820
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP19820%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [auto1.es] INFO: Scrape type for TP19820: 2
2026-03-28 14:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e50a90be-dc51-5e36-9bd1-a2b4e911cb1a with identifier: TP19820
2026-03-28 14:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e50a90be-dc51-5e36-9bd1-a2b4e911cb1a with scrape type 2
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e50a90be-dc51-5e36-9bd1-a2b4e911cb1a with scrape type 2
2026-03-28 14:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e50a90be-dc51-5e36-9bd1-a2b4e911cb1a, identifier: TP19820
2026-03-28 14:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:18 [auto1.es] INFO: Found listing with ID: GY73641
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY73641%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [auto1.es] INFO: Scrape type for GY73641: 2
2026-03-28 14:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a43a1d82-09fc-5a31-996c-f140cf9b3c3d with identifier: GY73641
2026-03-28 14:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a43a1d82-09fc-5a31-996c-f140cf9b3c3d with scrape type 2
2026-03-28 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a43a1d82-09fc-5a31-996c-f140cf9b3c3d with scrape type 2
2026-03-28 14:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a43a1d82-09fc-5a31-996c-f140cf9b3c3d, identifier: GY73641
2026-03-28 14:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e50a90be-dc51-5e36-9bd1-a2b4e911cb1a with identifier: TP19820
2026-03-28 14:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e50a90be-dc51-5e36-9bd1-a2b4e911cb1a with identifier: TP19820
2026-03-28 14:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e50a90be-dc51-5e36-9bd1-a2b4e911cb1a with identifier: TP19820 to the API
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:06:44Z',
 'fuel_type': 'diesel',
 'id': 'e50a90be-dc51-5e36-9bd1-a2b4e911cb1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP19820',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 76060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP19820%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [auto1.es] INFO: Saving data for TP19820: {'auction_closing_time': 1774714004.0, 'created_time': 1773691490.307794, 'last_price_update_time': 1774706658.648726}
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TP19820') HTTP/1.1" 204 0
2026-03-28 14:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a43a1d82-09fc-5a31-996c-f140cf9b3c3d with identifier: GY73641
2026-03-28 14:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a43a1d82-09fc-5a31-996c-f140cf9b3c3d with identifier: GY73641
2026-03-28 14:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a43a1d82-09fc-5a31-996c-f140cf9b3c3d with identifier: GY73641 to the API
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:49:03Z',
 'fuel_type': 'petrol',
 'id': 'a43a1d82-09fc-5a31-996c-f140cf9b3c3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY73641',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 29517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-16',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2023}
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY73641%27 HTTP/1.1" 200 None
2026-03-28 14:04:18 [auto1.es] INFO: Saving data for GY73641: {'auction_closing_time': 1774716543.0, 'created_time': 1773130879.743383, 'last_price_update_time': 1774706658.9785}
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GY73641') HTTP/1.1" 204 0
2026-03-28 14:04:18 [auto1.es] INFO: Found listing with ID: UP13396
2026-03-28 14:04:18 [auto1.es] INFO: Found listing with ID: HF43157
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF43157%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [auto1.es] INFO: Scrape type for HF43157: 2
2026-03-28 14:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25c1b16f-dd3b-52ab-80bd-99c9e32107ef with identifier: HF43157
2026-03-28 14:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25c1b16f-dd3b-52ab-80bd-99c9e32107ef with scrape type 2
2026-03-28 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25c1b16f-dd3b-52ab-80bd-99c9e32107ef with scrape type 2
2026-03-28 14:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 25c1b16f-dd3b-52ab-80bd-99c9e32107ef, identifier: HF43157
2026-03-28 14:04:19 [auto1.es] INFO: Found listing with ID: LB26536
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB26536%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [auto1.es] INFO: Scrape type for LB26536: 2
2026-03-28 14:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4b52fc6-fe84-5783-b703-085410364ad6 with identifier: LB26536
2026-03-28 14:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4b52fc6-fe84-5783-b703-085410364ad6 with scrape type 2
2026-03-28 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4b52fc6-fe84-5783-b703-085410364ad6 with scrape type 2
2026-03-28 14:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a4b52fc6-fe84-5783-b703-085410364ad6, identifier: LB26536
2026-03-28 14:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 25c1b16f-dd3b-52ab-80bd-99c9e32107ef with identifier: HF43157
2026-03-28 14:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 25c1b16f-dd3b-52ab-80bd-99c9e32107ef with identifier: HF43157
2026-03-28 14:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 25c1b16f-dd3b-52ab-80bd-99c9e32107ef with identifier: HF43157 to the API
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:02:32Z',
 'fuel_type': 'petrol',
 'id': '25c1b16f-dd3b-52ab-80bd-99c9e32107ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF43157',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 67857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF43157%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [auto1.es] INFO: Saving data for HF43157: {'auction_closing_time': 1774713752.0, 'created_time': 1773130930.328798, 'last_price_update_time': 1774706659.518957}
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HF43157') HTTP/1.1" 204 0
2026-03-28 14:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a4b52fc6-fe84-5783-b703-085410364ad6 with identifier: LB26536
2026-03-28 14:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a4b52fc6-fe84-5783-b703-085410364ad6 with identifier: LB26536
2026-03-28 14:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a4b52fc6-fe84-5783-b703-085410364ad6 with identifier: LB26536 to the API
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:21Z',
 'fuel_type': 'petrol',
 'id': 'a4b52fc6-fe84-5783-b703-085410364ad6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB26536',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 180897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-13',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2003}
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB26536%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [auto1.es] INFO: Saving data for LB26536: {'auction_closing_time': 1774714761.0, 'created_time': 1774620148.959277, 'last_price_update_time': 1774706659.826274}
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LB26536') HTTP/1.1" 204 0
2026-03-28 14:04:19 [auto1.es] INFO: Found listing with ID: RD87944
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD87944%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [auto1.es] INFO: Scrape type for RD87944: 2
2026-03-28 14:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019 with identifier: RD87944
2026-03-28 14:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019 with scrape type 2
2026-03-28 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019 with scrape type 2
2026-03-28 14:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019, identifier: RD87944
2026-03-28 14:04:19 [auto1.es] INFO: Found listing with ID: FE19310
2026-03-28 14:04:19 [auto1.es] INFO: Found listing with ID: XB79448
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB79448%27 HTTP/1.1" 200 None
2026-03-28 14:04:19 [auto1.es] INFO: Scrape type for XB79448: 2
2026-03-28 14:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77229b04-dc69-5edd-ad24-3bf36b8e2552 with identifier: XB79448
2026-03-28 14:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77229b04-dc69-5edd-ad24-3bf36b8e2552 with scrape type 2
2026-03-28 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77229b04-dc69-5edd-ad24-3bf36b8e2552 with scrape type 2
2026-03-28 14:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 77229b04-dc69-5edd-ad24-3bf36b8e2552, identifier: XB79448
2026-03-28 14:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019 with identifier: RD87944
2026-03-28 14:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019 with identifier: RD87944
2026-03-28 14:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1fcd97d9-b2f1-5748-9e6b-4a3b890e7019 with identifier: RD87944 to the API
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:17:08Z',
 'fuel_type': 'hybrid',
 'id': '1fcd97d9-b2f1-5748-9e6b-4a3b890e7019',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD87944',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 30129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-03',
 'seller_name': None,
 'title': 'Citroen C5 X 1.6 Plug-in Hybrid Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2022}
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD87944%27 HTTP/1.1" 200 None
2026-03-28 14:04:20 [auto1.es] INFO: Saving data for RD87944: {'auction_closing_time': 1774714628.0, 'created_time': 1773130927.242682, 'last_price_update_time': 1774706660.335353}
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD87944') HTTP/1.1" 204 0
2026-03-28 14:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 77229b04-dc69-5edd-ad24-3bf36b8e2552 with identifier: XB79448
2026-03-28 14:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 77229b04-dc69-5edd-ad24-3bf36b8e2552 with identifier: XB79448
2026-03-28 14:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 77229b04-dc69-5edd-ad24-3bf36b8e2552 with identifier: XB79448 to the API
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:54:13Z',
 'fuel_type': 'petrol',
 'id': '77229b04-dc69-5edd-ad24-3bf36b8e2552',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB79448',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 34841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-14',
 'seller_name': None,
 'title': 'Citroen C5 X 1.2 PureTech Feel Pack',
 'transmission': 'automatic',
 'trim': 'Feel Pack',
 'year': 2023}
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB79448%27 HTTP/1.1" 200 None
2026-03-28 14:04:20 [auto1.es] INFO: Saving data for XB79448: {'auction_closing_time': 1774716853.0, 'created_time': 1773131037.202544, 'last_price_update_time': 1774706660.625066}
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XB79448') HTTP/1.1" 204 0
2026-03-28 14:04:20 [auto1.es] INFO: Found listing with ID: CV42273
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV42273%27 HTTP/1.1" 200 None
2026-03-28 14:04:20 [auto1.es] INFO: Scrape type for CV42273: 2
2026-03-28 14:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e0e5613-6246-5e7d-866c-39148385221d with identifier: CV42273
2026-03-28 14:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e0e5613-6246-5e7d-866c-39148385221d with scrape type 2
2026-03-28 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e0e5613-6246-5e7d-866c-39148385221d with scrape type 2
2026-03-28 14:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6e0e5613-6246-5e7d-866c-39148385221d, identifier: CV42273
2026-03-28 14:04:20 [auto1.es] INFO: Found listing with ID: ME14626
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME14626%27 HTTP/1.1" 200 None
2026-03-28 14:04:20 [auto1.es] INFO: Scrape type for ME14626: 2
2026-03-28 14:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ff67fdc-93bd-5f7d-9024-00b0c6c567da with identifier: ME14626
2026-03-28 14:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ff67fdc-93bd-5f7d-9024-00b0c6c567da with scrape type 2
2026-03-28 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ff67fdc-93bd-5f7d-9024-00b0c6c567da with scrape type 2
2026-03-28 14:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ff67fdc-93bd-5f7d-9024-00b0c6c567da, identifier: ME14626
2026-03-28 14:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6e0e5613-6246-5e7d-866c-39148385221d with identifier: CV42273
2026-03-28 14:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6e0e5613-6246-5e7d-866c-39148385221d with identifier: CV42273
2026-03-28 14:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6e0e5613-6246-5e7d-866c-39148385221d with identifier: CV42273 to the API
2026-03-28 14:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:48:31Z',
 'fuel_type': 'diesel',
 'id': '6e0e5613-6246-5e7d-866c-39148385221d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV42273',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 22758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-12',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV42273%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [auto1.es] INFO: Saving data for CV42273: {'auction_closing_time': 1774716511.0, 'created_time': 1774620163.094728, 'last_price_update_time': 1774706661.138549}
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CV42273') HTTP/1.1" 204 0
2026-03-28 14:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ff67fdc-93bd-5f7d-9024-00b0c6c567da with identifier: ME14626
2026-03-28 14:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ff67fdc-93bd-5f7d-9024-00b0c6c567da with identifier: ME14626
2026-03-28 14:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3ff67fdc-93bd-5f7d-9024-00b0c6c567da with identifier: ME14626 to the API
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-28T16:19:59Z',
 'fuel_type': 'petrol',
 'id': '3ff67fdc-93bd-5f7d-9024-00b0c6c567da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME14626',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 31071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-21',
 'seller_name': None,
 'title': 'Citroen C5 X 1.6 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2022}
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME14626%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [auto1.es] INFO: Saving data for ME14626: {'auction_closing_time': 1774714799.0, 'created_time': 1773131657.215589, 'last_price_update_time': 1774706661.442928}
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ME14626') HTTP/1.1" 204 0
2026-03-28 14:04:21 [auto1.es] INFO: Found listing with ID: LV56361
2026-03-28 14:04:21 [auto1.es] INFO: Found listing with ID: TW64158
2026-03-28 14:04:21 [auto1.es] INFO: Found listing with ID: KU36165
2026-03-28 14:04:21 [auto1.es] INFO: Found listing with ID: FG19732
2026-03-28 14:04:21 [auto1.es] INFO: Found listing with ID: BP57031
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP57031%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [auto1.es] INFO: Scrape type for BP57031: 2
2026-03-28 14:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7a01c8d-a7a3-512b-9f7e-612a0231dca2 with identifier: BP57031
2026-03-28 14:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7a01c8d-a7a3-512b-9f7e-612a0231dca2 with scrape type 2
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7a01c8d-a7a3-512b-9f7e-612a0231dca2 with scrape type 2
2026-03-28 14:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7a01c8d-a7a3-512b-9f7e-612a0231dca2, identifier: BP57031
2026-03-28 14:04:21 [auto1.es] INFO: Found listing with ID: HS01643
2026-03-28 14:04:21 [auto1.es] INFO: Found listing with ID: CF60022
2026-03-28 14:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7a01c8d-a7a3-512b-9f7e-612a0231dca2 with identifier: BP57031
2026-03-28 14:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7a01c8d-a7a3-512b-9f7e-612a0231dca2 with identifier: BP57031
2026-03-28 14:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e7a01c8d-a7a3-512b-9f7e-612a0231dca2 with identifier: BP57031 to the API
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:53:07Z',
 'fuel_type': 'diesel',
 'id': 'e7a01c8d-a7a3-512b-9f7e-612a0231dca2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP57031',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 138642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP57031%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [auto1.es] INFO: Saving data for BP57031: {'auction_closing_time': 1774716787.0, 'created_time': 1773691476.808425, 'last_price_update_time': 1774706661.847975}
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BP57031') HTTP/1.1" 204 0
2026-03-28 14:04:21 [auto1.es] INFO: Found listing with ID: RY21508
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY21508%27 HTTP/1.1" 200 None
2026-03-28 14:04:21 [auto1.es] INFO: Scrape type for RY21508: 2
2026-03-28 14:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f857f94b-70fc-5c9a-8dae-cc4ee243c00e with identifier: RY21508
2026-03-28 14:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f857f94b-70fc-5c9a-8dae-cc4ee243c00e with scrape type 2
2026-03-28 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f857f94b-70fc-5c9a-8dae-cc4ee243c00e with scrape type 2
2026-03-28 14:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f857f94b-70fc-5c9a-8dae-cc4ee243c00e, identifier: RY21508
2026-03-28 14:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f857f94b-70fc-5c9a-8dae-cc4ee243c00e with identifier: RY21508
2026-03-28 14:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f857f94b-70fc-5c9a-8dae-cc4ee243c00e with identifier: RY21508
2026-03-28 14:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f857f94b-70fc-5c9a-8dae-cc4ee243c00e with identifier: RY21508 to the API
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:47:17Z',
 'fuel_type': 'diesel',
 'id': 'f857f94b-70fc-5c9a-8dae-cc4ee243c00e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY21508',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 147533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2019}
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY21508%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [auto1.es] INFO: Saving data for RY21508: {'auction_closing_time': 1774716437.0, 'created_time': 1773131231.261462, 'last_price_update_time': 1774706662.360387}
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RY21508') HTTP/1.1" 204 0
2026-03-28 14:04:22 [auto1.es] INFO: Found listing with ID: FV98550
2026-03-28 14:04:22 [auto1.es] INFO: Found listing with ID: NN72545
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN72545%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [auto1.es] INFO: Scrape type for NN72545: 2
2026-03-28 14:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a8c96dd-119e-581e-a6dc-a7529cad50bc with identifier: NN72545
2026-03-28 14:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a8c96dd-119e-581e-a6dc-a7529cad50bc with scrape type 2
2026-03-28 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a8c96dd-119e-581e-a6dc-a7529cad50bc with scrape type 2
2026-03-28 14:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a8c96dd-119e-581e-a6dc-a7529cad50bc, identifier: NN72545
2026-03-28 14:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a8c96dd-119e-581e-a6dc-a7529cad50bc with identifier: NN72545
2026-03-28 14:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a8c96dd-119e-581e-a6dc-a7529cad50bc with identifier: NN72545
2026-03-28 14:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5a8c96dd-119e-581e-a6dc-a7529cad50bc with identifier: NN72545 to the API
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:27Z',
 'fuel_type': 'diesel',
 'id': '5a8c96dd-119e-581e-a6dc-a7529cad50bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN72545',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 171222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-30',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2016}
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN72545%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [auto1.es] INFO: Saving data for NN72545: {'auction_closing_time': 1774715067.0, 'created_time': 1774620162.355797, 'last_price_update_time': 1774706662.740831}
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NN72545') HTTP/1.1" 204 0
2026-03-28 14:04:22 [auto1.es] INFO: Found listing with ID: PX05110
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX05110%27 HTTP/1.1" 200 None
2026-03-28 14:04:22 [auto1.es] INFO: Scrape type for PX05110: 2
2026-03-28 14:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd10ddb2-5b45-5b55-9fff-3741d70f0c9f with identifier: PX05110
2026-03-28 14:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd10ddb2-5b45-5b55-9fff-3741d70f0c9f with scrape type 2
2026-03-28 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd10ddb2-5b45-5b55-9fff-3741d70f0c9f with scrape type 2
2026-03-28 14:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bd10ddb2-5b45-5b55-9fff-3741d70f0c9f, identifier: PX05110
2026-03-28 14:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bd10ddb2-5b45-5b55-9fff-3741d70f0c9f with identifier: PX05110
2026-03-28 14:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bd10ddb2-5b45-5b55-9fff-3741d70f0c9f with identifier: PX05110
2026-03-28 14:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bd10ddb2-5b45-5b55-9fff-3741d70f0c9f with identifier: PX05110 to the API
2026-03-28 14:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:23:55Z',
 'fuel_type': 'diesel',
 'id': 'bd10ddb2-5b45-5b55-9fff-3741d70f0c9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX05110',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 85001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-26',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Shine M',
 'transmission': 'manual',
 'trim': 'Shine M',
 'year': 2020}
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX05110%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [auto1.es] INFO: Saving data for PX05110: {'auction_closing_time': 1774715035.0, 'created_time': 1773131102.260455, 'last_price_update_time': 1774706663.268129}
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PX05110') HTTP/1.1" 204 0
2026-03-28 14:04:23 [auto1.es] INFO: Found listing with ID: VK69645
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK69645%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [auto1.es] INFO: Scrape type for VK69645: 2
2026-03-28 14:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd6143ee-faf0-50d6-8c68-297e26384a8a with identifier: VK69645
2026-03-28 14:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd6143ee-faf0-50d6-8c68-297e26384a8a with scrape type 2
2026-03-28 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd6143ee-faf0-50d6-8c68-297e26384a8a with scrape type 2
2026-03-28 14:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fd6143ee-faf0-50d6-8c68-297e26384a8a, identifier: VK69645
2026-03-28 14:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fd6143ee-faf0-50d6-8c68-297e26384a8a with identifier: VK69645
2026-03-28 14:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fd6143ee-faf0-50d6-8c68-297e26384a8a with identifier: VK69645
2026-03-28 14:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fd6143ee-faf0-50d6-8c68-297e26384a8a with identifier: VK69645 to the API
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:07:11Z',
 'fuel_type': 'diesel',
 'id': 'fd6143ee-faf0-50d6-8c68-297e26384a8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK69645',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 15160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-18',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2024}
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK69645%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [auto1.es] INFO: Saving data for VK69645: {'auction_closing_time': 1774714031.0, 'created_time': 1773130915.042136, 'last_price_update_time': 1774706663.853314}
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VK69645') HTTP/1.1" 204 0
2026-03-28 14:04:23 [auto1.es] INFO: Found listing with ID: MV52589
2026-03-28 14:04:23 [auto1.es] INFO: Found listing with ID: YT36266
2026-03-28 14:04:23 [auto1.es] INFO: Found listing with ID: BM28897
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM28897%27 HTTP/1.1" 200 None
2026-03-28 14:04:23 [auto1.es] INFO: Scrape type for BM28897: 2
2026-03-28 14:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ce97825-2baf-5c8a-b981-fe4f9f383d8b with identifier: BM28897
2026-03-28 14:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ce97825-2baf-5c8a-b981-fe4f9f383d8b with scrape type 2
2026-03-28 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ce97825-2baf-5c8a-b981-fe4f9f383d8b with scrape type 2
2026-03-28 14:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0ce97825-2baf-5c8a-b981-fe4f9f383d8b, identifier: BM28897
2026-03-28 14:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0ce97825-2baf-5c8a-b981-fe4f9f383d8b with identifier: BM28897
2026-03-28 14:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0ce97825-2baf-5c8a-b981-fe4f9f383d8b with identifier: BM28897
2026-03-28 14:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0ce97825-2baf-5c8a-b981-fe4f9f383d8b with identifier: BM28897 to the API
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:08:17Z',
 'fuel_type': 'petrol',
 'id': '0ce97825-2baf-5c8a-b981-fe4f9f383d8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM28897',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 179838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-30',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2008}
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM28897%27 HTTP/1.1" 200 None
2026-03-28 14:04:24 [auto1.es] INFO: Saving data for BM28897: {'auction_closing_time': 1774714097.0, 'created_time': 1774620160.961434, 'last_price_update_time': 1774706664.281021}
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BM28897') HTTP/1.1" 204 0
2026-03-28 14:04:24 [auto1.es] INFO: Channel: 24h | Page: 55 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:24 [auto1.es] INFO: Found listing with ID: YJ05760
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ05760%27 HTTP/1.1" 200 None
2026-03-28 14:04:24 [auto1.es] INFO: Scrape type for YJ05760: 2
2026-03-28 14:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c29e2a4f-fe6a-54d0-80f4-1b8337ad7346 with identifier: YJ05760
2026-03-28 14:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c29e2a4f-fe6a-54d0-80f4-1b8337ad7346 with scrape type 2
2026-03-28 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c29e2a4f-fe6a-54d0-80f4-1b8337ad7346 with scrape type 2
2026-03-28 14:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c29e2a4f-fe6a-54d0-80f4-1b8337ad7346, identifier: YJ05760
2026-03-28 14:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c29e2a4f-fe6a-54d0-80f4-1b8337ad7346 with identifier: YJ05760
2026-03-28 14:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c29e2a4f-fe6a-54d0-80f4-1b8337ad7346 with identifier: YJ05760
2026-03-28 14:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c29e2a4f-fe6a-54d0-80f4-1b8337ad7346 with identifier: YJ05760 to the API
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:11:08Z',
 'fuel_type': 'hybrid',
 'id': 'c29e2a4f-fe6a-54d0-80f4-1b8337ad7346',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ05760',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7',
 'odometer': 35911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-01',
 'seller_name': None,
 'title': 'DS Automobiles DS7 1.6 E-Tense Hybrid 4x2 Rivoli',
 'transmission': 'automatic',
 'trim': '4x2 Rivoli',
 'year': 2023}
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ05760%27 HTTP/1.1" 200 None
2026-03-28 14:04:24 [auto1.es] INFO: Saving data for YJ05760: {'auction_closing_time': 1774714268.0, 'created_time': 1773131761.754467, 'last_price_update_time': 1774706664.961244}
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ05760') HTTP/1.1" 204 0
2026-03-28 14:04:24 [auto1.es] INFO: Found listing with ID: ES80363
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES80363%27 HTTP/1.1" 200 None
2026-03-28 14:04:24 [auto1.es] INFO: Scrape type for ES80363: 2
2026-03-28 14:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3b6d013-a1e9-5dd4-b45a-e2f069507533 with identifier: ES80363
2026-03-28 14:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3b6d013-a1e9-5dd4-b45a-e2f069507533 with scrape type 2
2026-03-28 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3b6d013-a1e9-5dd4-b45a-e2f069507533 with scrape type 2
2026-03-28 14:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b3b6d013-a1e9-5dd4-b45a-e2f069507533, identifier: ES80363
2026-03-28 14:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:25 [auto1.es] INFO: Found listing with ID: PH65326
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH65326%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [auto1.es] INFO: Scrape type for PH65326: 2
2026-03-28 14:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 101b02fa-934e-5f6e-a412-ae5f79af4b8b with identifier: PH65326
2026-03-28 14:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 101b02fa-934e-5f6e-a412-ae5f79af4b8b with scrape type 2
2026-03-28 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 101b02fa-934e-5f6e-a412-ae5f79af4b8b with scrape type 2
2026-03-28 14:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 101b02fa-934e-5f6e-a412-ae5f79af4b8b, identifier: PH65326
2026-03-28 14:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b3b6d013-a1e9-5dd4-b45a-e2f069507533 with identifier: ES80363
2026-03-28 14:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b3b6d013-a1e9-5dd4-b45a-e2f069507533 with identifier: ES80363
2026-03-28 14:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b3b6d013-a1e9-5dd4-b45a-e2f069507533 with identifier: ES80363 to the API
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:01:52Z',
 'fuel_type': 'diesel',
 'id': 'b3b6d013-a1e9-5dd4-b45a-e2f069507533',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES80363',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 163668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES80363%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [auto1.es] INFO: Saving data for ES80363: {'auction_closing_time': 1774713712.0, 'created_time': 1773691480.820723, 'last_price_update_time': 1774706665.490146}
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ES80363') HTTP/1.1" 204 0
2026-03-28 14:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 101b02fa-934e-5f6e-a412-ae5f79af4b8b with identifier: PH65326
2026-03-28 14:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 101b02fa-934e-5f6e-a412-ae5f79af4b8b with identifier: PH65326
2026-03-28 14:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 101b02fa-934e-5f6e-a412-ae5f79af4b8b with identifier: PH65326 to the API
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 404,
 'expiration_date': '2026-03-28T16:21:21Z',
 'fuel_type': 'hybrid',
 'id': '101b02fa-934e-5f6e-a412-ae5f79af4b8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH65326',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 113167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-08',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar P400e Plug-in Hybrid R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2022}
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH65326%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [auto1.es] INFO: Saving data for PH65326: {'auction_closing_time': 1774714881.0, 'created_time': 1773126731.284539, 'last_price_update_time': 1774706665.878811}
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PH65326') HTTP/1.1" 204 0
2026-03-28 14:04:25 [auto1.es] INFO: Found listing with ID: NA66808
2026-03-28 14:04:25 [auto1.es] INFO: Found listing with ID: GH55887
2026-03-28 14:04:25 [auto1.es] INFO: Found listing with ID: LL24572
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL24572%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [auto1.es] INFO: Scrape type for LL24572: 0
2026-03-28 14:04:25 [auto1.es] INFO: Found listing with ID: WA42706
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA42706%27 HTTP/1.1" 200 None
2026-03-28 14:04:25 [auto1.es] INFO: Scrape type for WA42706: 2
2026-03-28 14:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40e19e62-450f-5eb2-837e-18d28272f1f4 with identifier: WA42706
2026-03-28 14:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40e19e62-450f-5eb2-837e-18d28272f1f4 with scrape type 2
2026-03-28 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40e19e62-450f-5eb2-837e-18d28272f1f4 with scrape type 2
2026-03-28 14:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 40e19e62-450f-5eb2-837e-18d28272f1f4, identifier: WA42706
2026-03-28 14:04:26 [auto1.es] INFO: Found listing with ID: ED82323
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED82323%27 HTTP/1.1" 200 None
2026-03-28 14:04:26 [auto1.es] INFO: Scrape type for ED82323: 2
2026-03-28 14:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8e67b3b-fea2-5a5e-9050-0508a75b4e0c with identifier: ED82323
2026-03-28 14:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8e67b3b-fea2-5a5e-9050-0508a75b4e0c with scrape type 2
2026-03-28 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8e67b3b-fea2-5a5e-9050-0508a75b4e0c with scrape type 2
2026-03-28 14:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e8e67b3b-fea2-5a5e-9050-0508a75b4e0c, identifier: ED82323
2026-03-28 14:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 40e19e62-450f-5eb2-837e-18d28272f1f4 with identifier: WA42706
2026-03-28 14:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 40e19e62-450f-5eb2-837e-18d28272f1f4 with identifier: WA42706
2026-03-28 14:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 40e19e62-450f-5eb2-837e-18d28272f1f4 with identifier: WA42706 to the API
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:21:32Z',
 'fuel_type': 'diesel',
 'id': '40e19e62-450f-5eb2-837e-18d28272f1f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA42706',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 144183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-18',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2017}
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA42706%27 HTTP/1.1" 200 None
2026-03-28 14:04:26 [auto1.es] INFO: Saving data for WA42706: {'auction_closing_time': 1774714892.0, 'created_time': 1773131103.327179, 'last_price_update_time': 1774706666.433062}
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WA42706') HTTP/1.1" 204 0
2026-03-28 14:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e8e67b3b-fea2-5a5e-9050-0508a75b4e0c with identifier: ED82323
2026-03-28 14:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e8e67b3b-fea2-5a5e-9050-0508a75b4e0c with identifier: ED82323
2026-03-28 14:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e8e67b3b-fea2-5a5e-9050-0508a75b4e0c with identifier: ED82323 to the API
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:26:51Z',
 'fuel_type': 'petrol',
 'id': 'e8e67b3b-fea2-5a5e-9050-0508a75b4e0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED82323',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 216700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2009}
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED82323%27 HTTP/1.1" 200 None
2026-03-28 14:04:26 [auto1.es] INFO: Saving data for ED82323: {'auction_closing_time': 1774715211.0, 'created_time': 1773227013.893786, 'last_price_update_time': 1774706666.745566}
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ED82323') HTTP/1.1" 204 0
2026-03-28 14:04:26 [auto1.es] INFO: Found listing with ID: UJ02953
2026-03-28 14:04:26 [auto1.es] INFO: Found listing with ID: ZZ48834
2026-03-28 14:04:26 [auto1.es] INFO: Found listing with ID: VJ40506
2026-03-28 14:04:26 [auto1.es] INFO: Found listing with ID: RN82930
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN82930%27 HTTP/1.1" 200 None
2026-03-28 14:04:26 [auto1.es] INFO: Scrape type for RN82930: 2
2026-03-28 14:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb796ab0-597b-5f50-a45f-65a4100e18e5 with identifier: RN82930
2026-03-28 14:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb796ab0-597b-5f50-a45f-65a4100e18e5 with scrape type 2
2026-03-28 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb796ab0-597b-5f50-a45f-65a4100e18e5 with scrape type 2
2026-03-28 14:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eb796ab0-597b-5f50-a45f-65a4100e18e5, identifier: RN82930
2026-03-28 14:04:26 [auto1.es] INFO: Found listing with ID: YF71759
2026-03-28 14:04:26 [auto1.es] INFO: Found listing with ID: HJ36466
2026-03-28 14:04:26 [auto1.es] INFO: Found listing with ID: AC34566
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC34566%27 HTTP/1.1" 200 None
2026-03-28 14:04:26 [auto1.es] INFO: Scrape type for AC34566: 2
2026-03-28 14:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3c40649-b882-5e0a-b86e-584481154cfe with identifier: AC34566
2026-03-28 14:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c40649-b882-5e0a-b86e-584481154cfe with scrape type 2
2026-03-28 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3c40649-b882-5e0a-b86e-584481154cfe with scrape type 2
2026-03-28 14:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e3c40649-b882-5e0a-b86e-584481154cfe, identifier: AC34566
2026-03-28 14:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eb796ab0-597b-5f50-a45f-65a4100e18e5 with identifier: RN82930
2026-03-28 14:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eb796ab0-597b-5f50-a45f-65a4100e18e5 with identifier: RN82930
2026-03-28 14:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eb796ab0-597b-5f50-a45f-65a4100e18e5 with identifier: RN82930 to the API
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:03:37Z',
 'fuel_type': 'diesel',
 'id': 'eb796ab0-597b-5f50-a45f-65a4100e18e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN82930',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 400681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-30',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2011}
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN82930%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [auto1.es] INFO: Saving data for RN82930: {'auction_closing_time': 1774713817.0, 'created_time': 1774001892.374734, 'last_price_update_time': 1774706667.261242}
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RN82930') HTTP/1.1" 204 0
2026-03-28 14:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e3c40649-b882-5e0a-b86e-584481154cfe with identifier: AC34566
2026-03-28 14:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e3c40649-b882-5e0a-b86e-584481154cfe with identifier: AC34566
2026-03-28 14:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e3c40649-b882-5e0a-b86e-584481154cfe with identifier: AC34566 to the API
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:35:42Z',
 'fuel_type': 'diesel',
 'id': 'e3c40649-b882-5e0a-b86e-584481154cfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC34566',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 30264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-18',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 114 CDI kompakt',
 'transmission': 'automatic',
 'trim': 'kompakt',
 'year': 2021}
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC34566%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [auto1.es] INFO: Saving data for AC34566: {'auction_closing_time': 1774715742.0, 'created_time': 1773131094.931149, 'last_price_update_time': 1774706667.672419}
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AC34566') HTTP/1.1" 204 0
2026-03-28 14:04:27 [auto1.es] INFO: Found listing with ID: GZ65389
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ65389%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [auto1.es] INFO: Scrape type for GZ65389: 2
2026-03-28 14:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59f2c82f-7de3-5461-b402-d8d9b21430f1 with identifier: GZ65389
2026-03-28 14:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59f2c82f-7de3-5461-b402-d8d9b21430f1 with scrape type 2
2026-03-28 14:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59f2c82f-7de3-5461-b402-d8d9b21430f1 with scrape type 2
2026-03-28 14:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 59f2c82f-7de3-5461-b402-d8d9b21430f1, identifier: GZ65389
2026-03-28 14:04:27 [auto1.es] INFO: Found listing with ID: SV63508
2026-03-28 14:04:27 [auto1.es] INFO: Found listing with ID: XR63585
2026-03-28 14:04:27 [auto1.es] INFO: Found listing with ID: FM92662
2026-03-28 14:04:27 [auto1.es] INFO: Found listing with ID: LG55317
2026-03-28 14:04:27 [auto1.es] INFO: Found listing with ID: DY55894
2026-03-28 14:04:27 [auto1.es] INFO: Found listing with ID: LN78930
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN78930%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [auto1.es] INFO: Scrape type for LN78930: 0
2026-03-28 14:04:27 [auto1.es] INFO: Found listing with ID: EZ26896
2026-03-28 14:04:27 [auto1.es] INFO: Found listing with ID: WA45592
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA45592%27 HTTP/1.1" 200 None
2026-03-28 14:04:27 [auto1.es] INFO: Scrape type for WA45592: 2
2026-03-28 14:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d48601f8-5104-5708-889d-5a73c1219443 with identifier: WA45592
2026-03-28 14:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d48601f8-5104-5708-889d-5a73c1219443 with scrape type 2
2026-03-28 14:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d48601f8-5104-5708-889d-5a73c1219443 with scrape type 2
2026-03-28 14:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d48601f8-5104-5708-889d-5a73c1219443, identifier: WA45592
2026-03-28 14:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 59f2c82f-7de3-5461-b402-d8d9b21430f1 with identifier: GZ65389
2026-03-28 14:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 59f2c82f-7de3-5461-b402-d8d9b21430f1 with identifier: GZ65389
2026-03-28 14:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 59f2c82f-7de3-5461-b402-d8d9b21430f1 with identifier: GZ65389 to the API
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:54:13Z',
 'fuel_type': 'diesel',
 'id': '59f2c82f-7de3-5461-b402-d8d9b21430f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ65389',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 176530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 Blue-HDi 335 L2H2 Premium Stop&Start',
 'transmission': 'manual',
 'trim': '335 L2H2 Premium Stop&Start',
 'year': 2020}
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ65389%27 HTTP/1.1" 200 None
2026-03-28 14:04:28 [auto1.es] INFO: Saving data for GZ65389: {'auction_closing_time': 1774716853.0, 'created_time': 1774620174.339111, 'last_price_update_time': 1774706668.220099}
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GZ65389') HTTP/1.1" 204 0
2026-03-28 14:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d48601f8-5104-5708-889d-5a73c1219443 with identifier: WA45592
2026-03-28 14:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d48601f8-5104-5708-889d-5a73c1219443 with identifier: WA45592
2026-03-28 14:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d48601f8-5104-5708-889d-5a73c1219443 with identifier: WA45592 to the API
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:42:06Z',
 'fuel_type': 'petrol',
 'id': 'd48601f8-5104-5708-889d-5a73c1219443',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA45592',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Magentis',
 'odometer': 88189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-24',
 'seller_name': None,
 'title': 'Kia Magentis 2.0 GLS',
 'transmission': 'manual',
 'trim': 'GLS',
 'year': 2002}
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA45592%27 HTTP/1.1" 200 None
2026-03-28 14:04:28 [auto1.es] INFO: Saving data for WA45592: {'auction_closing_time': 1774716126.0, 'created_time': 1774620169.835354, 'last_price_update_time': 1774706668.532946}
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WA45592') HTTP/1.1" 204 0
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: WU84058
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: ZN70323
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: JD05776
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: ZT28887
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: KF15980
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: XH14423
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: BK45760
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK45760%27 HTTP/1.1" 200 None
2026-03-28 14:04:28 [auto1.es] INFO: Scrape type for BK45760: 2
2026-03-28 14:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ca15faf-27f6-57e8-92a1-9a5639207f40 with identifier: BK45760
2026-03-28 14:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ca15faf-27f6-57e8-92a1-9a5639207f40 with scrape type 2
2026-03-28 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ca15faf-27f6-57e8-92a1-9a5639207f40 with scrape type 2
2026-03-28 14:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ca15faf-27f6-57e8-92a1-9a5639207f40, identifier: BK45760
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: BG56736
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: KH43607
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: EE39278
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: XZ84742
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: BK86158
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: BU12450
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: UB63669
2026-03-28 14:04:28 [auto1.es] INFO: Found listing with ID: NP13134
2026-03-28 14:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ca15faf-27f6-57e8-92a1-9a5639207f40 with identifier: BK45760
2026-03-28 14:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ca15faf-27f6-57e8-92a1-9a5639207f40 with identifier: BK45760
2026-03-28 14:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ca15faf-27f6-57e8-92a1-9a5639207f40 with identifier: BK45760 to the API
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:35:48Z',
 'fuel_type': 'diesel',
 'id': '1ca15faf-27f6-57e8-92a1-9a5639207f40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK45760',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 225563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-22',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK45760%27 HTTP/1.1" 200 None
2026-03-28 14:04:28 [auto1.es] INFO: Saving data for BK45760: {'auction_closing_time': 1774715748.0, 'created_time': 1774620172.986631, 'last_price_update_time': 1774706668.949318}
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BK45760') HTTP/1.1" 204 0
2026-03-28 14:04:29 [auto1.es] INFO: Found listing with ID: BM13295
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM13295%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [auto1.es] INFO: Scrape type for BM13295: 2
2026-03-28 14:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 198e5ef7-7116-50c4-b2f4-75e53b328aeb with identifier: BM13295
2026-03-28 14:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 198e5ef7-7116-50c4-b2f4-75e53b328aeb with scrape type 2
2026-03-28 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 198e5ef7-7116-50c4-b2f4-75e53b328aeb with scrape type 2
2026-03-28 14:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 198e5ef7-7116-50c4-b2f4-75e53b328aeb, identifier: BM13295
2026-03-28 14:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 198e5ef7-7116-50c4-b2f4-75e53b328aeb with identifier: BM13295
2026-03-28 14:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 198e5ef7-7116-50c4-b2f4-75e53b328aeb with identifier: BM13295
2026-03-28 14:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 198e5ef7-7116-50c4-b2f4-75e53b328aeb with identifier: BM13295 to the API
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-28T16:50:19Z',
 'fuel_type': 'petrol',
 'id': '198e5ef7-7116-50c4-b2f4-75e53b328aeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM13295',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 12999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-22',
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Techno',
 'transmission': 'manual',
 'trim': 'Techno',
 'year': 2023}
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM13295%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [auto1.es] INFO: Saving data for BM13295: {'auction_closing_time': 1774716619.0, 'created_time': 1773777869.280507, 'last_price_update_time': 1774706669.461933}
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BM13295') HTTP/1.1" 204 0
2026-03-28 14:04:29 [auto1.es] INFO: Found listing with ID: TR57503
2026-03-28 14:04:29 [auto1.es] INFO: Found listing with ID: XW97577
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW97577%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [auto1.es] INFO: Scrape type for XW97577: 2
2026-03-28 14:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b90ae97-55a7-5447-98ec-1442e2ab4d48 with identifier: XW97577
2026-03-28 14:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b90ae97-55a7-5447-98ec-1442e2ab4d48 with scrape type 2
2026-03-28 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b90ae97-55a7-5447-98ec-1442e2ab4d48 with scrape type 2
2026-03-28 14:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b90ae97-55a7-5447-98ec-1442e2ab4d48, identifier: XW97577
2026-03-28 14:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b90ae97-55a7-5447-98ec-1442e2ab4d48 with identifier: XW97577
2026-03-28 14:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b90ae97-55a7-5447-98ec-1442e2ab4d48 with identifier: XW97577
2026-03-28 14:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b90ae97-55a7-5447-98ec-1442e2ab4d48 with identifier: XW97577 to the API
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:00:33Z',
 'fuel_type': 'petrol',
 'id': '6b90ae97-55a7-5447-98ec-1442e2ab4d48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW97577',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 57719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-18',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B3 Mild-Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2023}
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW97577%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [auto1.es] INFO: Saving data for XW97577: {'auction_closing_time': 1774713633.0, 'created_time': 1773131946.785816, 'last_price_update_time': 1774706669.872061}
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XW97577') HTTP/1.1" 204 0
2026-03-28 14:04:29 [auto1.es] INFO: Found listing with ID: PF88217
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF88217%27 HTTP/1.1" 200 None
2026-03-28 14:04:29 [auto1.es] INFO: Scrape type for PF88217: 2
2026-03-28 14:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a93a26c-639c-5d2b-a5b6-dc26fd79ba56 with identifier: PF88217
2026-03-28 14:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a93a26c-639c-5d2b-a5b6-dc26fd79ba56 with scrape type 2
2026-03-28 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a93a26c-639c-5d2b-a5b6-dc26fd79ba56 with scrape type 2
2026-03-28 14:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9a93a26c-639c-5d2b-a5b6-dc26fd79ba56, identifier: PF88217
2026-03-28 14:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9a93a26c-639c-5d2b-a5b6-dc26fd79ba56 with identifier: PF88217
2026-03-28 14:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9a93a26c-639c-5d2b-a5b6-dc26fd79ba56 with identifier: PF88217
2026-03-28 14:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9a93a26c-639c-5d2b-a5b6-dc26fd79ba56 with identifier: PF88217 to the API
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:35Z',
 'fuel_type': 'diesel',
 'id': '9a93a26c-639c-5d2b-a5b6-dc26fd79ba56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF88217',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 238236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF88217%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [auto1.es] INFO: Saving data for PF88217: {'auction_closing_time': 1774715555.0, 'created_time': 1774620172.401159, 'last_price_update_time': 1774706670.245048}
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PF88217') HTTP/1.1" 204 0
2026-03-28 14:04:30 [auto1.es] INFO: Found listing with ID: MB16167
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB16167%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [auto1.es] INFO: Scrape type for MB16167: 0
2026-03-28 14:04:30 [auto1.es] INFO: Found listing with ID: EG85848
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG85848%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [auto1.es] INFO: Scrape type for EG85848: 2
2026-03-28 14:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2 with identifier: EG85848
2026-03-28 14:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2 with scrape type 2
2026-03-28 14:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2 with scrape type 2
2026-03-28 14:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2, identifier: EG85848
2026-03-28 14:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2 with identifier: EG85848
2026-03-28 14:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2 with identifier: EG85848
2026-03-28 14:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2 with identifier: EG85848 to the API
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:11:01Z',
 'fuel_type': 'petrol',
 'id': 'b3c7acbc-753a-5d70-a33d-1f2f62dbb6e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG85848',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 41317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-29',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2022}
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG85848%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [auto1.es] INFO: Saving data for EG85848: {'auction_closing_time': 1774714261.0, 'created_time': 1773132149.535303, 'last_price_update_time': 1774706670.656275}
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EG85848') HTTP/1.1" 204 0
2026-03-28 14:04:30 [auto1.es] INFO: Found listing with ID: UZ66881
2026-03-28 14:04:30 [auto1.es] INFO: Found listing with ID: BL63813
2026-03-28 14:04:30 [auto1.es] INFO: Found listing with ID: EN12947
2026-03-28 14:04:30 [auto1.es] INFO: Found listing with ID: TU33340
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU33340%27 HTTP/1.1" 200 None
2026-03-28 14:04:30 [auto1.es] INFO: Scrape type for TU33340: 2
2026-03-28 14:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d457ec8-ef2e-5c53-b840-15fffb165825 with identifier: TU33340
2026-03-28 14:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d457ec8-ef2e-5c53-b840-15fffb165825 with scrape type 2
2026-03-28 14:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d457ec8-ef2e-5c53-b840-15fffb165825 with scrape type 2
2026-03-28 14:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6d457ec8-ef2e-5c53-b840-15fffb165825, identifier: TU33340
2026-03-28 14:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6d457ec8-ef2e-5c53-b840-15fffb165825 with identifier: TU33340
2026-03-28 14:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6d457ec8-ef2e-5c53-b840-15fffb165825 with identifier: TU33340
2026-03-28 14:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6d457ec8-ef2e-5c53-b840-15fffb165825 with identifier: TU33340 to the API
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:41:12Z',
 'fuel_type': 'hybrid',
 'id': '6d457ec8-ef2e-5c53-b840-15fffb165825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU33340',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4',
 'odometer': 11913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-26',
 'seller_name': None,
 'title': 'DS Automobiles DS4 1.6 E-Tense Hybrid Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2024}
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU33340%27 HTTP/1.1" 200 None
2026-03-28 14:04:31 [auto1.es] INFO: Saving data for TU33340: {'auction_closing_time': 1774716072.0, 'created_time': 1773131109.433281, 'last_price_update_time': 1774706671.271455}
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TU33340') HTTP/1.1" 204 0
2026-03-28 14:04:31 [auto1.es] INFO: Found listing with ID: DV32133
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV32133%27 HTTP/1.1" 200 None
2026-03-28 14:04:31 [auto1.es] INFO: Scrape type for DV32133: 2
2026-03-28 14:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9d454ce-1278-5b5b-8f3f-53a442142b7d with identifier: DV32133
2026-03-28 14:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9d454ce-1278-5b5b-8f3f-53a442142b7d with scrape type 2
2026-03-28 14:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9d454ce-1278-5b5b-8f3f-53a442142b7d with scrape type 2
2026-03-28 14:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a9d454ce-1278-5b5b-8f3f-53a442142b7d, identifier: DV32133
2026-03-28 14:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a9d454ce-1278-5b5b-8f3f-53a442142b7d with identifier: DV32133
2026-03-28 14:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a9d454ce-1278-5b5b-8f3f-53a442142b7d with identifier: DV32133
2026-03-28 14:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a9d454ce-1278-5b5b-8f3f-53a442142b7d with identifier: DV32133 to the API
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:40:54Z',
 'fuel_type': 'petrol',
 'id': 'a9d454ce-1278-5b5b-8f3f-53a442142b7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV32133',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 126561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV32133%27 HTTP/1.1" 200 None
2026-03-28 14:04:31 [auto1.es] INFO: Saving data for DV32133: {'auction_closing_time': 1774716054.0, 'created_time': 1773131925.882401, 'last_price_update_time': 1774706671.741733}
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DV32133') HTTP/1.1" 204 0
2026-03-28 14:04:31 [auto1.es] INFO: Found listing with ID: ZV69106
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV69106%27 HTTP/1.1" 200 None
2026-03-28 14:04:31 [auto1.es] INFO: Scrape type for ZV69106: 2
2026-03-28 14:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26dbfa81-9c34-54de-9150-230ba3ab05c9 with identifier: ZV69106
2026-03-28 14:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26dbfa81-9c34-54de-9150-230ba3ab05c9 with scrape type 2
2026-03-28 14:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26dbfa81-9c34-54de-9150-230ba3ab05c9 with scrape type 2
2026-03-28 14:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 26dbfa81-9c34-54de-9150-230ba3ab05c9, identifier: ZV69106
2026-03-28 14:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 26dbfa81-9c34-54de-9150-230ba3ab05c9 with identifier: ZV69106
2026-03-28 14:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 26dbfa81-9c34-54de-9150-230ba3ab05c9 with identifier: ZV69106
2026-03-28 14:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 26dbfa81-9c34-54de-9150-230ba3ab05c9 with identifier: ZV69106 to the API
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:04:26Z',
 'fuel_type': 'diesel',
 'id': '26dbfa81-9c34-54de-9150-230ba3ab05c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV69106',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 147820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI Premium Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Premium Elegance 4Motion',
 'year': 2022}
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV69106%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [auto1.es] INFO: Saving data for ZV69106: {'auction_closing_time': 1774713866.0, 'created_time': 1773145833.64531, 'last_price_update_time': 1774706672.267858}
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZV69106') HTTP/1.1" 204 0
2026-03-28 14:04:32 [auto1.es] INFO: Found listing with ID: MD70003
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD70003%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [auto1.es] INFO: Scrape type for MD70003: 2
2026-03-28 14:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1643cffc-2a5d-5ad1-be00-fa20ccd6377e with identifier: MD70003
2026-03-28 14:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1643cffc-2a5d-5ad1-be00-fa20ccd6377e with scrape type 2
2026-03-28 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1643cffc-2a5d-5ad1-be00-fa20ccd6377e with scrape type 2
2026-03-28 14:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1643cffc-2a5d-5ad1-be00-fa20ccd6377e, identifier: MD70003
2026-03-28 14:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1643cffc-2a5d-5ad1-be00-fa20ccd6377e with identifier: MD70003
2026-03-28 14:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1643cffc-2a5d-5ad1-be00-fa20ccd6377e with identifier: MD70003
2026-03-28 14:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1643cffc-2a5d-5ad1-be00-fa20ccd6377e with identifier: MD70003 to the API
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:11:23Z',
 'fuel_type': 'petrol',
 'id': '1643cffc-2a5d-5ad1-be00-fa20ccd6377e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD70003',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 156998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-17',
 'seller_name': None,
 'title': 'Peugeot 407 1.8 SR Confort',
 'transmission': 'manual',
 'trim': 'SR Confort',
 'year': 2005}
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD70003%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [auto1.es] INFO: Saving data for MD70003: {'auction_closing_time': 1774714283.0, 'created_time': 1774620170.186683, 'last_price_update_time': 1774706672.718417}
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MD70003') HTTP/1.1" 204 0
2026-03-28 14:04:32 [auto1.es] INFO: Channel: 24h | Page: 56 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:32 [auto1.es] INFO: Found listing with ID: LA48157
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA48157%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [auto1.es] INFO: Scrape type for LA48157: 0
2026-03-28 14:04:32 [auto1.es] INFO: Found listing with ID: EP39863
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP39863%27 HTTP/1.1" 200 None
2026-03-28 14:04:32 [auto1.es] INFO: Scrape type for EP39863: 2
2026-03-28 14:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aa043e1-0960-5fd3-bea9-af48bcd36458 with identifier: EP39863
2026-03-28 14:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aa043e1-0960-5fd3-bea9-af48bcd36458 with scrape type 2
2026-03-28 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aa043e1-0960-5fd3-bea9-af48bcd36458 with scrape type 2
2026-03-28 14:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9aa043e1-0960-5fd3-bea9-af48bcd36458, identifier: EP39863
2026-03-28 14:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9aa043e1-0960-5fd3-bea9-af48bcd36458 with identifier: EP39863
2026-03-28 14:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9aa043e1-0960-5fd3-bea9-af48bcd36458 with identifier: EP39863
2026-03-28 14:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9aa043e1-0960-5fd3-bea9-af48bcd36458 with identifier: EP39863 to the API
2026-03-28 14:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:32:07Z',
 'fuel_type': 'petrol',
 'id': '9aa043e1-0960-5fd3-bea9-af48bcd36458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP39863',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 302049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-21',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP39863%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [auto1.es] INFO: Saving data for EP39863: {'auction_closing_time': 1774715527.0, 'created_time': 1774620175.207619, 'last_price_update_time': 1774706673.154354}
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EP39863') HTTP/1.1" 204 0
2026-03-28 14:04:33 [auto1.es] INFO: Found listing with ID: WA67007
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA67007%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [auto1.es] INFO: Scrape type for WA67007: 2
2026-03-28 14:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7df3f34f-8889-5e40-8a75-f077327b3820 with identifier: WA67007
2026-03-28 14:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7df3f34f-8889-5e40-8a75-f077327b3820 with scrape type 2
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7df3f34f-8889-5e40-8a75-f077327b3820 with scrape type 2
2026-03-28 14:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7df3f34f-8889-5e40-8a75-f077327b3820, identifier: WA67007
2026-03-28 14:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:33 [auto1.es] INFO: Found listing with ID: WW33252
2026-03-28 14:04:33 [auto1.es] INFO: Found listing with ID: GK53380
2026-03-28 14:04:33 [auto1.es] INFO: Found listing with ID: GX06456
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX06456%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [auto1.es] INFO: Scrape type for GX06456: 2
2026-03-28 14:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1057a905-96df-5265-8230-94b8a750e82a with identifier: GX06456
2026-03-28 14:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1057a905-96df-5265-8230-94b8a750e82a with scrape type 2
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1057a905-96df-5265-8230-94b8a750e82a with scrape type 2
2026-03-28 14:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1057a905-96df-5265-8230-94b8a750e82a, identifier: GX06456
2026-03-28 14:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7df3f34f-8889-5e40-8a75-f077327b3820 with identifier: WA67007
2026-03-28 14:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7df3f34f-8889-5e40-8a75-f077327b3820 with identifier: WA67007
2026-03-28 14:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7df3f34f-8889-5e40-8a75-f077327b3820 with identifier: WA67007 to the API
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:07:36Z',
 'fuel_type': 'hybrid',
 'id': '7df3f34f-8889-5e40-8a75-f077327b3820',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA67007',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Camry',
 'odometer': 194244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-08',
 'seller_name': None,
 'title': 'Toyota Camry 2.5 Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2020}
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA67007%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [auto1.es] INFO: Saving data for WA67007: {'auction_closing_time': 1774714056.0, 'created_time': 1774382635.252186, 'last_price_update_time': 1774706673.665803}
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WA67007') HTTP/1.1" 204 0
2026-03-28 14:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1057a905-96df-5265-8230-94b8a750e82a with identifier: GX06456
2026-03-28 14:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1057a905-96df-5265-8230-94b8a750e82a with identifier: GX06456
2026-03-28 14:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1057a905-96df-5265-8230-94b8a750e82a with identifier: GX06456 to the API
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:23:21Z',
 'fuel_type': 'diesel',
 'id': '1057a905-96df-5265-8230-94b8a750e82a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX06456',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 214204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-12',
 'seller_name': None,
 'title': 'Land Rover Range Rover 4.4 SDI Vogue',
 'transmission': 'automatic',
 'trim': 'Vogue',
 'year': 2016}
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX06456%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [auto1.es] INFO: Saving data for GX06456: {'auction_closing_time': 1774715001.0, 'created_time': 1774620177.335187, 'last_price_update_time': 1774706673.956224}
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GX06456') HTTP/1.1" 204 0
2026-03-28 14:04:33 [auto1.es] INFO: Found listing with ID: AX74159
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX74159%27 HTTP/1.1" 200 None
2026-03-28 14:04:33 [auto1.es] INFO: Scrape type for AX74159: 2
2026-03-28 14:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e50672-de17-5858-a788-1164c2d1ce5d with identifier: AX74159
2026-03-28 14:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e50672-de17-5858-a788-1164c2d1ce5d with scrape type 2
2026-03-28 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0e50672-de17-5858-a788-1164c2d1ce5d with scrape type 2
2026-03-28 14:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a0e50672-de17-5858-a788-1164c2d1ce5d, identifier: AX74159
2026-03-28 14:04:34 [auto1.es] INFO: Found listing with ID: MV28926
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV28926%27 HTTP/1.1" 200 None
2026-03-28 14:04:34 [auto1.es] INFO: Scrape type for MV28926: 2
2026-03-28 14:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31cf98f1-83ed-5092-b21d-d1c8acf615c6 with identifier: MV28926
2026-03-28 14:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31cf98f1-83ed-5092-b21d-d1c8acf615c6 with scrape type 2
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31cf98f1-83ed-5092-b21d-d1c8acf615c6 with scrape type 2
2026-03-28 14:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 31cf98f1-83ed-5092-b21d-d1c8acf615c6, identifier: MV28926
2026-03-28 14:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a0e50672-de17-5858-a788-1164c2d1ce5d with identifier: AX74159
2026-03-28 14:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a0e50672-de17-5858-a788-1164c2d1ce5d with identifier: AX74159
2026-03-28 14:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a0e50672-de17-5858-a788-1164c2d1ce5d with identifier: AX74159 to the API
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 462,
 'expiration_date': '2026-03-28T16:59:54Z',
 'fuel_type': 'hybrid',
 'id': 'a0e50672-de17-5858-a788-1164c2d1ce5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX74159',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 70817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-18',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 eHybrid R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2021}
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX74159%27 HTTP/1.1" 200 None
2026-03-28 14:04:34 [auto1.es] INFO: Saving data for AX74159: {'auction_closing_time': 1774717194.0, 'created_time': 1774382779.827528, 'last_price_update_time': 1774706674.478052}
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AX74159') HTTP/1.1" 204 0
2026-03-28 14:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 31cf98f1-83ed-5092-b21d-d1c8acf615c6 with identifier: MV28926
2026-03-28 14:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 31cf98f1-83ed-5092-b21d-d1c8acf615c6 with identifier: MV28926
2026-03-28 14:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 31cf98f1-83ed-5092-b21d-d1c8acf615c6 with identifier: MV28926 to the API
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:23:46Z',
 'fuel_type': 'diesel',
 'id': '31cf98f1-83ed-5092-b21d-d1c8acf615c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV28926',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 42915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-20',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV28926%27 HTTP/1.1" 200 None
2026-03-28 14:04:34 [auto1.es] INFO: Saving data for MV28926: {'auction_closing_time': 1774715026.0, 'created_time': 1773126739.26267, 'last_price_update_time': 1774706674.786126}
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MV28926') HTTP/1.1" 204 0
2026-03-28 14:04:34 [auto1.es] INFO: Found listing with ID: SL25416
2026-03-28 14:04:34 [auto1.es] INFO: Found listing with ID: GG82225
2026-03-28 14:04:34 [auto1.es] INFO: Found listing with ID: LV49535
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV49535%27 HTTP/1.1" 200 None
2026-03-28 14:04:34 [auto1.es] INFO: Scrape type for LV49535: 2
2026-03-28 14:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9735fb9-49ac-51c2-89b9-dfd43c37c686 with identifier: LV49535
2026-03-28 14:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9735fb9-49ac-51c2-89b9-dfd43c37c686 with scrape type 2
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9735fb9-49ac-51c2-89b9-dfd43c37c686 with scrape type 2
2026-03-28 14:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d9735fb9-49ac-51c2-89b9-dfd43c37c686, identifier: LV49535
2026-03-28 14:04:34 [auto1.es] INFO: Found listing with ID: HZ84403
2026-03-28 14:04:34 [auto1.es] INFO: Found listing with ID: SN85132
2026-03-28 14:04:34 [auto1.es] INFO: Found listing with ID: PZ83937
2026-03-28 14:04:34 [auto1.es] INFO: Found listing with ID: MJ22507
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ22507%27 HTTP/1.1" 200 None
2026-03-28 14:04:34 [auto1.es] INFO: Scrape type for MJ22507: 2
2026-03-28 14:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 with identifier: MJ22507
2026-03-28 14:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 with scrape type 2
2026-03-28 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 with scrape type 2
2026-03-28 14:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055, identifier: MJ22507
2026-03-28 14:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d9735fb9-49ac-51c2-89b9-dfd43c37c686 with identifier: LV49535
2026-03-28 14:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d9735fb9-49ac-51c2-89b9-dfd43c37c686 with identifier: LV49535
2026-03-28 14:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d9735fb9-49ac-51c2-89b9-dfd43c37c686 with identifier: LV49535 to the API
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:52:52Z',
 'fuel_type': 'diesel',
 'id': 'd9735fb9-49ac-51c2-89b9-dfd43c37c686',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV49535',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 155624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2021}
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV49535%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Saving data for LV49535: {'auction_closing_time': 1774716772.0, 'created_time': 1773146156.693131, 'last_price_update_time': 1774706675.293935}
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LV49535') HTTP/1.1" 204 0
2026-03-28 14:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 with identifier: MJ22507
2026-03-28 14:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 with identifier: MJ22507
2026-03-28 14:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 with identifier: MJ22507 to the API
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:19:59Z',
 'fuel_type': 'petrol',
 'id': '44ea2c4b-d82b-5aeb-8b97-0c6a007a1055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ22507',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 192191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2020}
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ22507%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Saving data for MJ22507: {'auction_closing_time': 1774714799.0, 'created_time': 1773126740.060129, 'last_price_update_time': 1774706675.679127}
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MJ22507') HTTP/1.1" 204 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: DJ04712
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ04712%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for DJ04712: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: GX78430
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: XA13214
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: XH50909
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: DE67964
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE67964%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for DE67964: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: TX42049
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: SG65714
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG65714%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for SG65714: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: XJ18059
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: CY15368
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY15368%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for CY15368: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: UP27315
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: JG12289
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: RX15442
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX15442%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for RX15442: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: HT69965
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT69965%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for HT69965: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: KW14097
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: TE55978
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE55978%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for TE55978: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: DG64903
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: YE59618
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE59618%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for YE59618: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: FJ48335
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ48335%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for FJ48335: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: YP50704
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP50704%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for YP50704: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: ML86623
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: AE33071
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE33071%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for AE33071: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: EY16008
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY16008%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for EY16008: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: WB62155
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: XZ16571
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ16571%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for XZ16571: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: BZ14545
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: SP81388
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: YL98507
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: UZ13447
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: KX02596
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX02596%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for KX02596: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: VC76613
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: FE56951
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: RD14633
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: GT51555
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT51555%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for GT51555: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: ZM80152
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM80152%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for ZM80152: 0
2026-03-28 14:04:35 [auto1.es] INFO: Found listing with ID: FN90345
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN90345%27 HTTP/1.1" 200 None
2026-03-28 14:04:35 [auto1.es] INFO: Scrape type for FN90345: 0
2026-03-28 14:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:36 [auto1.es] INFO: Channel: 24h | Page: 57 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:36 [auto1.es] INFO: Found listing with ID: ZA28450
2026-03-28 14:04:36 [auto1.es] INFO: Found listing with ID: VV73300
2026-03-28 14:04:36 [auto1.es] INFO: Found listing with ID: AT54546
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT54546%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [auto1.es] INFO: Scrape type for AT54546: 0
2026-03-28 14:04:36 [auto1.es] INFO: Found listing with ID: PB23846
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB23846%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [auto1.es] INFO: Scrape type for PB23846: 0
2026-03-28 14:04:36 [auto1.es] INFO: Found listing with ID: VN77018
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN77018%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [auto1.es] INFO: Scrape type for VN77018: 0
2026-03-28 14:04:36 [auto1.es] INFO: Found listing with ID: WG01714
2026-03-28 14:04:36 [auto1.es] INFO: Found listing with ID: TB50178
2026-03-28 14:04:36 [auto1.es] INFO: Found listing with ID: JK29035
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK29035%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [auto1.es] INFO: Scrape type for JK29035: 0
2026-03-28 14:04:36 [auto1.es] INFO: Found listing with ID: VL72913
2026-03-28 14:04:36 [auto1.es] INFO: Found listing with ID: ZZ62546
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ62546%27 HTTP/1.1" 200 None
2026-03-28 14:04:36 [auto1.es] INFO: Scrape type for ZZ62546: 0
2026-03-28 14:04:36 [auto1.es] INFO: Found listing with ID: XP57901
2026-03-28 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP57901%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [auto1.es] INFO: Scrape type for XP57901: 0
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: JW76352
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: AB11386
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: XR29035
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: YF06119
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: MC71487
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: LT61588
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: MP31569
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP31569%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [auto1.es] INFO: Scrape type for MP31569: 0
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: UL23725
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL23725%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [auto1.es] INFO: Scrape type for UL23725: 0
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: YC43770
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC43770%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [auto1.es] INFO: Scrape type for YC43770: 0
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: FZ62617
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: UZ90227
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: CT66486
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: TN50205
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: FJ32217
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: MU50158
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: LV83724
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV83724%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [auto1.es] INFO: Scrape type for LV83724: 0
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: KH40259
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: EF00810
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: CR96058
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR96058%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [auto1.es] INFO: Scrape type for CR96058: 0
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: NH80896
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH80896%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [auto1.es] INFO: Scrape type for NH80896: 0
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: JJ54433
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: PX76519
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: TJ03460
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: EE78385
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: RL54744
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: FL97062
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: PC36576
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC36576%27 HTTP/1.1" 200 None
2026-03-28 14:04:37 [auto1.es] INFO: Scrape type for PC36576: 0
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: TG55276
2026-03-28 14:04:37 [auto1.es] INFO: Found listing with ID: VL76370
2026-03-28 14:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:38 [auto1.es] INFO: Channel: 24h | Page: 58 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: AN25119
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN25119%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for AN25119: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: HL96316
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: NA14080
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA14080%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for NA14080: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: KD32086
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD32086%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for KD32086: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: JE90684
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE90684%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for JE90684: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: KL07706
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL07706%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for KL07706: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: ZC57359
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC57359%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for ZC57359: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: LJ23140
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: CH50110
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: ET64130
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: WL07406
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL07406%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for WL07406: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: JL80339
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL80339%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for JL80339: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: UP46325
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: MM77073
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: DV58619
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: MH58773
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH58773%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for MH58773: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: KE17366
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: WM54096
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: YX68233
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: FW39837
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW39837%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for FW39837: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: ES82633
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES82633%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for ES82633: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: JW31558
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW31558%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for JW31558: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: XW86216
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW86216%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for XW86216: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: ZR14615
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR14615%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for ZR14615: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: MG74318
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG74318%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for MG74318: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: EB56604
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: EZ75681
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: YP54060
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP54060%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for YP54060: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: ZF52825
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF52825%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for ZF52825: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: FD92977
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD92977%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for FD92977: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: UT04175
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT04175%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for UT04175: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: FJ63213
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ63213%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for FJ63213: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: YM46867
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: DM27699
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM27699%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for DM27699: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: FP35669
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP35669%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for FP35669: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: JE09459
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE09459%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for JE09459: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: XE32619
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: ZY33695
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY33695%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for ZY33695: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: XC39222
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC39222%27 HTTP/1.1" 200 None
2026-03-28 14:04:38 [auto1.es] INFO: Scrape type for XC39222: 0
2026-03-28 14:04:38 [auto1.es] INFO: Found listing with ID: DH28057
2026-03-28 14:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:43 [auto1.es] INFO: Channel: 24h | Page: 59 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: LC81120
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC81120%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for LC81120: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: GD98283
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: CB57175
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB57175%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for CB57175: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: PZ72634
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: MS49436
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: RR62391
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR62391%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for RR62391: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: AJ84089
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ84089%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for AJ84089: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: FB43319
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB43319%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for FB43319: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: XC46914
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: RM79142
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM79142%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for RM79142: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: JY09497
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY09497%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for JY09497: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: TD25649
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: AS51467
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: NZ54247
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: WE21693
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE21693%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for WE21693: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: FR95558
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: ZE41555
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: HM27570
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: AL28647
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL28647%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for AL28647: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: PC53610
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: KM47082
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM47082%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for KM47082: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: FJ09985
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ09985%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for FJ09985: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: JZ86442
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: VB06067
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB06067%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for VB06067: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: SA98238
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: LS65787
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: DA25807
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: MA79555
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA79555%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for MA79555: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: TE50739
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: VL49161
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL49161%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for VL49161: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: RT14519
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: WM24762
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: JE26942
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: XX85945
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: BT54234
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT54234%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for BT54234: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: BE99512
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: CN53275
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN53275%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for CN53275: 0
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: RN90591
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: TC61442
2026-03-28 14:04:43 [auto1.es] INFO: Found listing with ID: PT49535
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT49535%27 HTTP/1.1" 200 None
2026-03-28 14:04:43 [auto1.es] INFO: Scrape type for PT49535: 0
2026-03-28 14:04:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:44 [auto1.es] INFO: Channel: 24h | Page: 60 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: AL30564
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: KE47103
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: SF05146
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF05146%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for SF05146: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: GX55521
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: EL12224
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: EE07728
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: LB97818
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: SU20973
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: RD73162
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD73162%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for RD73162: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: LE09183
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE09183%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for LE09183: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: DL40805
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL40805%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for DL40805: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: AW49477
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW49477%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for AW49477: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: TB74372
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB74372%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for TB74372: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: LU79245
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: RV28339
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: AE79363
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE79363%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for AE79363: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: BP19645
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP19645%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for BP19645: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: RB19136
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB19136%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for RB19136: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: HC67204
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC67204%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for HC67204: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: EL32039
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: YD48242
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: SB84191
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: XF10257
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF10257%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for XF10257: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: UA88301
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: TT54847
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: MF03574
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF03574%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for MF03574: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: CZ73203
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ73203%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for CZ73203: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: AJ53679
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ53679%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for AJ53679: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: ER99924
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER99924%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for ER99924: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: AJ63740
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ63740%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for AJ63740: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: MG24035
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: AG87385
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG87385%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for AG87385: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: XW95149
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW95149%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for XW95149: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: SY91293
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY91293%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for SY91293: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: JC49855
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: DM43927
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM43927%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for DM43927: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: ZH88989
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH88989%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for ZH88989: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: AV04114
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: NN13578
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN13578%27 HTTP/1.1" 200 None
2026-03-28 14:04:44 [auto1.es] INFO: Scrape type for NN13578: 0
2026-03-28 14:04:44 [auto1.es] INFO: Found listing with ID: JB50336
2026-03-28 14:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:45 [auto1.es] INFO: Channel: 24h | Page: 61 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:45 [auto1.es] INFO: Found listing with ID: XJ92197
2026-03-28 14:04:45 [auto1.es] INFO: Found listing with ID: TV08054
2026-03-28 14:04:45 [auto1.es] INFO: Found listing with ID: MA21066
2026-03-28 14:04:45 [auto1.es] INFO: Found listing with ID: UK85840
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK85840%27 HTTP/1.1" 200 None
2026-03-28 14:04:45 [auto1.es] INFO: Scrape type for UK85840: 0
2026-03-28 14:04:45 [auto1.es] INFO: Found listing with ID: HZ40578
2026-03-28 14:04:45 [auto1.es] INFO: Found listing with ID: AH95116
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH95116%27 HTTP/1.1" 200 None
2026-03-28 14:04:45 [auto1.es] INFO: Scrape type for AH95116: 0
2026-03-28 14:04:45 [auto1.es] INFO: Found listing with ID: ML07808
2026-03-28 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML07808%27 HTTP/1.1" 200 None
2026-03-28 14:04:46 [auto1.es] INFO: Scrape type for ML07808: 0
2026-03-28 14:04:46 [auto1.es] INFO: Found listing with ID: NE97244
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE97244%27 HTTP/1.1" 200 None
2026-03-28 14:04:46 [auto1.es] INFO: Scrape type for NE97244: 0
2026-03-28 14:04:46 [auto1.es] INFO: Found listing with ID: UF15640
2026-03-28 14:04:46 [auto1.es] INFO: Found listing with ID: UV13351
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV13351%27 HTTP/1.1" 200 None
2026-03-28 14:04:46 [auto1.es] INFO: Scrape type for UV13351: 2
2026-03-28 14:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f574373-8a5f-5066-b4fd-b981fa569d53 with identifier: UV13351
2026-03-28 14:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f574373-8a5f-5066-b4fd-b981fa569d53 with scrape type 2
2026-03-28 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f574373-8a5f-5066-b4fd-b981fa569d53 with scrape type 2
2026-03-28 14:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f574373-8a5f-5066-b4fd-b981fa569d53, identifier: UV13351
2026-03-28 14:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f574373-8a5f-5066-b4fd-b981fa569d53 with identifier: UV13351
2026-03-28 14:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f574373-8a5f-5066-b4fd-b981fa569d53 with identifier: UV13351
2026-03-28 14:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1f574373-8a5f-5066-b4fd-b981fa569d53 with identifier: UV13351 to the API
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:58:33Z',
 'fuel_type': 'diesel',
 'id': '1f574373-8a5f-5066-b4fd-b981fa569d53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV13351',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Grand Vitara',
 'odometer': 166512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-17',
 'seller_name': None,
 'title': 'Suzuki Grand Vitara 1.9 DDiS JLX',
 'transmission': 'manual',
 'trim': 'JLX',
 'year': 2007}
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV13351%27 HTTP/1.1" 200 None
2026-03-28 14:04:46 [auto1.es] INFO: Saving data for UV13351: {'auction_closing_time': 1774717113.0, 'created_time': 1774533685.633888, 'last_price_update_time': 1774706686.742725}
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UV13351') HTTP/1.1" 204 0
2026-03-28 14:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:46 [auto1.es] INFO: Found listing with ID: JY25444
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY25444%27 HTTP/1.1" 200 None
2026-03-28 14:04:46 [auto1.es] INFO: Scrape type for JY25444: 2
2026-03-28 14:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c58746e3-20a5-5ea6-8667-4499ded6c260 with identifier: JY25444
2026-03-28 14:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c58746e3-20a5-5ea6-8667-4499ded6c260 with scrape type 2
2026-03-28 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c58746e3-20a5-5ea6-8667-4499ded6c260 with scrape type 2
2026-03-28 14:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c58746e3-20a5-5ea6-8667-4499ded6c260, identifier: JY25444
2026-03-28 14:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c58746e3-20a5-5ea6-8667-4499ded6c260 with identifier: JY25444
2026-03-28 14:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c58746e3-20a5-5ea6-8667-4499ded6c260 with identifier: JY25444
2026-03-28 14:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c58746e3-20a5-5ea6-8667-4499ded6c260 with identifier: JY25444 to the API
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:20:45Z',
 'fuel_type': 'diesel',
 'id': 'c58746e3-20a5-5ea6-8667-4499ded6c260',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY25444',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 246378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-31',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2016}
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY25444%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [auto1.es] INFO: Saving data for JY25444: {'auction_closing_time': 1774714845.0, 'created_time': 1774436440.407065, 'last_price_update_time': 1774706687.253428}
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JY25444') HTTP/1.1" 204 0
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: CU51757
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: EY86051
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: GP92404
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP92404%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [auto1.es] INFO: Scrape type for GP92404: 0
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: NB97215
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: PK58195
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: SG84832
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG84832%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [auto1.es] INFO: Scrape type for SG84832: 0
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: NK92990
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: UU25578
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU25578%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [auto1.es] INFO: Scrape type for UU25578: 0
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: AB11281
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: PE24027
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE24027%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [auto1.es] INFO: Scrape type for PE24027: 0
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: GN52396
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: ZA21810
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: BJ36748
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: AV93278
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: AW04396
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW04396%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [auto1.es] INFO: Scrape type for AW04396: 0
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: MA61086
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: PS45222
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: ZZ72823
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ72823%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [auto1.es] INFO: Scrape type for ZZ72823: 0
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: CW88498
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW88498%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [auto1.es] INFO: Scrape type for CW88498: 0
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: KR67716
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: NZ88130
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: EA95786
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA95786%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [auto1.es] INFO: Scrape type for EA95786: 0
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: GS59468
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: NL01395
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: FD66693
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD66693%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [auto1.es] INFO: Scrape type for FD66693: 0
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: MZ54464
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: CB03666
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB03666%27 HTTP/1.1" 200 None
2026-03-28 14:04:47 [auto1.es] INFO: Scrape type for CB03666: 0
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: WN15214
2026-03-28 14:04:47 [auto1.es] INFO: Found listing with ID: GP65825
2026-03-28 14:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:48 [auto1.es] INFO: Channel: 24h | Page: 62 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: KP85608
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: VU96042
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU96042%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for VU96042: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: TV36544
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: HF92394
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: AS08117
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: HT85667
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT85667%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for HT85667: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: XN45249
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: HB38669
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB38669%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for HB38669: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: HZ02297
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: UG78525
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: LK07555
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: XX98366
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX98366%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for XX98366: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: DF08485
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF08485%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for DF08485: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: JC46060
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC46060%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for JC46060: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: VT11458
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT11458%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for VT11458: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: VG77720
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: DL11284
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL11284%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for DL11284: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: YV30906
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV30906%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for YV30906: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: DL05579
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: UK08613
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: AZ15880
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ15880%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for AZ15880: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: EV24986
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: HA22815
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA22815%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for HA22815: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: RK55405
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: UG21171
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: ME07403
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: MF36359
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: ES15520
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES15520%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for ES15520: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: HP01859
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: CP49442
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: TC70621
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC70621%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for TC70621: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: LG93188
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG93188%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for LG93188: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: MY48214
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY48214%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for MY48214: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: ZJ52163
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ52163%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for ZJ52163: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: VY31603
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: WC85393
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC85393%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for WC85393: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: TG12231
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: VK38327
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK38327%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for VK38327: 0
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: ZJ67299
2026-03-28 14:04:48 [auto1.es] INFO: Found listing with ID: TZ36663
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ36663%27 HTTP/1.1" 200 None
2026-03-28 14:04:48 [auto1.es] INFO: Scrape type for TZ36663: 0
2026-03-28 14:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:49 [auto1.es] INFO: Channel: 24h | Page: 63 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: WP66264
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP66264%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for WP66264: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: GR19122
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR19122%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for GR19122: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: EB62750
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB62750%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for EB62750: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: BZ21450
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: XY10294
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY10294%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for XY10294: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: LG59471
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG59471%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for LG59471: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: RV14480
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV14480%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for RV14480: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: ZC21665
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC21665%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for ZC21665: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: FA71297
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA71297%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for FA71297: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: VL09919
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL09919%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for VL09919: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: HE42254
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: RK09701
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: TV36726
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: GE62108
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: ZH45296
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: WZ44927
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: LP80713
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP80713%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for LP80713: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: DM84841
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: MZ44217
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ44217%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for MZ44217: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: DH50359
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: NJ73279
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: GM08675
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: ZW95177
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW95177%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for ZW95177: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: XX72262
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX72262%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for XX72262: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: EH39769
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH39769%27 HTTP/1.1" 200 None
2026-03-28 14:04:49 [auto1.es] INFO: Scrape type for EH39769: 0
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: LG94479
2026-03-28 14:04:49 [auto1.es] INFO: Found listing with ID: VT96833
2026-03-28 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT96833%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [auto1.es] INFO: Scrape type for VT96833: 0
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: UR64839
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR64839%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [auto1.es] INFO: Scrape type for UR64839: 0
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: TR96675
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR96675%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [auto1.es] INFO: Scrape type for TR96675: 0
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: KP83247
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: LC59267
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC59267%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [auto1.es] INFO: Scrape type for LC59267: 0
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: DV40298
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV40298%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [auto1.es] INFO: Scrape type for DV40298: 0
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: DD46195
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD46195%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [auto1.es] INFO: Scrape type for DD46195: 0
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: VB81501
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB81501%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [auto1.es] INFO: Scrape type for VB81501: 0
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: HN11800
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: GH42664
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH42664%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [auto1.es] INFO: Scrape type for GH42664: 0
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: UV08458
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: BB29813
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB29813%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [auto1.es] INFO: Scrape type for BB29813: 0
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: DD02198
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD02198%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [auto1.es] INFO: Scrape type for DD02198: 0
2026-03-28 14:04:50 [auto1.es] INFO: Found listing with ID: SM77284
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM77284%27 HTTP/1.1" 200 None
2026-03-28 14:04:50 [auto1.es] INFO: Scrape type for SM77284: 0
2026-03-28 14:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:51 [auto1.es] INFO: Channel: 24h | Page: 64 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: XS23007
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS23007%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for XS23007: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: TH31010
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH31010%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for TH31010: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: PP39110
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: TT72287
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: KL48857
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL48857%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for KL48857: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: RY19109
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY19109%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for RY19109: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: MK23766
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: DR64033
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: TH38754
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH38754%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for TH38754: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: FU14405
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU14405%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for FU14405: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: PD86662
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: XC40695
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC40695%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for XC40695: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: VE50785
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE50785%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for VE50785: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: NT66217
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: AP64153
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP64153%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for AP64153: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: PK37230
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK37230%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for PK37230: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: CW49447
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW49447%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for CW49447: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: BG55573
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: CT91769
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: UV80286
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: RP83421
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: YE20956
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: FT33215
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: CB32241
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: DX86055
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX86055%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for DX86055: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: KV41270
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV41270%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for KV41270: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: PD21728
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: XK73032
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK73032%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for XK73032: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: TN29066
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN29066%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for TN29066: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: RS45242
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS45242%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for RS45242: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: RT04886
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: JC38983
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC38983%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for JC38983: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: KD08887
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD08887%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for KD08887: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: EK86006
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: XL12491
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: VR29926
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR29926%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for VR29926: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: YC02097
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: FK65100
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK65100%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for FK65100: 0
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: ZT16054
2026-03-28 14:04:51 [auto1.es] INFO: Found listing with ID: VC62552
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC62552%27 HTTP/1.1" 200 None
2026-03-28 14:04:51 [auto1.es] INFO: Scrape type for VC62552: 0
2026-03-28 14:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:52 [auto1.es] INFO: Channel: 24h | Page: 65 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: DD15597
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD15597%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [auto1.es] INFO: Scrape type for DD15597: 0
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: LE34718
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: FM31640
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM31640%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [auto1.es] INFO: Scrape type for FM31640: 0
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: XS51461
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: ZD85047
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: MD04984
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: WD34727
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD34727%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [auto1.es] INFO: Scrape type for WD34727: 0
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: TT49974
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: ZE13912
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE13912%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [auto1.es] INFO: Scrape type for ZE13912: 0
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: AM05329
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: TH42321
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH42321%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [auto1.es] INFO: Scrape type for TH42321: 0
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: JG85850
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: MU04629
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: MW15131
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: UM71516
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM71516%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [auto1.es] INFO: Scrape type for UM71516: 0
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: VT35195
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: PD96380
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD96380%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [auto1.es] INFO: Scrape type for PD96380: 0
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: UD80298
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: PH10774
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: AL10193
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: RR40846
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: LR89235
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: DU61809
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: PH11049
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH11049%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [auto1.es] INFO: Scrape type for PH11049: 0
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: GX91950
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX91950%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [auto1.es] INFO: Scrape type for GX91950: 0
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: YJ04642
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ04642%27 HTTP/1.1" 200 None
2026-03-28 14:04:52 [auto1.es] INFO: Scrape type for YJ04642: 0
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: XZ30156
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: XF66468
2026-03-28 14:04:52 [auto1.es] INFO: Found listing with ID: FX14772
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX14772%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [auto1.es] INFO: Scrape type for FX14772: 0
2026-03-28 14:04:53 [auto1.es] INFO: Found listing with ID: VN13138
2026-03-28 14:04:53 [auto1.es] INFO: Found listing with ID: EN73965
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN73965%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [auto1.es] INFO: Scrape type for EN73965: 0
2026-03-28 14:04:53 [auto1.es] INFO: Found listing with ID: YA86748
2026-03-28 14:04:53 [auto1.es] INFO: Found listing with ID: ND59157
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND59157%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [auto1.es] INFO: Scrape type for ND59157: 0
2026-03-28 14:04:53 [auto1.es] INFO: Found listing with ID: KZ49779
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ49779%27 HTTP/1.1" 200 None
2026-03-28 14:04:53 [auto1.es] INFO: Scrape type for KZ49779: 0
2026-03-28 14:04:53 [auto1.es] INFO: Found listing with ID: YT85498
2026-03-28 14:04:53 [auto1.es] INFO: Found listing with ID: VZ06267
2026-03-28 14:04:53 [auto1.es] INFO: Found listing with ID: GC26553
2026-03-28 14:04:53 [auto1.es] INFO: Found listing with ID: YU03196
2026-03-28 14:04:53 [auto1.es] INFO: Found listing with ID: PA92548
2026-03-28 14:04:53 [auto1.es] INFO: Found listing with ID: JJ75829
2026-03-28 14:04:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:54 [auto1.es] INFO: Channel: 24h | Page: 66 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: SV29323
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV29323%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for SV29323: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: TB73704
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB73704%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for TB73704: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: VD81677
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD81677%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for VD81677: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: EJ16249
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: UH45112
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: DZ42678
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: VR45740
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR45740%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for VR45740: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: FK61059
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: VC98401
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: PS29729
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: WZ34012
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ34012%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for WZ34012: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: ZP51440
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: ZS20717
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS20717%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for ZS20717: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: NY16020
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: GT44883
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT44883%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for GT44883: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: XV33818
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV33818%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for XV33818: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: KX99272
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: AD67761
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD67761%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for AD67761: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: ZE85496
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: RT81282
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: XC28006
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC28006%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for XC28006: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: JP11260
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: MW05620
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: GY32674
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY32674%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for GY32674: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: TV15408
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV15408%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for TV15408: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: HV86151
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV86151%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for HV86151: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: UZ86093
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: ZM69944
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: RT56400
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT56400%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for RT56400: 0
2026-03-28 14:04:54 [auto1.es] INFO: Found listing with ID: MZ66022
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ66022%27 HTTP/1.1" 200 None
2026-03-28 14:04:54 [auto1.es] INFO: Scrape type for MZ66022: 2
2026-03-28 14:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 894b921a-b691-5eb5-951d-f67218c37e14 with identifier: MZ66022
2026-03-28 14:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 894b921a-b691-5eb5-951d-f67218c37e14 with scrape type 2
2026-03-28 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 894b921a-b691-5eb5-951d-f67218c37e14 with scrape type 2
2026-03-28 14:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 894b921a-b691-5eb5-951d-f67218c37e14, identifier: MZ66022
2026-03-28 14:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 894b921a-b691-5eb5-951d-f67218c37e14 with identifier: MZ66022
2026-03-28 14:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 894b921a-b691-5eb5-951d-f67218c37e14 with identifier: MZ66022
2026-03-28 14:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 894b921a-b691-5eb5-951d-f67218c37e14 with identifier: MZ66022 to the API
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:54:12Z',
 'fuel_type': 'diesel',
 'id': '894b921a-b691-5eb5-951d-f67218c37e14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ66022',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 154765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Lounge Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge Sport & Style BlueMotion Tech',
 'year': 2016}
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ66022%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [auto1.es] INFO: Saving data for MZ66022: {'auction_closing_time': 1774716852.0, 'created_time': 1774015651.323371, 'last_price_update_time': 1774706695.037963}
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MZ66022') HTTP/1.1" 204 0
2026-03-28 14:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:55 [auto1.es] INFO: Found listing with ID: WN54679
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN54679%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [auto1.es] INFO: Scrape type for WN54679: 0
2026-03-28 14:04:55 [auto1.es] INFO: Found listing with ID: VP18393
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP18393%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [auto1.es] INFO: Scrape type for VP18393: 0
2026-03-28 14:04:55 [auto1.es] INFO: Found listing with ID: DB92602
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB92602%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [auto1.es] INFO: Scrape type for DB92602: 0
2026-03-28 14:04:55 [auto1.es] INFO: Found listing with ID: WX13119
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX13119%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [auto1.es] INFO: Scrape type for WX13119: 0
2026-03-28 14:04:55 [auto1.es] INFO: Found listing with ID: UD21856
2026-03-28 14:04:55 [auto1.es] INFO: Found listing with ID: FZ04394
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ04394%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [auto1.es] INFO: Scrape type for FZ04394: 0
2026-03-28 14:04:55 [auto1.es] INFO: Found listing with ID: XK60422
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK60422%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [auto1.es] INFO: Scrape type for XK60422: 0
2026-03-28 14:04:55 [auto1.es] INFO: Found listing with ID: UF95473
2026-03-28 14:04:55 [auto1.es] INFO: Found listing with ID: ZW56409
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW56409%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [auto1.es] INFO: Scrape type for ZW56409: 0
2026-03-28 14:04:55 [auto1.es] INFO: Found listing with ID: BR13060
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR13060%27 HTTP/1.1" 200 None
2026-03-28 14:04:55 [auto1.es] INFO: Scrape type for BR13060: 0
2026-03-28 14:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:56 [auto1.es] INFO: Channel: 24h | Page: 67 | totalHits: 2696 | hits on page: 40
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: FK50437
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK50437%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [auto1.es] INFO: Scrape type for FK50437: 0
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: RD21311
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: XJ78592
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ78592%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [auto1.es] INFO: Scrape type for XJ78592: 0
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: FU29422
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: NG83144
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG83144%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [auto1.es] INFO: Scrape type for NG83144: 0
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: KH84544
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: LM59241
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: TF39547
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF39547%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [auto1.es] INFO: Scrape type for TF39547: 0
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: UT93063
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT93063%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [auto1.es] INFO: Scrape type for UT93063: 0
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: WA94101
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: VJ59554
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: MJ93698
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ93698%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [auto1.es] INFO: Scrape type for MJ93698: 0
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: RA85318
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: RC37181
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC37181%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [auto1.es] INFO: Scrape type for RC37181: 0
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: KV37790
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: AP29688
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP29688%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [auto1.es] INFO: Scrape type for AP29688: 0
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: RL18296
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL18296%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [auto1.es] INFO: Scrape type for RL18296: 2
2026-03-28 14:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a9131ac-9346-5cd1-9c77-f1a8829d1550 with identifier: RL18296
2026-03-28 14:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a9131ac-9346-5cd1-9c77-f1a8829d1550 with scrape type 2
2026-03-28 14:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a9131ac-9346-5cd1-9c77-f1a8829d1550 with scrape type 2
2026-03-28 14:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9a9131ac-9346-5cd1-9c77-f1a8829d1550, identifier: RL18296
2026-03-28 14:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9a9131ac-9346-5cd1-9c77-f1a8829d1550 with identifier: RL18296
2026-03-28 14:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9a9131ac-9346-5cd1-9c77-f1a8829d1550 with identifier: RL18296
2026-03-28 14:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9a9131ac-9346-5cd1-9c77-f1a8829d1550 with identifier: RL18296 to the API
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:08:14Z',
 'fuel_type': 'diesel',
 'id': '9a9131ac-9346-5cd1-9c77-f1a8829d1550',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL18296',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 243366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-31',
 'seller_name': None,
 'title': 'Renault Scenic 1.9 dCi Expression Confort',
 'transmission': 'manual',
 'trim': 'Expression Confort',
 'year': 2005}
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL18296%27 HTTP/1.1" 200 None
2026-03-28 14:04:56 [auto1.es] INFO: Saving data for RL18296: {'auction_closing_time': 1774714094.0, 'created_time': 1774350078.360297, 'last_price_update_time': 1774706696.874587}
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RL18296') HTTP/1.1" 204 0
2026-03-28 14:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: TK95363
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: BE90053
2026-03-28 14:04:56 [auto1.es] INFO: Found listing with ID: VY28267
2026-03-28 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY28267%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [auto1.es] INFO: Scrape type for VY28267: 0
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: HV58793
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: AU82484
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU82484%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [auto1.es] INFO: Scrape type for AU82484: 0
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: CL32416
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL32416%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [auto1.es] INFO: Scrape type for CL32416: 2
2026-03-28 14:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2422464c-d0e7-5681-a307-a0047d630d0f with identifier: CL32416
2026-03-28 14:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2422464c-d0e7-5681-a307-a0047d630d0f with scrape type 2
2026-03-28 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2422464c-d0e7-5681-a307-a0047d630d0f with scrape type 2
2026-03-28 14:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2422464c-d0e7-5681-a307-a0047d630d0f, identifier: CL32416
2026-03-28 14:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2422464c-d0e7-5681-a307-a0047d630d0f with identifier: CL32416
2026-03-28 14:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2422464c-d0e7-5681-a307-a0047d630d0f with identifier: CL32416
2026-03-28 14:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2422464c-d0e7-5681-a307-a0047d630d0f with identifier: CL32416 to the API
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:30:21Z',
 'fuel_type': 'diesel',
 'id': '2422464c-d0e7-5681-a307-a0047d630d0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL32416',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 336275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-25',
 'seller_name': None,
 'title': 'Peugeot 407 2.0 HDi ST Sport Pack',
 'transmission': 'manual',
 'trim': 'ST Sport Pack',
 'year': 2007}
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL32416%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [auto1.es] INFO: Saving data for CL32416: {'auction_closing_time': 1774715421.0, 'created_time': 1774296362.14874, 'last_price_update_time': 1774706697.403873}
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CL32416') HTTP/1.1" 204 0
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: YF90515
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: TL16652
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL16652%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [auto1.es] INFO: Scrape type for TL16652: 0
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: ET37328
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: VB46301
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: SU85789
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: JW67554
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW67554%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [auto1.es] INFO: Scrape type for JW67554: 0
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: CY04008
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: NV45891
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: NS96167
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: XV58633
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: UV89988
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: SB36142
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: UU20141
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: DH00541
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH00541%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [auto1.es] INFO: Scrape type for DH00541: 0
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: ND20390
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND20390%27 HTTP/1.1" 200 None
2026-03-28 14:04:57 [auto1.es] INFO: Scrape type for ND20390: 0
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: CA13811
2026-03-28 14:04:57 [auto1.es] INFO: Found listing with ID: VM06943
2026-03-28 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:58 [auto1.es] INFO: Channel: 24h | Page: 68 | totalHits: 2696 | hits on page: 16
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: GF91510
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF91510%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [auto1.es] INFO: Scrape type for GF91510: 0
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: GE94512
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: NM44751
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: HD74513
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: GT92698
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: VN26021
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN26021%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [auto1.es] INFO: Scrape type for VN26021: 0
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: WH54771
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: NL75511
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: LX82632
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX82632%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [auto1.es] INFO: Scrape type for LX82632: 0
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: WW97634
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: JM72010
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM72010%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [auto1.es] INFO: Scrape type for JM72010: 0
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: SD86160
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: HF43561
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: PP85710
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: PL21143
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL21143%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [auto1.es] INFO: Scrape type for PL21143: 0
2026-03-28 14:04:58 [auto1.es] INFO: Found listing with ID: ZL14108
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL14108%27 HTTP/1.1" 200 None
2026-03-28 14:04:58 [auto1.es] INFO: Scrape type for ZL14108: 0
2026-03-28 14:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:04:58 [auto1.es] INFO: Channel: 24h | Page: 69 | totalHits: 2696 | hits on page: 0
2026-03-28 14:04:58 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 14:04:58 [auto1.es] INFO: auto1.es Batch config: batch 1/2
2026-03-28 14:04:58 [auto1.es] INFO: auto1.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 12, <ScrapeType.BATCH_SKIPPED: 5>: 26}
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20last_price_update_time%20lt%201774274699 HTTP/1.1" 200 None
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AC43693') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AL09771') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AR09911') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AT27530') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BJ00859') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BK58007') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BP50598') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BV22359') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BW98345') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BY19278') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DB06999') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DG31180') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DG89968') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DU09016') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DU20099') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EH33306') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EM19163') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EV28932') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EX41082') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GF11758') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GZ55862') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HE11547') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HP57253') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JS29355') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KP88823') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KS42658') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KT88109') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KX56487') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KZ55320') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LZ76549') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MV53235') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NM62344') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NS36470') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NU34245') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NV40040') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PK26134') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PS67854') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RB91838') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RE49286') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RK30098') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RZ86538') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TD27524') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TH70586') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TP06770') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TT54114') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TT95397') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UC61578') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UL55614') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UU82636') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VP17889') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VW02721') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VY19292') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WV03551') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WY46745') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XU11405') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZD05403') HTTP/1.1" 204 0
2026-03-28 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZF66065') HTTP/1.1" 204 0
2026-03-28 14:04:59 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (293 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.es/task_21_2026-03-28T14_00_00.jl
2026-03-28 14:04:59 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 960574,
 'downloader/request_count': 551,
 'downloader/request_method_count/GET': 480,
 'downloader/request_method_count/POST': 71,
 'downloader/response_bytes': 44423306,
 'downloader/response_count': 551,
 'downloader/response_status_count/200': 551,
 'dupefilter/filtered': 11,
 'elapsed_time_seconds': 289.281264,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 14, 4, 59, 772135, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 293,
 'log_count/DEBUG': 8017,
 'log_count/INFO': 9328,
 'memusage/max': 181563392,
 'memusage/startup': 150007808,
 'photo_download_count': 372,
 'request_depth_max': 72,
 'response_received_count': 179,
 'scheduler/dequeued': 551,
 'scheduler/dequeued/memory': 551,
 'scheduler/enqueued': 551,
 'scheduler/enqueued/memory': 551,
 'scrape_type/batch_skipped': 1396,
 'scrape_type/new': 53,
 'scrape_type/price_update': 240,
 'scrape_type/skipped': 1036,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 179,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.161763224690926,
 'scrapy-zyte-api/mean_response_seconds': 3.2108909844228335,
 'scrapy-zyte-api/processed': 179,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 179,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 178,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 179,
 'scrapy-zyte-api/request_args/httpRequestBody': 71,
 'scrapy-zyte-api/request_args/httpRequestMethod': 71,
 'scrapy-zyte-api/request_args/httpResponseBody': 179,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 179,
 'scrapy-zyte-api/request_args/sessionContext': 179,
 'scrapy-zyte-api/request_args/url': 179,
 'scrapy-zyte-api/status_codes/200': 179,
 'scrapy-zyte-api/success': 179,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 2736,
 'source/total_available': 2696,
 'start_time': datetime.datetime(2026, 3, 28, 14, 0, 10, 490871, tzinfo=datetime.timezone.utc)}
2026-03-28 14:04:59 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 14:04:59 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7ff16c13e450>
2026-03-28 14:04:59 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7ff16c13e810>