2026-03-30 08:00:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 08:00:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 08:00:04 [auto1.es] INFO: Batch mode enabled: batch 1/2
2026-03-30 08:00:04 [auto1.es] INFO: Starting spider auto1.es
2026-03-30 08:00:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 08:00:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 08:00:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 08:00:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 08:00:04 [scrapy.extensions.telnet] INFO: Telnet Password: a8e664e7996bcb94
2026-03-30 08:00:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 08:00:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.es/task_21_2026-03-30T08_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 08:00:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 08:00:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 08:00:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 08:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 08:00:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 08:00:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 08:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 08:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-30 08:00:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 08:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 08:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 08:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 08:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 08:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 08:00:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 08:00:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 08:00:05 [scrapy.core.engine] INFO: Spider opened
2026-03-30 08:00:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 08:00:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 08:00:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-30 08:00:05 [scrapy-playwright] INFO: Starting download handler
2026-03-30 08:00:05 [scrapy-playwright] INFO: Starting download handler
2026-03-30 08:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 08:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 08:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 08:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 08:00:16 [auto1.es] INFO: Channel: 24h | Page: 0 | totalHits: 2178 | hits on page: 40
2026-03-30 08:00:16 [auto1.es] INFO: Found listing with ID: HU46093
2026-03-30 08:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU46093%27 HTTP/1.1" 200 None
2026-03-30 08:00:16 [auto1.es] INFO: Scrape type for HU46093: 1
2026-03-30 08:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:16 [auto1.es] INFO: Found listing with ID: SP06471
2026-03-30 08:00:16 [auto1.es] INFO: Found listing with ID: ZJ75396
2026-03-30 08:00:16 [auto1.es] INFO: Found listing with ID: MF17439
2026-03-30 08:00:16 [auto1.es] INFO: Found listing with ID: DA93296
2026-03-30 08:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA93296%27 HTTP/1.1" 200 None
2026-03-30 08:00:16 [auto1.es] INFO: Scrape type for DA93296: 2
2026-03-30 08:00:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4bc3b6a-2cc4-572f-a6a7-7bac347fdb35 with identifier: DA93296
2026-03-30 08:00:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4bc3b6a-2cc4-572f-a6a7-7bac347fdb35 with scrape type 2
2026-03-30 08:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4bc3b6a-2cc4-572f-a6a7-7bac347fdb35 with scrape type 2
2026-03-30 08:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a4bc3b6a-2cc4-572f-a6a7-7bac347fdb35, identifier: DA93296
2026-03-30 08:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a4bc3b6a-2cc4-572f-a6a7-7bac347fdb35 with identifier: DA93296
2026-03-30 08:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:00:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 08:00:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:00:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 08:00:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a4bc3b6a-2cc4-572f-a6a7-7bac347fdb35 with identifier: DA93296
2026-03-30 08:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a4bc3b6a-2cc4-572f-a6a7-7bac347fdb35 with identifier: DA93296 to the API
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:54:51Z',
 'fuel_type': 'diesel',
 'id': 'a4bc3b6a-2cc4-572f-a6a7-7bac347fdb35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA93296',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 358193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-28',
 'seller_name': None,
 'title': 'Peugeot 407 2.0 HDi ST Sport',
 'transmission': 'manual',
 'trim': 'ST Sport',
 'year': 2006}
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA93296%27 HTTP/1.1" 200 None
2026-03-30 08:00:17 [auto1.es] INFO: Saving data for DA93296: {'auction_closing_time': 1774972491.0, 'created_time': 1774555388.347278, 'last_price_update_time': 1774857617.594307}
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DA93296') HTTP/1.1" 204 0
2026-03-30 08:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:17 [auto1.es] INFO: Found listing with ID: CW87826
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW87826%27 HTTP/1.1" 200 None
2026-03-30 08:00:17 [auto1.es] INFO: Scrape type for CW87826: 1
2026-03-30 08:00:17 [auto1.es] INFO: Found listing with ID: KZ56767
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ56767%27 HTTP/1.1" 200 None
2026-03-30 08:00:17 [auto1.es] INFO: Scrape type for KZ56767: 2
2026-03-30 08:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b763b2a-464e-5c46-a30b-766ffb3d8963 with identifier: KZ56767
2026-03-30 08:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b763b2a-464e-5c46-a30b-766ffb3d8963 with scrape type 2
2026-03-30 08:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b763b2a-464e-5c46-a30b-766ffb3d8963 with scrape type 2
2026-03-30 08:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b763b2a-464e-5c46-a30b-766ffb3d8963, identifier: KZ56767
2026-03-30 08:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b763b2a-464e-5c46-a30b-766ffb3d8963 with identifier: KZ56767
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 08:00:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:00:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 08:00:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b763b2a-464e-5c46-a30b-766ffb3d8963 with identifier: KZ56767
2026-03-30 08:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b763b2a-464e-5c46-a30b-766ffb3d8963 with identifier: KZ56767 to the API
2026-03-30 08:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:07:36Z',
 'fuel_type': 'petrol',
 'id': '6b763b2a-464e-5c46-a30b-766ffb3d8963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ56767',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 200890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-13',
 'seller_name': None,
 'title': 'Hyundai ix35 1.6 Essence 2WD',
 'transmission': 'manual',
 'trim': 'Essence 2WD',
 'year': 2014}
2026-03-30 08:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ56767%27 HTTP/1.1" 200 None
2026-03-30 08:00:19 [auto1.es] INFO: Saving data for KZ56767: {'auction_closing_time': 1774969656.0, 'created_time': 1773238681.018881, 'last_price_update_time': 1774857619.627723}
2026-03-30 08:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KZ56767') HTTP/1.1" 204 0
2026-03-30 08:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:19 [auto1.es] INFO: Found listing with ID: AB71147
2026-03-30 08:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB71147%27 HTTP/1.1" 200 None
2026-03-30 08:00:19 [auto1.es] INFO: Scrape type for AB71147: 2
2026-03-30 08:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d34d227-f50b-5422-a7dc-416495a4a834 with identifier: AB71147
2026-03-30 08:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d34d227-f50b-5422-a7dc-416495a4a834 with scrape type 2
2026-03-30 08:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d34d227-f50b-5422-a7dc-416495a4a834 with scrape type 2
2026-03-30 08:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d34d227-f50b-5422-a7dc-416495a4a834, identifier: AB71147
2026-03-30 08:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d34d227-f50b-5422-a7dc-416495a4a834 with identifier: AB71147
2026-03-30 08:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:00:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 08:00:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d34d227-f50b-5422-a7dc-416495a4a834 with identifier: AB71147
2026-03-30 08:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d34d227-f50b-5422-a7dc-416495a4a834 with identifier: AB71147 to the API
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:39:18Z',
 'fuel_type': 'diesel',
 'id': '0d34d227-f50b-5422-a7dc-416495a4a834',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB71147',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 106118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-31',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TDI Reference Plus',
 'transmission': 'manual',
 'trim': 'Reference Plus',
 'year': 2017}
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB71147%27 HTTP/1.1" 200 None
2026-03-30 08:00:20 [auto1.es] INFO: Saving data for AB71147: {'auction_closing_time': 1774971558.0, 'created_time': 1774296279.754523, 'last_price_update_time': 1774857620.389022}
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AB71147') HTTP/1.1" 204 0
2026-03-30 08:00:20 [auto1.es] INFO: Found listing with ID: GF89520
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF89520%27 HTTP/1.1" 200 None
2026-03-30 08:00:20 [auto1.es] INFO: Scrape type for GF89520: 1
2026-03-30 08:00:20 [auto1.es] INFO: Found listing with ID: AV31208
2026-03-30 08:00:20 [auto1.es] INFO: Found listing with ID: MZ99822
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ99822%27 HTTP/1.1" 200 None
2026-03-30 08:00:20 [auto1.es] INFO: Scrape type for MZ99822: 2
2026-03-30 08:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e396406-0a87-505f-bb9c-4ead0f3007e4 with identifier: MZ99822
2026-03-30 08:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e396406-0a87-505f-bb9c-4ead0f3007e4 with scrape type 2
2026-03-30 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e396406-0a87-505f-bb9c-4ead0f3007e4 with scrape type 2
2026-03-30 08:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0e396406-0a87-505f-bb9c-4ead0f3007e4, identifier: MZ99822
2026-03-30 08:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0e396406-0a87-505f-bb9c-4ead0f3007e4 with identifier: MZ99822
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 08:00:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0e396406-0a87-505f-bb9c-4ead0f3007e4 with identifier: MZ99822
2026-03-30 08:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0e396406-0a87-505f-bb9c-4ead0f3007e4 with identifier: MZ99822 to the API
2026-03-30 08:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-31T15:48:21Z',
 'fuel_type': 'petrol',
 'id': '0e396406-0a87-505f-bb9c-4ead0f3007e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ99822',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 164649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-29',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 350 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 08:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ99822%27 HTTP/1.1" 200 None
2026-03-30 08:00:22 [auto1.es] INFO: Saving data for MZ99822: {'auction_closing_time': 1774972101.0, 'created_time': 1773345869.283077, 'last_price_update_time': 1774857622.519109}
2026-03-30 08:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MZ99822') HTTP/1.1" 204 0
2026-03-30 08:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:22 [auto1.es] INFO: Found listing with ID: RL18296
2026-03-30 08:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL18296%27 HTTP/1.1" 200 None
2026-03-30 08:00:22 [auto1.es] INFO: Scrape type for RL18296: 2
2026-03-30 08:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a9131ac-9346-5cd1-9c77-f1a8829d1550 with identifier: RL18296
2026-03-30 08:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a9131ac-9346-5cd1-9c77-f1a8829d1550 with scrape type 2
2026-03-30 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a9131ac-9346-5cd1-9c77-f1a8829d1550 with scrape type 2
2026-03-30 08:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9a9131ac-9346-5cd1-9c77-f1a8829d1550, identifier: RL18296
2026-03-30 08:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9a9131ac-9346-5cd1-9c77-f1a8829d1550 with identifier: RL18296
2026-03-30 08:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 08:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9a9131ac-9346-5cd1-9c77-f1a8829d1550 with identifier: RL18296
2026-03-30 08:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9a9131ac-9346-5cd1-9c77-f1a8829d1550 with identifier: RL18296 to the API
2026-03-30 08:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:27:44Z',
 'fuel_type': 'diesel',
 'id': '9a9131ac-9346-5cd1-9c77-f1a8829d1550',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL18296',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 243366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-31',
 'seller_name': None,
 'title': 'Renault Scenic 1.9 dCi Expression Confort',
 'transmission': 'manual',
 'trim': 'Expression Confort',
 'year': 2005}
2026-03-30 08:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL18296%27 HTTP/1.1" 200 None
2026-03-30 08:00:23 [auto1.es] INFO: Saving data for RL18296: {'auction_closing_time': 1774970864.0, 'created_time': 1774350078.360297, 'last_price_update_time': 1774857623.4699}
2026-03-30 08:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RL18296') HTTP/1.1" 204 0
2026-03-30 08:00:23 [auto1.es] INFO: Found listing with ID: BN81239
2026-03-30 08:00:23 [auto1.es] INFO: Found listing with ID: KV37790
2026-03-30 08:00:23 [auto1.es] INFO: Found listing with ID: AP29688
2026-03-30 08:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP29688%27 HTTP/1.1" 200 None
2026-03-30 08:00:23 [auto1.es] INFO: Scrape type for AP29688: 2
2026-03-30 08:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4cc9dd3-c21b-5d22-8079-40f8431a0962 with identifier: AP29688
2026-03-30 08:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4cc9dd3-c21b-5d22-8079-40f8431a0962 with scrape type 2
2026-03-30 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4cc9dd3-c21b-5d22-8079-40f8431a0962 with scrape type 2
2026-03-30 08:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d4cc9dd3-c21b-5d22-8079-40f8431a0962, identifier: AP29688
2026-03-30 08:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d4cc9dd3-c21b-5d22-8079-40f8431a0962 with identifier: AP29688
2026-03-30 08:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d4cc9dd3-c21b-5d22-8079-40f8431a0962 with identifier: AP29688
2026-03-30 08:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d4cc9dd3-c21b-5d22-8079-40f8431a0962 with identifier: AP29688 to the API
2026-03-30 08:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:30:04Z',
 'fuel_type': 'petrol',
 'id': 'd4cc9dd3-c21b-5d22-8079-40f8431a0962',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP29688',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 158213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-23',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 08:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP29688%27 HTTP/1.1" 200 None
2026-03-30 08:00:25 [auto1.es] INFO: Saving data for AP29688: {'auction_closing_time': 1774971004.0, 'created_time': 1774361325.243337, 'last_price_update_time': 1774857625.438671}
2026-03-30 08:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AP29688') HTTP/1.1" 204 0
2026-03-30 08:00:25 [auto1.es] INFO: Found listing with ID: FM74939
2026-03-30 08:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM74939%27 HTTP/1.1" 200 None
2026-03-30 08:00:25 [auto1.es] INFO: Scrape type for FM74939: 2
2026-03-30 08:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7ab37ab-6839-5daf-9baf-af3b2eb5e24c with identifier: FM74939
2026-03-30 08:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ab37ab-6839-5daf-9baf-af3b2eb5e24c with scrape type 2
2026-03-30 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7ab37ab-6839-5daf-9baf-af3b2eb5e24c with scrape type 2
2026-03-30 08:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c7ab37ab-6839-5daf-9baf-af3b2eb5e24c, identifier: FM74939
2026-03-30 08:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c7ab37ab-6839-5daf-9baf-af3b2eb5e24c with identifier: FM74939
2026-03-30 08:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c7ab37ab-6839-5daf-9baf-af3b2eb5e24c with identifier: FM74939
2026-03-30 08:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c7ab37ab-6839-5daf-9baf-af3b2eb5e24c with identifier: FM74939 to the API
2026-03-30 08:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:42:25Z',
 'fuel_type': 'diesel',
 'id': 'c7ab37ab-6839-5daf-9baf-af3b2eb5e24c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM74939',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 161308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-28',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI Chili',
 'transmission': 'manual',
 'trim': 'Chili',
 'year': 2011}
2026-03-30 08:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM74939%27 HTTP/1.1" 200 None
2026-03-30 08:00:26 [auto1.es] INFO: Saving data for FM74939: {'auction_closing_time': 1774971745.0, 'created_time': 1773129449.016526, 'last_price_update_time': 1774857626.990352}
2026-03-30 08:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FM74939') HTTP/1.1" 204 0
2026-03-30 08:00:27 [auto1.es] INFO: Found listing with ID: XS10937
2026-03-30 08:00:27 [auto1.es] INFO: Found listing with ID: MD97530
2026-03-30 08:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD97530%27 HTTP/1.1" 200 None
2026-03-30 08:00:27 [auto1.es] INFO: Scrape type for MD97530: 2
2026-03-30 08:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8721b60-a643-5213-92d4-50024de4a7c0 with identifier: MD97530
2026-03-30 08:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8721b60-a643-5213-92d4-50024de4a7c0 with scrape type 2
2026-03-30 08:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8721b60-a643-5213-92d4-50024de4a7c0 with scrape type 2
2026-03-30 08:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8721b60-a643-5213-92d4-50024de4a7c0, identifier: MD97530
2026-03-30 08:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW87826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU46093/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8721b60-a643-5213-92d4-50024de4a7c0 with identifier: MD97530
2026-03-30 08:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8721b60-a643-5213-92d4-50024de4a7c0 with identifier: MD97530
2026-03-30 08:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c8721b60-a643-5213-92d4-50024de4a7c0 with identifier: MD97530 to the API
2026-03-30 08:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:16:10Z',
 'fuel_type': 'petrol',
 'id': 'c8721b60-a643-5213-92d4-50024de4a7c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD97530',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 56323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-21',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Slam ecoFlex',
 'transmission': 'manual',
 'trim': 'Slam ecoFlex',
 'year': 2016}
2026-03-30 08:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD97530%27 HTTP/1.1" 200 None
2026-03-30 08:00:28 [auto1.es] INFO: Saving data for MD97530: {'auction_closing_time': 1774970170.0, 'created_time': 1774468899.824063, 'last_price_update_time': 1774857628.156882}
2026-03-30 08:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MD97530') HTTP/1.1" 204 0
2026-03-30 08:00:28 [auto1.es] INFO: Found listing with ID: HR79714
2026-03-30 08:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR79714%27 HTTP/1.1" 200 None
2026-03-30 08:00:28 [auto1.es] INFO: Scrape type for HR79714: 1
2026-03-30 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:28 [auto1.es] INFO: Found listing with ID: HA53879
2026-03-30 08:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA53879%27 HTTP/1.1" 200 None
2026-03-30 08:00:28 [auto1.es] INFO: Scrape type for HA53879: 2
2026-03-30 08:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f35af1-fe44-548e-be5e-5d21ea9dc160 with identifier: HA53879
2026-03-30 08:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f35af1-fe44-548e-be5e-5d21ea9dc160 with scrape type 2
2026-03-30 08:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f35af1-fe44-548e-be5e-5d21ea9dc160 with scrape type 2
2026-03-30 08:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 36f35af1-fe44-548e-be5e-5d21ea9dc160, identifier: HA53879
2026-03-30 08:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 36f35af1-fe44-548e-be5e-5d21ea9dc160 with identifier: HA53879
2026-03-30 08:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 36f35af1-fe44-548e-be5e-5d21ea9dc160 with identifier: HA53879
2026-03-30 08:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 36f35af1-fe44-548e-be5e-5d21ea9dc160 with identifier: HA53879 to the API
2026-03-30 08:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:48:13Z',
 'fuel_type': 'diesel',
 'id': '36f35af1-fe44-548e-be5e-5d21ea9dc160',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA53879',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 198687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-11-12',
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI Fresh',
 'transmission': 'manual',
 'trim': 'Fresh',
 'year': 2002}
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA53879%27 HTTP/1.1" 200 None
2026-03-30 08:00:29 [auto1.es] INFO: Saving data for HA53879: {'auction_closing_time': 1774972093.0, 'created_time': 1773132084.059195, 'last_price_update_time': 1774857629.082274}
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HA53879') HTTP/1.1" 204 0
2026-03-30 08:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:29 [auto1.es] INFO: Found listing with ID: NA38669
2026-03-30 08:00:29 [auto1.es] INFO: Found listing with ID: ZM37153
2026-03-30 08:00:29 [auto1.es] INFO: Found listing with ID: RS33188
2026-03-30 08:00:29 [auto1.es] INFO: Found listing with ID: ZE40464
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE40464%27 HTTP/1.1" 200 None
2026-03-30 08:00:29 [auto1.es] INFO: Scrape type for ZE40464: 1
2026-03-30 08:00:29 [auto1.es] INFO: Found listing with ID: SF77258
2026-03-30 08:00:29 [auto1.es] INFO: Found listing with ID: VK08624
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK08624%27 HTTP/1.1" 200 None
2026-03-30 08:00:29 [auto1.es] INFO: Scrape type for VK08624: 2
2026-03-30 08:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ece19d-f0c7-5445-af0f-9c4db1445e2c with identifier: VK08624
2026-03-30 08:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ece19d-f0c7-5445-af0f-9c4db1445e2c with scrape type 2
2026-03-30 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7ece19d-f0c7-5445-af0f-9c4db1445e2c with scrape type 2
2026-03-30 08:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7ece19d-f0c7-5445-af0f-9c4db1445e2c, identifier: VK08624
2026-03-30 08:00:29 [auto1.es] INFO: Channel: 24h | Page: 1 | totalHits: 2178 | hits on page: 40
2026-03-30 08:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7ece19d-f0c7-5445-af0f-9c4db1445e2c with identifier: VK08624
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 08:00:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7ece19d-f0c7-5445-af0f-9c4db1445e2c with identifier: VK08624
2026-03-30 08:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e7ece19d-f0c7-5445-af0f-9c4db1445e2c with identifier: VK08624 to the API
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:48:29Z',
 'fuel_type': 'petrol',
 'id': 'e7ece19d-f0c7-5445-af0f-9c4db1445e2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK08624',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 94925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-13',
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2019}
2026-03-30 08:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK08624%27 HTTP/1.1" 200 None
2026-03-30 08:00:30 [auto1.es] INFO: Saving data for VK08624: {'auction_closing_time': 1774972109.0, 'created_time': 1774447292.014541, 'last_price_update_time': 1774857630.07422}
2026-03-30 08:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VK08624') HTTP/1.1" 204 0
2026-03-30 08:00:30 [auto1.es] INFO: Found listing with ID: BF57593
2026-03-30 08:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF57593%27 HTTP/1.1" 200 None
2026-03-30 08:00:30 [auto1.es] INFO: Scrape type for BF57593: 2
2026-03-30 08:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54a26fea-a6ad-5855-aa64-26ad1c640dd7 with identifier: BF57593
2026-03-30 08:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54a26fea-a6ad-5855-aa64-26ad1c640dd7 with scrape type 2
2026-03-30 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54a26fea-a6ad-5855-aa64-26ad1c640dd7 with scrape type 2
2026-03-30 08:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 54a26fea-a6ad-5855-aa64-26ad1c640dd7, identifier: BF57593
2026-03-30 08:00:30 [auto1.es] INFO: Found listing with ID: HU46093
2026-03-30 08:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 54a26fea-a6ad-5855-aa64-26ad1c640dd7 with identifier: BF57593
2026-03-30 08:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 54a26fea-a6ad-5855-aa64-26ad1c640dd7 with identifier: BF57593
2026-03-30 08:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 54a26fea-a6ad-5855-aa64-26ad1c640dd7 with identifier: BF57593 to the API
2026-03-30 08:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:50:45Z',
 'fuel_type': 'petrol',
 'id': '54a26fea-a6ad-5855-aa64-26ad1c640dd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF57593',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 220308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-27',
 'seller_name': None,
 'title': 'Volvo C30 2.0 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2009}
2026-03-30 08:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF57593%27 HTTP/1.1" 200 None
2026-03-30 08:00:31 [auto1.es] INFO: Saving data for BF57593: {'auction_closing_time': 1774972245.0, 'created_time': 1773129398.462946, 'last_price_update_time': 1774857631.120851}
2026-03-30 08:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BF57593') HTTP/1.1" 204 0
2026-03-30 08:00:31 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/HU46093/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 08:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF89520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:31 [auto1.es] INFO: Found listing with ID: BM87438
2026-03-30 08:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM87438%27 HTTP/1.1" 200 None
2026-03-30 08:00:31 [auto1.es] INFO: Scrape type for BM87438: 2
2026-03-30 08:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f3b20fa-3133-5bc0-b641-36d1078c1319 with identifier: BM87438
2026-03-30 08:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f3b20fa-3133-5bc0-b641-36d1078c1319 with scrape type 2
2026-03-30 08:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f3b20fa-3133-5bc0-b641-36d1078c1319 with scrape type 2
2026-03-30 08:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f3b20fa-3133-5bc0-b641-36d1078c1319, identifier: BM87438
2026-03-30 08:00:31 [auto1.es] INFO: Found listing with ID: SP06471
2026-03-30 08:00:31 [auto1.es] INFO: Found listing with ID: ZJ75396
2026-03-30 08:00:31 [auto1.es] INFO: Found listing with ID: MF17439
2026-03-30 08:00:31 [auto1.es] INFO: Found listing with ID: DA93296
2026-03-30 08:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA93296%27 HTTP/1.1" 200 None
2026-03-30 08:00:31 [auto1.es] INFO: Scrape type for DA93296: 0
2026-03-30 08:00:31 [auto1.es] INFO: Found listing with ID: CW87826
2026-03-30 08:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f3b20fa-3133-5bc0-b641-36d1078c1319 with identifier: BM87438
2026-03-30 08:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f3b20fa-3133-5bc0-b641-36d1078c1319 with identifier: BM87438
2026-03-30 08:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f3b20fa-3133-5bc0-b641-36d1078c1319 with identifier: BM87438 to the API
2026-03-30 08:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:36:43Z',
 'fuel_type': 'petrol',
 'id': '2f3b20fa-3133-5bc0-b641-36d1078c1319',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM87438',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 115755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-30 08:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM87438%27 HTTP/1.1" 200 None
2026-03-30 08:00:32 [auto1.es] INFO: Saving data for BM87438: {'auction_closing_time': 1774971403.0, 'created_time': 1774447275.580135, 'last_price_update_time': 1774857632.159269}
2026-03-30 08:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BM87438') HTTP/1.1" 204 0
2026-03-30 08:00:32 [auto1.es] INFO: Found listing with ID: CP82441
2026-03-30 08:00:32 [auto1.es] INFO: Found listing with ID: BP19687
2026-03-30 08:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP19687%27 HTTP/1.1" 200 None
2026-03-30 08:00:32 [auto1.es] INFO: Scrape type for BP19687: 2
2026-03-30 08:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 017714b1-28f9-5372-beea-b1326b406e5a with identifier: BP19687
2026-03-30 08:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 017714b1-28f9-5372-beea-b1326b406e5a with scrape type 2
2026-03-30 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 017714b1-28f9-5372-beea-b1326b406e5a with scrape type 2
2026-03-30 08:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 017714b1-28f9-5372-beea-b1326b406e5a, identifier: BP19687
2026-03-30 08:00:32 [auto1.es] INFO: Found listing with ID: KZ56767
2026-03-30 08:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ56767%27 HTTP/1.1" 200 None
2026-03-30 08:00:32 [auto1.es] INFO: Scrape type for KZ56767: 0
2026-03-30 08:00:32 [auto1.es] INFO: Found listing with ID: AB71147
2026-03-30 08:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB71147%27 HTTP/1.1" 200 None
2026-03-30 08:00:32 [auto1.es] INFO: Scrape type for AB71147: 0
2026-03-30 08:00:32 [auto1.es] INFO: Found listing with ID: GF89520
2026-03-30 08:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 017714b1-28f9-5372-beea-b1326b406e5a with identifier: BP19687
2026-03-30 08:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 017714b1-28f9-5372-beea-b1326b406e5a with identifier: BP19687
2026-03-30 08:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 017714b1-28f9-5372-beea-b1326b406e5a with identifier: BP19687 to the API
2026-03-30 08:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:06:04Z',
 'fuel_type': 'diesel',
 'id': '017714b1-28f9-5372-beea-b1326b406e5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP19687',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 253352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-31',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Pack Dynamique',
 'transmission': 'manual',
 'trim': 'Pack Dynamique',
 'year': 2004}
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP19687%27 HTTP/1.1" 200 None
2026-03-30 08:00:33 [auto1.es] INFO: Saving data for BP19687: {'auction_closing_time': 1774969564.0, 'created_time': 1774274573.79218, 'last_price_update_time': 1774857633.188788}
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BP19687') HTTP/1.1" 204 0
2026-03-30 08:00:33 [auto1.es] INFO: Found listing with ID: CP16982
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP16982%27 HTTP/1.1" 200 None
2026-03-30 08:00:33 [auto1.es] INFO: Scrape type for CP16982: 2
2026-03-30 08:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6af89766-7bfc-5c4b-a911-2bb2a61f1f93 with identifier: CP16982
2026-03-30 08:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6af89766-7bfc-5c4b-a911-2bb2a61f1f93 with scrape type 2
2026-03-30 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6af89766-7bfc-5c4b-a911-2bb2a61f1f93 with scrape type 2
2026-03-30 08:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6af89766-7bfc-5c4b-a911-2bb2a61f1f93, identifier: CP16982
2026-03-30 08:00:33 [auto1.es] INFO: Found listing with ID: AV31208
2026-03-30 08:00:33 [auto1.es] INFO: Found listing with ID: MZ99822
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ99822%27 HTTP/1.1" 200 None
2026-03-30 08:00:33 [auto1.es] INFO: Scrape type for MZ99822: 0
2026-03-30 08:00:33 [auto1.es] INFO: Found listing with ID: RL18296
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL18296%27 HTTP/1.1" 200 None
2026-03-30 08:00:33 [auto1.es] INFO: Scrape type for RL18296: 0
2026-03-30 08:00:33 [auto1.es] INFO: Found listing with ID: BN81239
2026-03-30 08:00:33 [auto1.es] INFO: Found listing with ID: KV37790
2026-03-30 08:00:33 [auto1.es] INFO: Found listing with ID: AP29688
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP29688%27 HTTP/1.1" 200 None
2026-03-30 08:00:33 [auto1.es] INFO: Scrape type for AP29688: 0
2026-03-30 08:00:33 [auto1.es] INFO: Found listing with ID: FM74939
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM74939%27 HTTP/1.1" 200 None
2026-03-30 08:00:33 [auto1.es] INFO: Scrape type for FM74939: 0
2026-03-30 08:00:33 [auto1.es] INFO: Found listing with ID: XS10937
2026-03-30 08:00:33 [auto1.es] INFO: Found listing with ID: MD97530
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD97530%27 HTTP/1.1" 200 None
2026-03-30 08:00:33 [auto1.es] INFO: Scrape type for MD97530: 0
2026-03-30 08:00:33 [auto1.es] INFO: Found listing with ID: HR79714
2026-03-30 08:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6af89766-7bfc-5c4b-a911-2bb2a61f1f93 with identifier: CP16982
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 08:00:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6af89766-7bfc-5c4b-a911-2bb2a61f1f93 with identifier: CP16982
2026-03-30 08:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6af89766-7bfc-5c4b-a911-2bb2a61f1f93 with identifier: CP16982 to the API
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 106,
 'expiration_date': '2026-03-31T15:47:30Z',
 'fuel_type': 'gas',
 'id': '6af89766-7bfc-5c4b-a911-2bb2a61f1f93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP16982',
 'listing': 'auction',
 'make': 'EVO',
 'model': '4',
 'odometer': 28913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-19',
 'seller_name': None,
 'title': 'EVO 4 1.6 LPG',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP16982%27 HTTP/1.1" 200 None
2026-03-30 08:00:34 [auto1.es] INFO: Saving data for CP16982: {'auction_closing_time': 1774972050.0, 'created_time': 1774641845.869036, 'last_price_update_time': 1774857634.115579}
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CP16982') HTTP/1.1" 204 0
2026-03-30 08:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:34 [auto1.es] INFO: Found listing with ID: XG07152
2026-03-30 08:00:34 [auto1.es] INFO: Found listing with ID: LL26626
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL26626%27 HTTP/1.1" 200 None
2026-03-30 08:00:34 [auto1.es] INFO: Scrape type for LL26626: 2
2026-03-30 08:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f95aac1-6911-5a2d-9ab8-d6c21eac48cf with identifier: LL26626
2026-03-30 08:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f95aac1-6911-5a2d-9ab8-d6c21eac48cf with scrape type 2
2026-03-30 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f95aac1-6911-5a2d-9ab8-d6c21eac48cf with scrape type 2
2026-03-30 08:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f95aac1-6911-5a2d-9ab8-d6c21eac48cf, identifier: LL26626
2026-03-30 08:00:34 [auto1.es] INFO: Found listing with ID: HA53879
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA53879%27 HTTP/1.1" 200 None
2026-03-30 08:00:34 [auto1.es] INFO: Scrape type for HA53879: 0
2026-03-30 08:00:34 [auto1.es] INFO: Found listing with ID: NA38669
2026-03-30 08:00:34 [auto1.es] INFO: Found listing with ID: ZM37153
2026-03-30 08:00:34 [auto1.es] INFO: Found listing with ID: RS33188
2026-03-30 08:00:34 [auto1.es] INFO: Found listing with ID: ZE40464
2026-03-30 08:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f95aac1-6911-5a2d-9ab8-d6c21eac48cf with identifier: LL26626
2026-03-30 08:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f95aac1-6911-5a2d-9ab8-d6c21eac48cf with identifier: LL26626
2026-03-30 08:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f95aac1-6911-5a2d-9ab8-d6c21eac48cf with identifier: LL26626 to the API
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:40:28Z',
 'fuel_type': 'petrol',
 'id': '6f95aac1-6911-5a2d-9ab8-d6c21eac48cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL26626',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 83446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-28',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL26626%27 HTTP/1.1" 200 None
2026-03-30 08:00:34 [auto1.es] INFO: Saving data for LL26626: {'auction_closing_time': 1774971628.0, 'created_time': 1774447273.616202, 'last_price_update_time': 1774857634.794888}
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LL26626') HTTP/1.1" 204 0
2026-03-30 08:00:34 [auto1.es] INFO: Found listing with ID: DA17068
2026-03-30 08:00:34 [auto1.es] INFO: Found listing with ID: HK75891
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK75891%27 HTTP/1.1" 200 None
2026-03-30 08:00:34 [auto1.es] INFO: Scrape type for HK75891: 2
2026-03-30 08:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba173c33-0641-52e6-96c7-9d8e1c3e302c with identifier: HK75891
2026-03-30 08:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba173c33-0641-52e6-96c7-9d8e1c3e302c with scrape type 2
2026-03-30 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba173c33-0641-52e6-96c7-9d8e1c3e302c with scrape type 2
2026-03-30 08:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ba173c33-0641-52e6-96c7-9d8e1c3e302c, identifier: HK75891
2026-03-30 08:00:34 [auto1.es] INFO: Found listing with ID: SF77258
2026-03-30 08:00:34 [auto1.es] INFO: Found listing with ID: VK08624
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK08624%27 HTTP/1.1" 200 None
2026-03-30 08:00:35 [auto1.es] INFO: Scrape type for VK08624: 0
2026-03-30 08:00:35 [auto1.es] INFO: Found listing with ID: BF57593
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF57593%27 HTTP/1.1" 200 None
2026-03-30 08:00:35 [auto1.es] INFO: Scrape type for BF57593: 0
2026-03-30 08:00:35 [auto1.es] INFO: Found listing with ID: BM87438
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM87438%27 HTTP/1.1" 200 None
2026-03-30 08:00:35 [auto1.es] INFO: Scrape type for BM87438: 0
2026-03-30 08:00:35 [auto1.es] INFO: Found listing with ID: CP82441
2026-03-30 08:00:35 [auto1.es] INFO: Found listing with ID: BP19687
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP19687%27 HTTP/1.1" 200 None
2026-03-30 08:00:35 [auto1.es] INFO: Scrape type for BP19687: 0
2026-03-30 08:00:35 [auto1.es] INFO: Found listing with ID: CP16982
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP16982%27 HTTP/1.1" 200 None
2026-03-30 08:00:35 [auto1.es] INFO: Scrape type for CP16982: 0
2026-03-30 08:00:35 [auto1.es] INFO: Found listing with ID: XG07152
2026-03-30 08:00:35 [auto1.es] INFO: Found listing with ID: LL26626
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL26626%27 HTTP/1.1" 200 None
2026-03-30 08:00:35 [auto1.es] INFO: Scrape type for LL26626: 0
2026-03-30 08:00:35 [auto1.es] INFO: Found listing with ID: DA17068
2026-03-30 08:00:35 [auto1.es] INFO: Found listing with ID: HK75891
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK75891%27 HTTP/1.1" 200 None
2026-03-30 08:00:35 [auto1.es] INFO: Scrape type for HK75891: 2
2026-03-30 08:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba173c33-0641-52e6-96c7-9d8e1c3e302c with scrape type 2
2026-03-30 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba173c33-0641-52e6-96c7-9d8e1c3e302c with scrape type 2
2026-03-30 08:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ba173c33-0641-52e6-96c7-9d8e1c3e302c, identifier: HK75891
2026-03-30 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR79714/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE40464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ba173c33-0641-52e6-96c7-9d8e1c3e302c with identifier: HK75891
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 08:00:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ba173c33-0641-52e6-96c7-9d8e1c3e302c with identifier: HK75891
2026-03-30 08:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ba173c33-0641-52e6-96c7-9d8e1c3e302c with identifier: HK75891 to the API
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:19:50Z',
 'fuel_type': 'diesel',
 'id': 'ba173c33-0641-52e6-96c7-9d8e1c3e302c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK75891',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 267301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'Honda CR-V 2.2 DTEC Elegance 4WD',
 'transmission': 'manual',
 'trim': 'Elegance 4WD',
 'year': 2013}
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK75891%27 HTTP/1.1" 200 None
2026-03-30 08:00:35 [auto1.es] INFO: Saving data for HK75891: {'auction_closing_time': 1774970390.0, 'created_time': 1773131441.489776, 'last_price_update_time': 1774857635.786126}
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HK75891') HTTP/1.1" 204 0
2026-03-30 08:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ba173c33-0641-52e6-96c7-9d8e1c3e302c with identifier: HK75891
2026-03-30 08:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ba173c33-0641-52e6-96c7-9d8e1c3e302c with identifier: HK75891
2026-03-30 08:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ba173c33-0641-52e6-96c7-9d8e1c3e302c with identifier: HK75891 to the API
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:19:50Z',
 'fuel_type': 'diesel',
 'id': 'ba173c33-0641-52e6-96c7-9d8e1c3e302c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK75891',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 267301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'Honda CR-V 2.2 DTEC Elegance 4WD',
 'transmission': 'manual',
 'trim': 'Elegance 4WD',
 'year': 2013}
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK75891%27 HTTP/1.1" 200 None
2026-03-30 08:00:36 [auto1.es] INFO: Saving data for HK75891: {'auction_closing_time': 1774970390.0, 'created_time': 1773131441.489776, 'last_price_update_time': 1774857636.239357}
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HK75891') HTTP/1.1" 204 0
2026-03-30 08:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW87826> (referer: https://www.auto1.com/v1/car-details-view/CW87826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:36 [auto1.es] INFO: Found listing with ID: SN19973
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN19973%27 HTTP/1.1" 200 None
2026-03-30 08:00:36 [auto1.es] INFO: Scrape type for SN19973: 2
2026-03-30 08:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8f0886a-a190-5d1e-b4be-0d9e588f6863 with identifier: SN19973
2026-03-30 08:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f0886a-a190-5d1e-b4be-0d9e588f6863 with scrape type 2
2026-03-30 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8f0886a-a190-5d1e-b4be-0d9e588f6863 with scrape type 2
2026-03-30 08:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d8f0886a-a190-5d1e-b4be-0d9e588f6863, identifier: SN19973
2026-03-30 08:00:36 [auto1.es] INFO: Found listing with ID: SN19973
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN19973%27 HTTP/1.1" 200 None
2026-03-30 08:00:36 [auto1.es] INFO: Scrape type for SN19973: 2
2026-03-30 08:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f0886a-a190-5d1e-b4be-0d9e588f6863 with scrape type 2
2026-03-30 08:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8f0886a-a190-5d1e-b4be-0d9e588f6863 with scrape type 2
2026-03-30 08:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d8f0886a-a190-5d1e-b4be-0d9e588f6863, identifier: SN19973
2026-03-30 08:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d8f0886a-a190-5d1e-b4be-0d9e588f6863 with identifier: SN19973
2026-03-30 08:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d8f0886a-a190-5d1e-b4be-0d9e588f6863 with identifier: SN19973
2026-03-30 08:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d8f0886a-a190-5d1e-b4be-0d9e588f6863 with identifier: SN19973 to the API
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:16:15Z',
 'fuel_type': 'diesel',
 'id': 'd8f0886a-a190-5d1e-b4be-0d9e588f6863',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN19973',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 417923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-11',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2008}
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN19973%27 HTTP/1.1" 200 None
2026-03-30 08:00:36 [auto1.es] INFO: Saving data for SN19973: {'auction_closing_time': 1774970175.0, 'created_time': 1774263681.840022, 'last_price_update_time': 1774857636.861792}
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SN19973') HTTP/1.1" 204 0
2026-03-30 08:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d8f0886a-a190-5d1e-b4be-0d9e588f6863 with identifier: SN19973
2026-03-30 08:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d8f0886a-a190-5d1e-b4be-0d9e588f6863 with identifier: SN19973
2026-03-30 08:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d8f0886a-a190-5d1e-b4be-0d9e588f6863 with identifier: SN19973 to the API
2026-03-30 08:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:16:15Z',
 'fuel_type': 'diesel',
 'id': 'd8f0886a-a190-5d1e-b4be-0d9e588f6863',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN19973',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 417923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-11',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2008}
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN19973%27 HTTP/1.1" 200 None
2026-03-30 08:00:37 [auto1.es] INFO: Saving data for SN19973: {'auction_closing_time': 1774970175.0, 'created_time': 1774263681.840022, 'last_price_update_time': 1774857637.156519}
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SN19973') HTTP/1.1" 204 0
2026-03-30 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU46093> (referer: https://www.auto1.com/v1/car-details-view/HU46093/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:37 [auto1.es] INFO: Found listing with ID: NN48613
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN48613%27 HTTP/1.1" 200 None
2026-03-30 08:00:37 [auto1.es] INFO: Scrape type for NN48613: 2
2026-03-30 08:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6 with identifier: NN48613
2026-03-30 08:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6 with scrape type 2
2026-03-30 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6 with scrape type 2
2026-03-30 08:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6, identifier: NN48613
2026-03-30 08:00:37 [auto1.es] INFO: Found listing with ID: NN48613
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN48613%27 HTTP/1.1" 200 None
2026-03-30 08:00:37 [auto1.es] INFO: Scrape type for NN48613: 2
2026-03-30 08:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6 with scrape type 2
2026-03-30 08:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6 with scrape type 2
2026-03-30 08:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6, identifier: NN48613
2026-03-30 08:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6 with identifier: NN48613
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 08:00:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6 with identifier: NN48613
2026-03-30 08:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6 with identifier: NN48613 to the API
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:47:54Z',
 'fuel_type': 'petrol',
 'id': '47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN48613',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 128160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-29',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2012}
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN48613%27 HTTP/1.1" 200 None
2026-03-30 08:00:37 [auto1.es] INFO: Saving data for NN48613: {'auction_closing_time': 1774972074.0, 'created_time': 1774037147.664178, 'last_price_update_time': 1774857637.949781}
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NN48613') HTTP/1.1" 204 0
2026-03-30 08:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6 with identifier: NN48613
2026-03-30 08:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6 with identifier: NN48613
2026-03-30 08:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6 with identifier: NN48613 to the API
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:47:54Z',
 'fuel_type': 'petrol',
 'id': '47a21bd1-fa01-5d02-a57f-c2ee8ee2f7a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN48613',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 128160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-29',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2012}
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN48613%27 HTTP/1.1" 200 None
2026-03-30 08:00:38 [auto1.es] INFO: Saving data for NN48613: {'auction_closing_time': 1774972074.0, 'created_time': 1774037147.664178, 'last_price_update_time': 1774857638.287549}
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NN48613') HTTP/1.1" 204 0
2026-03-30 08:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee8b6763-f5bb-5655-b037-5a3a7f4ab42d with identifier: CW87826
2026-03-30 08:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d with scrape type 1
2026-03-30 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_782cb567136eaa2f2778da3c89fe3062.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_782cb567136eaa2f2778da3c89fe3062.jpg not downloaded yet
2026-03-30 08:00:38 [auto1.es] INFO: Found listing with ID: DM10276
2026-03-30 08:00:38 [auto1.es] INFO: Found listing with ID: FA27272
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA27272%27 HTTP/1.1" 200 None
2026-03-30 08:00:38 [auto1.es] INFO: Scrape type for FA27272: 2
2026-03-30 08:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 424602b9-39b8-569d-b3a1-419ed6ae843c with identifier: FA27272
2026-03-30 08:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 424602b9-39b8-569d-b3a1-419ed6ae843c with scrape type 2
2026-03-30 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 424602b9-39b8-569d-b3a1-419ed6ae843c with scrape type 2
2026-03-30 08:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 424602b9-39b8-569d-b3a1-419ed6ae843c, identifier: FA27272
2026-03-30 08:00:38 [auto1.es] INFO: Found listing with ID: DM10276
2026-03-30 08:00:38 [auto1.es] INFO: Found listing with ID: FA27272
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA27272%27 HTTP/1.1" 200 None
2026-03-30 08:00:38 [auto1.es] INFO: Scrape type for FA27272: 2
2026-03-30 08:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 424602b9-39b8-569d-b3a1-419ed6ae843c with scrape type 2
2026-03-30 08:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 424602b9-39b8-569d-b3a1-419ed6ae843c with scrape type 2
2026-03-30 08:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 424602b9-39b8-569d-b3a1-419ed6ae843c, identifier: FA27272
2026-03-30 08:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 424602b9-39b8-569d-b3a1-419ed6ae843c with identifier: FA27272
2026-03-30 08:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 424602b9-39b8-569d-b3a1-419ed6ae843c with identifier: FA27272
2026-03-30 08:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 424602b9-39b8-569d-b3a1-419ed6ae843c with identifier: FA27272 to the API
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:02:22Z',
 'fuel_type': 'diesel',
 'id': '424602b9-39b8-569d-b3a1-419ed6ae843c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA27272',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 247370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA27272%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [auto1.es] INFO: Saving data for FA27272: {'auction_closing_time': 1774969342.0, 'created_time': 1774436518.053232, 'last_price_update_time': 1774857639.042747}
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FA27272') HTTP/1.1" 204 0
2026-03-30 08:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 424602b9-39b8-569d-b3a1-419ed6ae843c with identifier: FA27272
2026-03-30 08:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 424602b9-39b8-569d-b3a1-419ed6ae843c with identifier: FA27272
2026-03-30 08:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 424602b9-39b8-569d-b3a1-419ed6ae843c with identifier: FA27272 to the API
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:02:22Z',
 'fuel_type': 'diesel',
 'id': '424602b9-39b8-569d-b3a1-419ed6ae843c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA27272',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 247370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA27272%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [auto1.es] INFO: Saving data for FA27272: {'auction_closing_time': 1774969342.0, 'created_time': 1774436518.053232, 'last_price_update_time': 1774857639.358837}
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FA27272') HTTP/1.1" 204 0
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_f5103546c336caa2988e4a42bb2fca2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_f5103546c336caa2988e4a42bb2fca2b.jpg not downloaded yet
2026-03-30 08:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31b7c214-386c-59b5-8f99-69d45a5e5222 with identifier: HU46093
2026-03-30 08:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31b7c214-386c-59b5-8f99-69d45a5e5222 with scrape type 1
2026-03-30 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31b7c214-386c-59b5-8f99-69d45a5e5222
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fca%252Fc7ca92460ebd0759c1353b07a6166ec4%252Fpa%252FHU46093_a285a1f4c70455374a70349efa272796.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_a285a1f4c70455374a70349efa272796.jpg already downloaded
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fca%252Fc7ca92460ebd0759c1353b07a6166ec4%252Fpa%252FHU46093_6ea6acec8ae90c0d290c1f90ec6fd0ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_6ea6acec8ae90c0d290c1f90ec6fd0ca.jpg already downloaded
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fca%252Fc7ca92460ebd0759c1353b07a6166ec4%252Fpa%252FHU46093_5730f9d2970ebdbd5c71adbef6775947.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_5730f9d2970ebdbd5c71adbef6775947.jpg already downloaded
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fca%252Fc7ca92460ebd0759c1353b07a6166ec4%252Fpa%252FHU46093_5960058ba7ceb49681f69035f27f1524.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_5960058ba7ceb49681f69035f27f1524.jpg already downloaded
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fca%252Fc7ca92460ebd0759c1353b07a6166ec4%252Fpa%252FHU46093_a3272b5efc08c97a9e13d533a623007c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_a3272b5efc08c97a9e13d533a623007c.jpg already downloaded
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fca%252Fc7ca92460ebd0759c1353b07a6166ec4%252Fpa%252FHU46093_0a9551f2d612d21b178853ef129c0992.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_0a9551f2d612d21b178853ef129c0992.jpg already downloaded
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fca%252Fc7ca92460ebd0759c1353b07a6166ec4%252Fpa%252FHU46093_0f0bb2590429d238f463d259409cad50.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_0f0bb2590429d238f463d259409cad50.jpg already downloaded
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fca%252Fc7ca92460ebd0759c1353b07a6166ec4%252Fpa%252FHU46093_4fa8a34ff39db58d8d302fb247094d08.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_4fa8a34ff39db58d8d302fb247094d08.jpg already downloaded
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fca%252Fc7ca92460ebd0759c1353b07a6166ec4%252Fpa%252FHU46093_71dbb534539b3a42ae6ae61ecf32d6cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_71dbb534539b3a42ae6ae61ecf32d6cf.jpg already downloaded
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fca%252Fc7ca92460ebd0759c1353b07a6166ec4%252Fpa%252FHU46093_9086bbc72c0bdaa93ac0884c60901a82.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_9086bbc72c0bdaa93ac0884c60901a82.jpg already downloaded
2026-03-30 08:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 31b7c214-386c-59b5-8f99-69d45a5e5222, identifier: HU46093
2026-03-30 08:00:39 [auto1.es] INFO: Channel: 24h | Page: 2 | totalHits: 2178 | hits on page: 40
2026-03-30 08:00:39 [auto1.es] INFO: Found listing with ID: MS32637
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS32637%27 HTTP/1.1" 200 None
2026-03-30 08:00:39 [auto1.es] INFO: Scrape type for MS32637: 1
2026-03-30 08:00:39 [auto1.es] INFO: Found listing with ID: MS32637
2026-03-30 08:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 31b7c214-386c-59b5-8f99-69d45a5e5222 with identifier: HU46093
2026-03-30 08:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 31b7c214-386c-59b5-8f99-69d45a5e5222 with identifier: HU46093
2026-03-30 08:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 31b7c214-386c-59b5-8f99-69d45a5e5222 with identifier: HU46093 to the API
2026-03-30 08:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HU46093>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:08:36Z',
 'fuel_type': 'diesel',
 'id': '31b7c214-386c-59b5-8f99-69d45a5e5222',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU46093',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'BMW',
 'model': '1er',
 'odometer': 167402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_a285a1f4c70455374a70349efa272796.jpg',
                'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_6ea6acec8ae90c0d290c1f90ec6fd0ca.jpg',
                'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_5730f9d2970ebdbd5c71adbef6775947.jpg',
                'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_5960058ba7ceb49681f69035f27f1524.jpg',
                'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_a3272b5efc08c97a9e13d533a623007c.jpg',
                'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_0a9551f2d612d21b178853ef129c0992.jpg',
                'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_0f0bb2590429d238f463d259409cad50.jpg',
                'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_4fa8a34ff39db58d8d302fb247094d08.jpg',
                'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_71dbb534539b3a42ae6ae61ecf32d6cf.jpg',
                'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_9086bbc72c0bdaa93ac0884c60901a82.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b7c214-386c-59b5-8f99-69d45a5e5222/31b7c214-386c-59b5-8f99-69d45a5e5222_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_a285a1f4c70455374a70349efa272796.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b7c214-386c-59b5-8f99-69d45a5e5222/31b7c214-386c-59b5-8f99-69d45a5e5222_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_6ea6acec8ae90c0d290c1f90ec6fd0ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b7c214-386c-59b5-8f99-69d45a5e5222/31b7c214-386c-59b5-8f99-69d45a5e5222_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_5730f9d2970ebdbd5c71adbef6775947.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b7c214-386c-59b5-8f99-69d45a5e5222/31b7c214-386c-59b5-8f99-69d45a5e5222_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_5960058ba7ceb49681f69035f27f1524.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b7c214-386c-59b5-8f99-69d45a5e5222/31b7c214-386c-59b5-8f99-69d45a5e5222_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_a3272b5efc08c97a9e13d533a623007c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b7c214-386c-59b5-8f99-69d45a5e5222/31b7c214-386c-59b5-8f99-69d45a5e5222_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_0a9551f2d612d21b178853ef129c0992.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b7c214-386c-59b5-8f99-69d45a5e5222/31b7c214-386c-59b5-8f99-69d45a5e5222_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_0f0bb2590429d238f463d259409cad50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b7c214-386c-59b5-8f99-69d45a5e5222/31b7c214-386c-59b5-8f99-69d45a5e5222_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_4fa8a34ff39db58d8d302fb247094d08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b7c214-386c-59b5-8f99-69d45a5e5222/31b7c214-386c-59b5-8f99-69d45a5e5222_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_71dbb534539b3a42ae6ae61ecf32d6cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b7c214-386c-59b5-8f99-69d45a5e5222/31b7c214-386c-59b5-8f99-69d45a5e5222_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/ca/c7ca92460ebd0759c1353b07a6166ec4/pa/HU46093_9086bbc72c0bdaa93ac0884c60901a82.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU46093%27 HTTP/1.1" 200 None
2026-03-30 08:00:40 [auto1.es] INFO: Saving data for HU46093: {'created_time': 1774857640.173878, 'last_price_update_time': 1774857640.17389, 'auction_closing_time': 1774969716.0}
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HU46093') HTTP/1.1" 204 0
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_a48ac4460f0f47e30a752663a19245c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_a48ac4460f0f47e30a752663a19245c6.jpg not downloaded yet
2026-03-30 08:00:40 [auto1.es] INFO: Found listing with ID: MR15790
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR15790%27 HTTP/1.1" 200 None
2026-03-30 08:00:40 [auto1.es] INFO: Scrape type for MR15790: 2
2026-03-30 08:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c20243b-2bb5-5e8c-9899-e64b34800604 with identifier: MR15790
2026-03-30 08:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c20243b-2bb5-5e8c-9899-e64b34800604 with scrape type 2
2026-03-30 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c20243b-2bb5-5e8c-9899-e64b34800604 with scrape type 2
2026-03-30 08:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7c20243b-2bb5-5e8c-9899-e64b34800604, identifier: MR15790
2026-03-30 08:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7c20243b-2bb5-5e8c-9899-e64b34800604 with identifier: MR15790
2026-03-30 08:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7c20243b-2bb5-5e8c-9899-e64b34800604 with identifier: MR15790
2026-03-30 08:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7c20243b-2bb5-5e8c-9899-e64b34800604 with identifier: MR15790 to the API
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:58:51Z',
 'fuel_type': 'diesel',
 'id': '7c20243b-2bb5-5e8c-9899-e64b34800604',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR15790',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 103626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-21',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR15790%27 HTTP/1.1" 200 None
2026-03-30 08:00:40 [auto1.es] INFO: Saving data for MR15790: {'auction_closing_time': 1774972731.0, 'created_time': 1773131963.809752, 'last_price_update_time': 1774857640.693505}
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MR15790') HTTP/1.1" 204 0
2026-03-30 08:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_3090edaed3b6b78cb6d2591fb5327c84.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_3090edaed3b6b78cb6d2591fb5327c84.jpg not downloaded yet
2026-03-30 08:00:40 [auto1.es] INFO: Found listing with ID: UT51952
2026-03-30 08:00:40 [auto1.es] INFO: Found listing with ID: XV15787
2026-03-30 08:00:40 [auto1.es] INFO: Found listing with ID: JT97247
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT97247%27 HTTP/1.1" 200 None
2026-03-30 08:00:40 [auto1.es] INFO: Scrape type for JT97247: 1
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_fe7131cb0d6fd4ac20a211118d1ee5fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_fe7131cb0d6fd4ac20a211118d1ee5fd.jpg not downloaded yet
2026-03-30 08:00:40 [auto1.es] INFO: Found listing with ID: LB47883
2026-03-30 08:00:40 [auto1.es] INFO: Found listing with ID: RE29588
2026-03-30 08:00:40 [auto1.es] INFO: Found listing with ID: PU95944
2026-03-30 08:00:40 [auto1.es] INFO: Found listing with ID: VC54810
2026-03-30 08:00:40 [auto1.es] INFO: Found listing with ID: PM70964
2026-03-30 08:00:40 [auto1.es] INFO: Found listing with ID: RC14934
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC14934%27 HTTP/1.1" 200 None
2026-03-30 08:00:40 [auto1.es] INFO: Scrape type for RC14934: 2
2026-03-30 08:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b837022f-206e-5373-bcef-51ab156c579e with identifier: RC14934
2026-03-30 08:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b837022f-206e-5373-bcef-51ab156c579e with scrape type 2
2026-03-30 08:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b837022f-206e-5373-bcef-51ab156c579e with scrape type 2
2026-03-30 08:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b837022f-206e-5373-bcef-51ab156c579e, identifier: RC14934
2026-03-30 08:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b837022f-206e-5373-bcef-51ab156c579e with identifier: RC14934
2026-03-30 08:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b837022f-206e-5373-bcef-51ab156c579e with identifier: RC14934
2026-03-30 08:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b837022f-206e-5373-bcef-51ab156c579e with identifier: RC14934 to the API
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:36:29Z',
 'fuel_type': 'petrol',
 'id': 'b837022f-206e-5373-bcef-51ab156c579e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC14934',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 191371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-01',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2010}
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC14934%27 HTTP/1.1" 200 None
2026-03-30 08:00:41 [auto1.es] INFO: Saving data for RC14934: {'auction_closing_time': 1774971389.0, 'created_time': 1773950488.292968, 'last_price_update_time': 1774857641.391081}
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RC14934') HTTP/1.1" 204 0
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_ec36241a4329110a9a004d76c5068815.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_ec36241a4329110a9a004d76c5068815.jpg not downloaded yet
2026-03-30 08:00:41 [auto1.es] INFO: Found listing with ID: EP76379
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP76379%27 HTTP/1.1" 200 None
2026-03-30 08:00:41 [auto1.es] INFO: Scrape type for EP76379: 1
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_3c4d017b8432ff87e315296bcbfbb762.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_3c4d017b8432ff87e315296bcbfbb762.jpg not downloaded yet
2026-03-30 08:00:41 [auto1.es] INFO: Found listing with ID: DL91172
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL91172%27 HTTP/1.1" 200 None
2026-03-30 08:00:41 [auto1.es] INFO: Scrape type for DL91172: 2
2026-03-30 08:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07be4181-0175-5a1f-9372-4eef3c0658a0 with identifier: DL91172
2026-03-30 08:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07be4181-0175-5a1f-9372-4eef3c0658a0 with scrape type 2
2026-03-30 08:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07be4181-0175-5a1f-9372-4eef3c0658a0 with scrape type 2
2026-03-30 08:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 07be4181-0175-5a1f-9372-4eef3c0658a0, identifier: DL91172
2026-03-30 08:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 07be4181-0175-5a1f-9372-4eef3c0658a0 with identifier: DL91172
2026-03-30 08:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 07be4181-0175-5a1f-9372-4eef3c0658a0 with identifier: DL91172
2026-03-30 08:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 07be4181-0175-5a1f-9372-4eef3c0658a0 with identifier: DL91172 to the API
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:50:42Z',
 'fuel_type': 'diesel',
 'id': '07be4181-0175-5a1f-9372-4eef3c0658a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL91172',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 79274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-21',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2023}
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL91172%27 HTTP/1.1" 200 None
2026-03-30 08:00:42 [auto1.es] INFO: Saving data for DL91172: {'auction_closing_time': 1774972242.0, 'created_time': 1773126736.865247, 'last_price_update_time': 1774857642.085583}
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DL91172') HTTP/1.1" 204 0
2026-03-30 08:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_b165f73c6d42357413c2426e5675ecc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_b165f73c6d42357413c2426e5675ecc4.jpg not downloaded yet
2026-03-30 08:00:42 [auto1.es] INFO: Found listing with ID: YH74863
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH74863%27 HTTP/1.1" 200 None
2026-03-30 08:00:42 [auto1.es] INFO: Scrape type for YH74863: 2
2026-03-30 08:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36209447-c469-51ff-a4ab-ebacc1890d31 with identifier: YH74863
2026-03-30 08:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36209447-c469-51ff-a4ab-ebacc1890d31 with scrape type 2
2026-03-30 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36209447-c469-51ff-a4ab-ebacc1890d31 with scrape type 2
2026-03-30 08:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 36209447-c469-51ff-a4ab-ebacc1890d31, identifier: YH74863
2026-03-30 08:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 36209447-c469-51ff-a4ab-ebacc1890d31 with identifier: YH74863
2026-03-30 08:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 36209447-c469-51ff-a4ab-ebacc1890d31 with identifier: YH74863
2026-03-30 08:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 36209447-c469-51ff-a4ab-ebacc1890d31 with identifier: YH74863 to the API
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:39:47Z',
 'fuel_type': 'diesel',
 'id': '36209447-c469-51ff-a4ab-ebacc1890d31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH74863',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Traveller',
 'odometer': 86290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-21',
 'seller_name': None,
 'title': 'Peugeot Traveller 1.5 Blue-HDi Active L1',
 'transmission': 'manual',
 'trim': 'Active L1',
 'year': 2018}
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH74863%27 HTTP/1.1" 200 None
2026-03-30 08:00:42 [auto1.es] INFO: Saving data for YH74863: {'auction_closing_time': 1774971587.0, 'created_time': 1773900504.689147, 'last_price_update_time': 1774857642.59454}
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YH74863') HTTP/1.1" 204 0
2026-03-30 08:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF89520> (referer: https://www.auto1.com/v1/car-details-view/GF89520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_36acad102ddc26484c1a984204839946.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_36acad102ddc26484c1a984204839946.jpg not downloaded yet
2026-03-30 08:00:42 [auto1.es] INFO: Found listing with ID: SW02884
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW02884%27 HTTP/1.1" 200 None
2026-03-30 08:00:42 [auto1.es] INFO: Scrape type for SW02884: 2
2026-03-30 08:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a6bc0d8-429f-5d38-a5e6-523d9e0e9546 with identifier: SW02884
2026-03-30 08:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a6bc0d8-429f-5d38-a5e6-523d9e0e9546 with scrape type 2
2026-03-30 08:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a6bc0d8-429f-5d38-a5e6-523d9e0e9546 with scrape type 2
2026-03-30 08:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0a6bc0d8-429f-5d38-a5e6-523d9e0e9546, identifier: SW02884
2026-03-30 08:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0a6bc0d8-429f-5d38-a5e6-523d9e0e9546 with identifier: SW02884
2026-03-30 08:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0a6bc0d8-429f-5d38-a5e6-523d9e0e9546 with identifier: SW02884
2026-03-30 08:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0a6bc0d8-429f-5d38-a5e6-523d9e0e9546 with identifier: SW02884 to the API
2026-03-30 08:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:27:08Z',
 'fuel_type': 'diesel',
 'id': '0a6bc0d8-429f-5d38-a5e6-523d9e0e9546',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW02884',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 118234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2016}
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW02884%27 HTTP/1.1" 200 None
2026-03-30 08:00:43 [auto1.es] INFO: Saving data for SW02884: {'auction_closing_time': 1774970828.0, 'created_time': 1774296242.005968, 'last_price_update_time': 1774857643.122219}
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SW02884') HTTP/1.1" 204 0
2026-03-30 08:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_782cb567136eaa2f2778da3c89fe3062.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_f5103546c336caa2988e4a42bb2fca2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_adb54f9e4ff7a7c859c74e323c452346.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_adb54f9e4ff7a7c859c74e323c452346.jpg not downloaded yet
2026-03-30 08:00:43 [auto1.es] INFO: Found listing with ID: EV89270
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV89270%27 HTTP/1.1" 200 None
2026-03-30 08:00:43 [auto1.es] INFO: Scrape type for EV89270: 2
2026-03-30 08:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36b89cde-39eb-58bc-bda4-ec563158af7b with identifier: EV89270
2026-03-30 08:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36b89cde-39eb-58bc-bda4-ec563158af7b with scrape type 2
2026-03-30 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36b89cde-39eb-58bc-bda4-ec563158af7b with scrape type 2
2026-03-30 08:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 36b89cde-39eb-58bc-bda4-ec563158af7b, identifier: EV89270
2026-03-30 08:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE40464> (referer: https://www.auto1.com/v1/car-details-view/ZE40464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR79714> (referer: https://www.auto1.com/v1/car-details-view/HR79714/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 36b89cde-39eb-58bc-bda4-ec563158af7b with identifier: EV89270
2026-03-30 08:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 36b89cde-39eb-58bc-bda4-ec563158af7b with identifier: EV89270
2026-03-30 08:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 36b89cde-39eb-58bc-bda4-ec563158af7b with identifier: EV89270 to the API
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:52:57Z',
 'fuel_type': 'petrol',
 'id': '36b89cde-39eb-58bc-bda4-ec563158af7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV89270',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 108049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Style Visio',
 'transmission': 'manual',
 'trim': 'Style Visio',
 'year': 2018}
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV89270%27 HTTP/1.1" 200 None
2026-03-30 08:00:43 [auto1.es] INFO: Saving data for EV89270: {'auction_closing_time': 1774972377.0, 'created_time': 1774447294.752699, 'last_price_update_time': 1774857643.700135}
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EV89270') HTTP/1.1" 204 0
2026-03-30 08:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 941fbdd5-5d11-5347-92a0-36630b5bf69d with identifier: GF89520
2026-03-30 08:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 941fbdd5-5d11-5347-92a0-36630b5bf69d with scrape type 1
2026-03-30 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 941fbdd5-5d11-5347-92a0-36630b5bf69d
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_103da45e7125d8d1a828016c7b3d579c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_103da45e7125d8d1a828016c7b3d579c.jpg not downloaded yet
2026-03-30 08:00:43 [auto1.es] INFO: Found listing with ID: TM60854
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM60854%27 HTTP/1.1" 200 None
2026-03-30 08:00:43 [auto1.es] INFO: Scrape type for TM60854: 2
2026-03-30 08:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d452784-45fb-598f-afc8-681bf408ee7d with identifier: TM60854
2026-03-30 08:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d452784-45fb-598f-afc8-681bf408ee7d with scrape type 2
2026-03-30 08:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d452784-45fb-598f-afc8-681bf408ee7d with scrape type 2
2026-03-30 08:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7d452784-45fb-598f-afc8-681bf408ee7d, identifier: TM60854
2026-03-30 08:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_3090edaed3b6b78cb6d2591fb5327c84.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_a48ac4460f0f47e30a752663a19245c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7d452784-45fb-598f-afc8-681bf408ee7d with identifier: TM60854
2026-03-30 08:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7d452784-45fb-598f-afc8-681bf408ee7d with identifier: TM60854
2026-03-30 08:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7d452784-45fb-598f-afc8-681bf408ee7d with identifier: TM60854 to the API
2026-03-30 08:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-31T15:37:02Z',
 'fuel_type': 'diesel',
 'id': '7d452784-45fb-598f-afc8-681bf408ee7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM60854',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 125547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-12',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 2.0 Blue-HDi Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM60854%27 HTTP/1.1" 200 None
2026-03-30 08:00:44 [auto1.es] INFO: Saving data for TM60854: {'auction_closing_time': 1774971422.0, 'created_time': 1773131357.50027, 'last_price_update_time': 1774857644.305234}
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TM60854') HTTP/1.1" 204 0
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_fad783013d38c39067bf7fd7ed24ae8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_fad783013d38c39067bf7fd7ed24ae8c.jpg not downloaded yet
2026-03-30 08:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS32637/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 08:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 08:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ea69090>
2026-03-30 08:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_782cb567136eaa2f2778da3c89fe3062.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_782cb567136eaa2f2778da3c89fe3062.jpg saved to cache
2026-03-30 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d
2026-03-30 08:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ea5fcd0>
2026-03-30 08:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_f5103546c336caa2988e4a42bb2fca2b.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_f5103546c336caa2988e4a42bb2fca2b.jpg saved to cache
2026-03-30 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d
2026-03-30 08:00:44 [auto1.es] INFO: Found listing with ID: RS73770
2026-03-30 08:00:44 [auto1.es] INFO: Found listing with ID: FP58894
2026-03-30 08:00:44 [auto1.es] INFO: Found listing with ID: CP22124
2026-03-30 08:00:44 [auto1.es] INFO: Found listing with ID: VJ60171
2026-03-30 08:00:44 [auto1.es] INFO: Found listing with ID: JV83587
2026-03-30 08:00:44 [auto1.es] INFO: Found listing with ID: AF99504
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF99504%27 HTTP/1.1" 200 None
2026-03-30 08:00:44 [auto1.es] INFO: Scrape type for AF99504: 2
2026-03-30 08:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73d838d0-91ba-5db9-a2f7-c31838eba90f with identifier: AF99504
2026-03-30 08:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d838d0-91ba-5db9-a2f7-c31838eba90f with scrape type 2
2026-03-30 08:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73d838d0-91ba-5db9-a2f7-c31838eba90f with scrape type 2
2026-03-30 08:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73d838d0-91ba-5db9-a2f7-c31838eba90f, identifier: AF99504
2026-03-30 08:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT97247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73d838d0-91ba-5db9-a2f7-c31838eba90f with identifier: AF99504
2026-03-30 08:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73d838d0-91ba-5db9-a2f7-c31838eba90f with identifier: AF99504
2026-03-30 08:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73d838d0-91ba-5db9-a2f7-c31838eba90f with identifier: AF99504 to the API
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:46:07Z',
 'fuel_type': 'petrol',
 'id': '73d838d0-91ba-5db9-a2f7-c31838eba90f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF99504',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 28119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-02',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2023}
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF99504%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [auto1.es] INFO: Saving data for AF99504: {'auction_closing_time': 1774971967.0, 'created_time': 1774447265.774133, 'last_price_update_time': 1774857645.360645}
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AF99504') HTTP/1.1" 204 0
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_e55fc7d5f1a287f060561fad5ad35f16.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_e55fc7d5f1a287f060561fad5ad35f16.jpg not downloaded yet
2026-03-30 08:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_fe7131cb0d6fd4ac20a211118d1ee5fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_36acad102ddc26484c1a984204839946.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:45 [auto1.es] INFO: Found listing with ID: SM68144
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM68144%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [auto1.es] INFO: Scrape type for SM68144: 2
2026-03-30 08:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 699db69f-9788-5254-aacd-cd46e8c6fcc2 with identifier: SM68144
2026-03-30 08:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 699db69f-9788-5254-aacd-cd46e8c6fcc2 with scrape type 2
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 699db69f-9788-5254-aacd-cd46e8c6fcc2 with scrape type 2
2026-03-30 08:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 699db69f-9788-5254-aacd-cd46e8c6fcc2, identifier: SM68144
2026-03-30 08:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 485e1783-a7fe-5c7e-970e-a2238046f2f2 with identifier: ZE40464
2026-03-30 08:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 485e1783-a7fe-5c7e-970e-a2238046f2f2 with scrape type 1
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 485e1783-a7fe-5c7e-970e-a2238046f2f2
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe9%252Ff1e99badb320d1b9f55adc28822fc844%252Fpa%252FZE40464_c3e77941885534279c9a7ed11020af0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_c3e77941885534279c9a7ed11020af0e.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe9%252Ff1e99badb320d1b9f55adc28822fc844%252Fpa%252FZE40464_fc8be399fa293a04113d386c75241626.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_fc8be399fa293a04113d386c75241626.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe9%252Ff1e99badb320d1b9f55adc28822fc844%252Fpa%252FZE40464_abc9cc40cd43358c2e66b2d68ab2f48e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_abc9cc40cd43358c2e66b2d68ab2f48e.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe9%252Ff1e99badb320d1b9f55adc28822fc844%252Fpa%252FZE40464_ce343d35848df39f71b6223c3aa56732.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_ce343d35848df39f71b6223c3aa56732.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe9%252Ff1e99badb320d1b9f55adc28822fc844%252Fpa%252FZE40464_72fb64f055dd72ccd7764fc1871b5cf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_72fb64f055dd72ccd7764fc1871b5cf9.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe9%252Ff1e99badb320d1b9f55adc28822fc844%252Fpa%252FZE40464_b76e9f2d47435ca417db4a15c4036ee1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_b76e9f2d47435ca417db4a15c4036ee1.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe9%252Ff1e99badb320d1b9f55adc28822fc844%252Fpa%252FZE40464_01db68749f172368e4db80171ae00ec5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_01db68749f172368e4db80171ae00ec5.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe9%252Ff1e99badb320d1b9f55adc28822fc844%252Fpa%252FZE40464_f5b365320f7ee9555aad86f778c31e72.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_f5b365320f7ee9555aad86f778c31e72.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe9%252Ff1e99badb320d1b9f55adc28822fc844%252Fpa%252FZE40464_3d9838140a5fbf4ac917a4be7e5ffd43.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_3d9838140a5fbf4ac917a4be7e5ffd43.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe9%252Ff1e99badb320d1b9f55adc28822fc844%252Fpa%252FZE40464_d349ee3caec5f2ce9ed8503718207ceb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_d349ee3caec5f2ce9ed8503718207ceb.jpg already downloaded
2026-03-30 08:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 485e1783-a7fe-5c7e-970e-a2238046f2f2, identifier: ZE40464
2026-03-30 08:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da7732a3-cde8-5ca6-a855-eff3ae47f154 with identifier: HR79714
2026-03-30 08:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da7732a3-cde8-5ca6-a855-eff3ae47f154 with scrape type 1
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da7732a3-cde8-5ca6-a855-eff3ae47f154
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F93%252Fa7933c94ca619b8531e87991df50a69e%252Fpa%252FHR79714_6b15d3da51981f7f09c54a24755d2c8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_6b15d3da51981f7f09c54a24755d2c8d.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F93%252Fa7933c94ca619b8531e87991df50a69e%252Fpa%252FHR79714_135182809a48eee435e4173cad1d8fd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_135182809a48eee435e4173cad1d8fd7.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F93%252Fa7933c94ca619b8531e87991df50a69e%252Fpa%252FHR79714_88df9209b966bec183e8e475674c7b45.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_88df9209b966bec183e8e475674c7b45.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F93%252Fa7933c94ca619b8531e87991df50a69e%252Fpa%252FHR79714_c538b2eb83e14f836c5b275fdc8c5f52.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_c538b2eb83e14f836c5b275fdc8c5f52.jpg already downloaded
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F93%252Fa7933c94ca619b8531e87991df50a69e%252Fpa%252FHR79714_32ff2c23f1b976961db2abfbdf9c9f7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_32ff2c23f1b976961db2abfbdf9c9f7a.jpg already downloaded
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F93%252Fa7933c94ca619b8531e87991df50a69e%252Fpa%252FHR79714_1d2f055c36859738b4d14e4375038a2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_1d2f055c36859738b4d14e4375038a2c.jpg already downloaded
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F93%252Fa7933c94ca619b8531e87991df50a69e%252Fpa%252FHR79714_55dc993dfe8456ee1c5f0c723fc30abf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_55dc993dfe8456ee1c5f0c723fc30abf.jpg already downloaded
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F93%252Fa7933c94ca619b8531e87991df50a69e%252Fpa%252FHR79714_feb00197c52766521e7c76668f3f6965.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_feb00197c52766521e7c76668f3f6965.jpg already downloaded
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F93%252Fa7933c94ca619b8531e87991df50a69e%252Fpa%252FHR79714_a74cd81f146ec53941ff5e6bd264580d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_a74cd81f146ec53941ff5e6bd264580d.jpg already downloaded
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F93%252Fa7933c94ca619b8531e87991df50a69e%252Fpa%252FHR79714_0e43c5359e1f1d6cfc0da46d3ec8ea46.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_0e43c5359e1f1d6cfc0da46d3ec8ea46.jpg already downloaded
2026-03-30 08:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: da7732a3-cde8-5ca6-a855-eff3ae47f154, identifier: HR79714
2026-03-30 08:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ebb1410>
2026-03-30 08:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_3090edaed3b6b78cb6d2591fb5327c84.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_3090edaed3b6b78cb6d2591fb5327c84.jpg saved to cache
2026-03-30 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d
2026-03-30 08:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e9ac610>
2026-03-30 08:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_a48ac4460f0f47e30a752663a19245c6.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_a48ac4460f0f47e30a752663a19245c6.jpg saved to cache
2026-03-30 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d
2026-03-30 08:00:46 [auto1.es] INFO: Channel: 24h | Page: 3 | totalHits: 2178 | hits on page: 40
2026-03-30 08:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 699db69f-9788-5254-aacd-cd46e8c6fcc2 with identifier: SM68144
2026-03-30 08:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 699db69f-9788-5254-aacd-cd46e8c6fcc2 with identifier: SM68144
2026-03-30 08:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 699db69f-9788-5254-aacd-cd46e8c6fcc2 with identifier: SM68144 to the API
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:24:20Z',
 'fuel_type': 'petrol',
 'id': '699db69f-9788-5254-aacd-cd46e8c6fcc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM68144',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 180841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-04',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2008}
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM68144%27 HTTP/1.1" 200 None
2026-03-30 08:00:46 [auto1.es] INFO: Saving data for SM68144: {'auction_closing_time': 1774970660.0, 'created_time': 1773126996.297519, 'last_price_update_time': 1774857646.731884}
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SM68144') HTTP/1.1" 204 0
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_be7432aff112bebe33e717e2b1ea2696.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_be7432aff112bebe33e717e2b1ea2696.jpg not downloaded yet
2026-03-30 08:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 485e1783-a7fe-5c7e-970e-a2238046f2f2 with identifier: ZE40464
2026-03-30 08:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 485e1783-a7fe-5c7e-970e-a2238046f2f2 with identifier: ZE40464
2026-03-30 08:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 485e1783-a7fe-5c7e-970e-a2238046f2f2 with identifier: ZE40464 to the API
2026-03-30 08:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZE40464>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '1.8L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:47:57Z',
 'fuel_type': 'petrol',
 'id': '485e1783-a7fe-5c7e-970e-a2238046f2f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE40464',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 42975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_c3e77941885534279c9a7ed11020af0e.jpg',
                'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_fc8be399fa293a04113d386c75241626.jpg',
                'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_abc9cc40cd43358c2e66b2d68ab2f48e.jpg',
                'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_ce343d35848df39f71b6223c3aa56732.jpg',
                'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_72fb64f055dd72ccd7764fc1871b5cf9.jpg',
                'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_b76e9f2d47435ca417db4a15c4036ee1.jpg',
                'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_01db68749f172368e4db80171ae00ec5.jpg',
                'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_f5b365320f7ee9555aad86f778c31e72.jpg',
                'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_3d9838140a5fbf4ac917a4be7e5ffd43.jpg',
                'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_d349ee3caec5f2ce9ed8503718207ceb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485e1783-a7fe-5c7e-970e-a2238046f2f2/485e1783-a7fe-5c7e-970e-a2238046f2f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_c3e77941885534279c9a7ed11020af0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485e1783-a7fe-5c7e-970e-a2238046f2f2/485e1783-a7fe-5c7e-970e-a2238046f2f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_fc8be399fa293a04113d386c75241626.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485e1783-a7fe-5c7e-970e-a2238046f2f2/485e1783-a7fe-5c7e-970e-a2238046f2f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_abc9cc40cd43358c2e66b2d68ab2f48e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485e1783-a7fe-5c7e-970e-a2238046f2f2/485e1783-a7fe-5c7e-970e-a2238046f2f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_ce343d35848df39f71b6223c3aa56732.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485e1783-a7fe-5c7e-970e-a2238046f2f2/485e1783-a7fe-5c7e-970e-a2238046f2f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_72fb64f055dd72ccd7764fc1871b5cf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485e1783-a7fe-5c7e-970e-a2238046f2f2/485e1783-a7fe-5c7e-970e-a2238046f2f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_b76e9f2d47435ca417db4a15c4036ee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485e1783-a7fe-5c7e-970e-a2238046f2f2/485e1783-a7fe-5c7e-970e-a2238046f2f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_01db68749f172368e4db80171ae00ec5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485e1783-a7fe-5c7e-970e-a2238046f2f2/485e1783-a7fe-5c7e-970e-a2238046f2f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_f5b365320f7ee9555aad86f778c31e72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485e1783-a7fe-5c7e-970e-a2238046f2f2/485e1783-a7fe-5c7e-970e-a2238046f2f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_3d9838140a5fbf4ac917a4be7e5ffd43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_485e1783-a7fe-5c7e-970e-a2238046f2f2/485e1783-a7fe-5c7e-970e-a2238046f2f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e9/f1e99badb320d1b9f55adc28822fc844/pa/ZE40464_d349ee3caec5f2ce9ed8503718207ceb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-12-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE40464%27 HTTP/1.1" 200 None
2026-03-30 08:00:47 [auto1.es] INFO: Saving data for ZE40464: {'created_time': 1774857647.168886, 'last_price_update_time': 1774857647.168897, 'auction_closing_time': 1774972077.0}
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZE40464') HTTP/1.1" 204 0
2026-03-30 08:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: da7732a3-cde8-5ca6-a855-eff3ae47f154 with identifier: HR79714
2026-03-30 08:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: da7732a3-cde8-5ca6-a855-eff3ae47f154 with identifier: HR79714
2026-03-30 08:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: da7732a3-cde8-5ca6-a855-eff3ae47f154 with identifier: HR79714 to the API
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HR79714>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:56:51Z',
 'fuel_type': 'diesel',
 'id': 'da7732a3-cde8-5ca6-a855-eff3ae47f154',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR79714',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'BMW',
 'model': '2er',
 'odometer': 177543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_6b15d3da51981f7f09c54a24755d2c8d.jpg',
                'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_135182809a48eee435e4173cad1d8fd7.jpg',
                'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_88df9209b966bec183e8e475674c7b45.jpg',
                'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_c538b2eb83e14f836c5b275fdc8c5f52.jpg',
                'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_32ff2c23f1b976961db2abfbdf9c9f7a.jpg',
                'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_1d2f055c36859738b4d14e4375038a2c.jpg',
                'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_55dc993dfe8456ee1c5f0c723fc30abf.jpg',
                'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_feb00197c52766521e7c76668f3f6965.jpg',
                'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_a74cd81f146ec53941ff5e6bd264580d.jpg',
                'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_0e43c5359e1f1d6cfc0da46d3ec8ea46.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da7732a3-cde8-5ca6-a855-eff3ae47f154/da7732a3-cde8-5ca6-a855-eff3ae47f154_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_6b15d3da51981f7f09c54a24755d2c8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da7732a3-cde8-5ca6-a855-eff3ae47f154/da7732a3-cde8-5ca6-a855-eff3ae47f154_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_135182809a48eee435e4173cad1d8fd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da7732a3-cde8-5ca6-a855-eff3ae47f154/da7732a3-cde8-5ca6-a855-eff3ae47f154_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_88df9209b966bec183e8e475674c7b45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da7732a3-cde8-5ca6-a855-eff3ae47f154/da7732a3-cde8-5ca6-a855-eff3ae47f154_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_c538b2eb83e14f836c5b275fdc8c5f52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da7732a3-cde8-5ca6-a855-eff3ae47f154/da7732a3-cde8-5ca6-a855-eff3ae47f154_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_32ff2c23f1b976961db2abfbdf9c9f7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da7732a3-cde8-5ca6-a855-eff3ae47f154/da7732a3-cde8-5ca6-a855-eff3ae47f154_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_1d2f055c36859738b4d14e4375038a2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da7732a3-cde8-5ca6-a855-eff3ae47f154/da7732a3-cde8-5ca6-a855-eff3ae47f154_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_55dc993dfe8456ee1c5f0c723fc30abf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da7732a3-cde8-5ca6-a855-eff3ae47f154/da7732a3-cde8-5ca6-a855-eff3ae47f154_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_feb00197c52766521e7c76668f3f6965.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da7732a3-cde8-5ca6-a855-eff3ae47f154/da7732a3-cde8-5ca6-a855-eff3ae47f154_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_a74cd81f146ec53941ff5e6bd264580d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da7732a3-cde8-5ca6-a855-eff3ae47f154/da7732a3-cde8-5ca6-a855-eff3ae47f154_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/93/a7933c94ca619b8531e87991df50a69e/pa/HR79714_0e43c5359e1f1d6cfc0da46d3ec8ea46.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2015}
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR79714%27 HTTP/1.1" 200 None
2026-03-30 08:00:47 [auto1.es] INFO: Saving data for HR79714: {'created_time': 1774857647.585667, 'last_price_update_time': 1774857647.585677, 'auction_closing_time': 1774972611.0}
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HR79714') HTTP/1.1" 204 0
2026-03-30 08:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_ec36241a4329110a9a004d76c5068815.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_103da45e7125d8d1a828016c7b3d579c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_adb54f9e4ff7a7c859c74e323c452346.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:47 [auto1.es] INFO: Found listing with ID: AP25949
2026-03-30 08:00:47 [auto1.es] INFO: Found listing with ID: XX78085
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX78085%27 HTTP/1.1" 200 None
2026-03-30 08:00:47 [auto1.es] INFO: Scrape type for XX78085: 2
2026-03-30 08:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2124e7dc-8bef-5c6e-bd23-4077a99bbbf3 with identifier: XX78085
2026-03-30 08:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2124e7dc-8bef-5c6e-bd23-4077a99bbbf3 with scrape type 2
2026-03-30 08:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2124e7dc-8bef-5c6e-bd23-4077a99bbbf3 with scrape type 2
2026-03-30 08:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2124e7dc-8bef-5c6e-bd23-4077a99bbbf3, identifier: XX78085
2026-03-30 08:00:47 [auto1.es] INFO: Found listing with ID: SW49334
2026-03-30 08:00:47 [auto1.es] INFO: Found listing with ID: EZ15319
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ15319%27 HTTP/1.1" 200 None
2026-03-30 08:00:47 [auto1.es] INFO: Scrape type for EZ15319: 2
2026-03-30 08:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31a5c79a-48d5-5533-9e7f-7a2a7cef2964 with identifier: EZ15319
2026-03-30 08:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31a5c79a-48d5-5533-9e7f-7a2a7cef2964 with scrape type 2
2026-03-30 08:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31a5c79a-48d5-5533-9e7f-7a2a7cef2964 with scrape type 2
2026-03-30 08:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 31a5c79a-48d5-5533-9e7f-7a2a7cef2964, identifier: EZ15319
2026-03-30 08:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_3c4d017b8432ff87e315296bcbfbb762.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2124e7dc-8bef-5c6e-bd23-4077a99bbbf3 with identifier: XX78085
2026-03-30 08:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2124e7dc-8bef-5c6e-bd23-4077a99bbbf3 with identifier: XX78085
2026-03-30 08:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2124e7dc-8bef-5c6e-bd23-4077a99bbbf3 with identifier: XX78085 to the API
2026-03-30 08:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:26:34Z',
 'fuel_type': 'diesel',
 'id': '2124e7dc-8bef-5c6e-bd23-4077a99bbbf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX78085',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS4',
 'odometer': 123294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-28',
 'seller_name': None,
 'title': 'Citroen DS4 1.6 HDi Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2011}
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX78085%27 HTTP/1.1" 200 None
2026-03-30 08:00:48 [auto1.es] INFO: Saving data for XX78085: {'auction_closing_time': 1774970794.0, 'created_time': 1773777877.361105, 'last_price_update_time': 1774857648.304844}
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XX78085') HTTP/1.1" 204 0
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_ed1b5aa75aa490a7ff2d087e70abae6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_ed1b5aa75aa490a7ff2d087e70abae6b.jpg not downloaded yet
2026-03-30 08:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 31a5c79a-48d5-5533-9e7f-7a2a7cef2964 with identifier: EZ15319
2026-03-30 08:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 31a5c79a-48d5-5533-9e7f-7a2a7cef2964 with identifier: EZ15319
2026-03-30 08:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 31a5c79a-48d5-5533-9e7f-7a2a7cef2964 with identifier: EZ15319 to the API
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:06:14Z',
 'fuel_type': 'diesel',
 'id': '31a5c79a-48d5-5533-9e7f-7a2a7cef2964',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ15319',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 353657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-12',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ15319%27 HTTP/1.1" 200 None
2026-03-30 08:00:48 [auto1.es] INFO: Saving data for EZ15319: {'auction_closing_time': 1774969574.0, 'created_time': 1773933925.666086, 'last_price_update_time': 1774857648.73966}
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EZ15319') HTTP/1.1" 204 0
2026-03-30 08:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e9172d0>
2026-03-30 08:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_fe7131cb0d6fd4ac20a211118d1ee5fd.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_fe7131cb0d6fd4ac20a211118d1ee5fd.jpg saved to cache
2026-03-30 08:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d
2026-03-30 08:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88df2f250>
2026-03-30 08:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_36acad102ddc26484c1a984204839946.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_36acad102ddc26484c1a984204839946.jpg saved to cache
2026-03-30 08:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d
2026-03-30 08:00:48 [auto1.es] INFO: Found listing with ID: WV86168
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV86168%27 HTTP/1.1" 200 None
2026-03-30 08:00:48 [auto1.es] INFO: Scrape type for WV86168: 2
2026-03-30 08:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 478d5039-f7f4-5ff1-9f20-ca90c8304622 with identifier: WV86168
2026-03-30 08:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 478d5039-f7f4-5ff1-9f20-ca90c8304622 with scrape type 2
2026-03-30 08:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 478d5039-f7f4-5ff1-9f20-ca90c8304622 with scrape type 2
2026-03-30 08:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 478d5039-f7f4-5ff1-9f20-ca90c8304622, identifier: WV86168
2026-03-30 08:00:48 [auto1.es] INFO: Found listing with ID: JF96117
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF96117%27 HTTP/1.1" 200 None
2026-03-30 08:00:48 [auto1.es] INFO: Scrape type for JF96117: 2
2026-03-30 08:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d56b4f6-e560-5f94-9ced-0e5cfc2f503d with identifier: JF96117
2026-03-30 08:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d56b4f6-e560-5f94-9ced-0e5cfc2f503d with scrape type 2
2026-03-30 08:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d56b4f6-e560-5f94-9ced-0e5cfc2f503d with scrape type 2
2026-03-30 08:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1d56b4f6-e560-5f94-9ced-0e5cfc2f503d, identifier: JF96117
2026-03-30 08:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_fad783013d38c39067bf7fd7ed24ae8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 478d5039-f7f4-5ff1-9f20-ca90c8304622 with identifier: WV86168
2026-03-30 08:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 478d5039-f7f4-5ff1-9f20-ca90c8304622 with identifier: WV86168
2026-03-30 08:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 478d5039-f7f4-5ff1-9f20-ca90c8304622 with identifier: WV86168 to the API
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:50:24Z',
 'fuel_type': 'diesel',
 'id': '478d5039-f7f4-5ff1-9f20-ca90c8304622',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV86168',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 115659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-21',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV86168%27 HTTP/1.1" 200 None
2026-03-30 08:00:49 [auto1.es] INFO: Saving data for WV86168: {'auction_closing_time': 1774972224.0, 'created_time': 1773127324.994479, 'last_price_update_time': 1774857649.481539}
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WV86168') HTTP/1.1" 204 0
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_f781321f3f9ff3a251236b20ca53eada.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_f781321f3f9ff3a251236b20ca53eada.jpg not downloaded yet
2026-03-30 08:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1d56b4f6-e560-5f94-9ced-0e5cfc2f503d with identifier: JF96117
2026-03-30 08:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1d56b4f6-e560-5f94-9ced-0e5cfc2f503d with identifier: JF96117
2026-03-30 08:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1d56b4f6-e560-5f94-9ced-0e5cfc2f503d with identifier: JF96117 to the API
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:34:19Z',
 'fuel_type': 'diesel',
 'id': '1d56b4f6-e560-5f94-9ced-0e5cfc2f503d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF96117',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 196735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-02',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2010}
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF96117%27 HTTP/1.1" 200 None
2026-03-30 08:00:49 [auto1.es] INFO: Saving data for JF96117: {'auction_closing_time': 1774971259.0, 'created_time': 1773131812.701557, 'last_price_update_time': 1774857649.915134}
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JF96117') HTTP/1.1" 204 0
2026-03-30 08:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_b165f73c6d42357413c2426e5675ecc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_e55fc7d5f1a287f060561fad5ad35f16.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:49 [auto1.es] INFO: Found listing with ID: BF01756
2026-03-30 08:00:49 [auto1.es] INFO: Found listing with ID: MY64125
2026-03-30 08:00:49 [auto1.es] INFO: Found listing with ID: KP50640
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP50640%27 HTTP/1.1" 200 None
2026-03-30 08:00:49 [auto1.es] INFO: Scrape type for KP50640: 1
2026-03-30 08:00:49 [auto1.es] INFO: Found listing with ID: LH19294
2026-03-30 08:00:49 [auto1.es] INFO: Found listing with ID: TR96554
2026-03-30 08:00:49 [auto1.es] INFO: Found listing with ID: TB43728
2026-03-30 08:00:49 [auto1.es] INFO: Found listing with ID: GY72881
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY72881%27 HTTP/1.1" 200 None
2026-03-30 08:00:49 [auto1.es] INFO: Scrape type for GY72881: 2
2026-03-30 08:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30185515-62ef-50f5-8f50-566961650463 with identifier: GY72881
2026-03-30 08:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30185515-62ef-50f5-8f50-566961650463 with scrape type 2
2026-03-30 08:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30185515-62ef-50f5-8f50-566961650463 with scrape type 2
2026-03-30 08:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 30185515-62ef-50f5-8f50-566961650463, identifier: GY72881
2026-03-30 08:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP76379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ec90f50>
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_ec36241a4329110a9a004d76c5068815.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_ec36241a4329110a9a004d76c5068815.jpg saved to cache
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e9014d0>
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_103da45e7125d8d1a828016c7b3d579c.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_103da45e7125d8d1a828016c7b3d579c.jpg saved to cache
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 941fbdd5-5d11-5347-92a0-36630b5bf69d
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ec8bd90>
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_adb54f9e4ff7a7c859c74e323c452346.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_adb54f9e4ff7a7c859c74e323c452346.jpg saved to cache
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ea23750>
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_3c4d017b8432ff87e315296bcbfbb762.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_3c4d017b8432ff87e315296bcbfbb762.jpg saved to cache
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_5c63b06216e67dc62e67254bddc4bc4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_5c63b06216e67dc62e67254bddc4bc4b.jpg not downloaded yet
2026-03-30 08:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 30185515-62ef-50f5-8f50-566961650463 with identifier: GY72881
2026-03-30 08:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 30185515-62ef-50f5-8f50-566961650463 with identifier: GY72881
2026-03-30 08:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 30185515-62ef-50f5-8f50-566961650463 with identifier: GY72881 to the API
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-31T15:03:39Z',
 'fuel_type': 'petrol',
 'id': '30185515-62ef-50f5-8f50-566961650463',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY72881',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CL-Coupe',
 'odometer': 273585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-04-02',
 'seller_name': None,
 'title': 'Mercedes-Benz CL-Coupe CL 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY72881%27 HTTP/1.1" 200 None
2026-03-30 08:00:50 [auto1.es] INFO: Saving data for GY72881: {'auction_closing_time': 1774969419.0, 'created_time': 1774522866.497343, 'last_price_update_time': 1774857650.605868}
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GY72881') HTTP/1.1" 204 0
2026-03-30 08:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_be7432aff112bebe33e717e2b1ea2696.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:50 [auto1.es] INFO: Found listing with ID: WR94987
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR94987%27 HTTP/1.1" 200 None
2026-03-30 08:00:50 [auto1.es] INFO: Scrape type for WR94987: 2
2026-03-30 08:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d76aa19-f282-5d20-a4d2-55005076a235 with identifier: WR94987
2026-03-30 08:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d76aa19-f282-5d20-a4d2-55005076a235 with scrape type 2
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d76aa19-f282-5d20-a4d2-55005076a235 with scrape type 2
2026-03-30 08:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1d76aa19-f282-5d20-a4d2-55005076a235, identifier: WR94987
2026-03-30 08:00:50 [auto1.es] INFO: Found listing with ID: JP85888
2026-03-30 08:00:50 [auto1.es] INFO: Found listing with ID: DZ12321
2026-03-30 08:00:50 [auto1.es] INFO: Found listing with ID: VS82741
2026-03-30 08:00:50 [auto1.es] INFO: Found listing with ID: WZ04978
2026-03-30 08:00:50 [auto1.es] INFO: Found listing with ID: GT09019
2026-03-30 08:00:50 [auto1.es] INFO: Found listing with ID: JH64240
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH64240%27 HTTP/1.1" 200 None
2026-03-30 08:00:50 [auto1.es] INFO: Scrape type for JH64240: 2
2026-03-30 08:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eb7ced5-db9d-543d-a0c0-db2b7c70b5be with identifier: JH64240
2026-03-30 08:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb7ced5-db9d-543d-a0c0-db2b7c70b5be with scrape type 2
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0eb7ced5-db9d-543d-a0c0-db2b7c70b5be with scrape type 2
2026-03-30 08:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0eb7ced5-db9d-543d-a0c0-db2b7c70b5be, identifier: JH64240
2026-03-30 08:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e944fd0>
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_fad783013d38c39067bf7fd7ed24ae8c.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_fad783013d38c39067bf7fd7ed24ae8c.jpg saved to cache
2026-03-30 08:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 941fbdd5-5d11-5347-92a0-36630b5bf69d
2026-03-30 08:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1d76aa19-f282-5d20-a4d2-55005076a235 with identifier: WR94987
2026-03-30 08:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1d76aa19-f282-5d20-a4d2-55005076a235 with identifier: WR94987
2026-03-30 08:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1d76aa19-f282-5d20-a4d2-55005076a235 with identifier: WR94987 to the API
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:58:44Z',
 'fuel_type': 'diesel',
 'id': '1d76aa19-f282-5d20-a4d2-55005076a235',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR94987',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 176831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seller_name': None,
 'title': 'Peugeot 208 1.6 Blue-HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR94987%27 HTTP/1.1" 200 None
2026-03-30 08:00:51 [auto1.es] INFO: Saving data for WR94987: {'auction_closing_time': 1774972724.0, 'created_time': 1773130310.329093, 'last_price_update_time': 1774857651.426462}
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WR94987') HTTP/1.1" 204 0
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_ddce624159fa4140c9d1a9806a699ffd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_ddce624159fa4140c9d1a9806a699ffd.jpg not downloaded yet
2026-03-30 08:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0eb7ced5-db9d-543d-a0c0-db2b7c70b5be with identifier: JH64240
2026-03-30 08:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0eb7ced5-db9d-543d-a0c0-db2b7c70b5be with identifier: JH64240
2026-03-30 08:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0eb7ced5-db9d-543d-a0c0-db2b7c70b5be with identifier: JH64240 to the API
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 113,
 'expiration_date': '2026-03-31T15:59:12Z',
 'fuel_type': 'diesel',
 'id': '0eb7ced5-db9d-543d-a0c0-db2b7c70b5be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH64240',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Elantra',
 'odometer': 243771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-19',
 'seller_name': None,
 'title': 'Hyundai Elantra 2.0 CRDi GLS 5',
 'transmission': 'manual',
 'trim': 'GLS 5',
 'year': 2005}
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH64240%27 HTTP/1.1" 200 None
2026-03-30 08:00:51 [auto1.es] INFO: Saving data for JH64240: {'auction_closing_time': 1774972752.0, 'created_time': 1774382734.500577, 'last_price_update_time': 1774857651.832948}
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JH64240') HTTP/1.1" 204 0
2026-03-30 08:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88df20990>
2026-03-30 08:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb5%252F19b59b7f3fc6b06d882b9aa51d87718a%252Fpa%252FCW87826_b165f73c6d42357413c2426e5675ecc4.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_b165f73c6d42357413c2426e5675ecc4.jpg saved to cache
2026-03-30 08:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d
2026-03-30 08:00:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee8b6763-f5bb-5655-b037-5a3a7f4ab42d, skipping ID generation
2026-03-30 08:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d with scrape type 1
2026-03-30 08:00:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee8b6763-f5bb-5655-b037-5a3a7f4ab42d sending to next pipeline
2026-03-30 08:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee8b6763-f5bb-5655-b037-5a3a7f4ab42d, identifier: CW87826
2026-03-30 08:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ea6ed10>
2026-03-30 08:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_e55fc7d5f1a287f060561fad5ad35f16.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_e55fc7d5f1a287f060561fad5ad35f16.jpg saved to cache
2026-03-30 08:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 941fbdd5-5d11-5347-92a0-36630b5bf69d
2026-03-30 08:00:52 [auto1.es] INFO: Found listing with ID: AV80298
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV80298%27 HTTP/1.1" 200 None
2026-03-30 08:00:52 [auto1.es] INFO: Scrape type for AV80298: 2
2026-03-30 08:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96b7a3a-95f6-517d-8341-30a245d76603 with identifier: AV80298
2026-03-30 08:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96b7a3a-95f6-517d-8341-30a245d76603 with scrape type 2
2026-03-30 08:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e96b7a3a-95f6-517d-8341-30a245d76603 with scrape type 2
2026-03-30 08:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e96b7a3a-95f6-517d-8341-30a245d76603, identifier: AV80298
2026-03-30 08:00:52 [auto1.es] INFO: Found listing with ID: XP46795
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP46795%27 HTTP/1.1" 200 None
2026-03-30 08:00:52 [auto1.es] INFO: Scrape type for XP46795: 2
2026-03-30 08:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c217d42-0f94-58e5-b1d0-ba56c51ff6e8 with identifier: XP46795
2026-03-30 08:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c217d42-0f94-58e5-b1d0-ba56c51ff6e8 with scrape type 2
2026-03-30 08:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c217d42-0f94-58e5-b1d0-ba56c51ff6e8 with scrape type 2
2026-03-30 08:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6c217d42-0f94-58e5-b1d0-ba56c51ff6e8, identifier: XP46795
2026-03-30 08:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee8b6763-f5bb-5655-b037-5a3a7f4ab42d with identifier: CW87826
2026-03-30 08:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee8b6763-f5bb-5655-b037-5a3a7f4ab42d with identifier: CW87826
2026-03-30 08:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ee8b6763-f5bb-5655-b037-5a3a7f4ab42d with identifier: CW87826 to the API
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_b165f73c6d42357413c2426e5675ecc4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 235,
 'expiration_date': '2026-03-31T15:18:46Z',
 'fuel_type': 'diesel',
 'id': 'ee8b6763-f5bb-5655-b037-5a3a7f4ab42d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW87826',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 102820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_782cb567136eaa2f2778da3c89fe3062.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_f5103546c336caa2988e4a42bb2fca2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_a48ac4460f0f47e30a752663a19245c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_3090edaed3b6b78cb6d2591fb5327c84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_fe7131cb0d6fd4ac20a211118d1ee5fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_ec36241a4329110a9a004d76c5068815.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_3c4d017b8432ff87e315296bcbfbb762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_b165f73c6d42357413c2426e5675ecc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_36acad102ddc26484c1a984204839946.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee8b6763-f5bb-5655-b037-5a3a7f4ab42d/ee8b6763-f5bb-5655-b037-5a3a7f4ab42d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b5/19b59b7f3fc6b06d882b9aa51d87718a/pa/CW87826_adb54f9e4ff7a7c859c74e323c452346.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2017}
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW87826%27 HTTP/1.1" 200 None
2026-03-30 08:00:52 [auto1.es] INFO: Saving data for CW87826: {'created_time': 1774857652.920975, 'last_price_update_time': 1774857652.920986, 'auction_closing_time': 1774970326.0}
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CW87826') HTTP/1.1" 204 0
2026-03-30 08:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_ed1b5aa75aa490a7ff2d087e70abae6b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e96b7a3a-95f6-517d-8341-30a245d76603 with identifier: AV80298
2026-03-30 08:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e96b7a3a-95f6-517d-8341-30a245d76603 with identifier: AV80298
2026-03-30 08:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e96b7a3a-95f6-517d-8341-30a245d76603 with identifier: AV80298 to the API
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:28:49Z',
 'fuel_type': 'diesel',
 'id': 'e96b7a3a-95f6-517d-8341-30a245d76603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV80298',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 191859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Shine XL',
 'transmission': 'manual',
 'trim': 'Shine XL',
 'year': 2019}
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV80298%27 HTTP/1.1" 200 None
2026-03-30 08:00:53 [auto1.es] INFO: Saving data for AV80298: {'auction_closing_time': 1774970929.0, 'created_time': 1774436477.676641, 'last_price_update_time': 1774857653.35162}
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AV80298') HTTP/1.1" 204 0
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_5756c705003ca2d4ee7eb59c16b0f139.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_5756c705003ca2d4ee7eb59c16b0f139.jpg not downloaded yet
2026-03-30 08:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6c217d42-0f94-58e5-b1d0-ba56c51ff6e8 with identifier: XP46795
2026-03-30 08:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6c217d42-0f94-58e5-b1d0-ba56c51ff6e8 with identifier: XP46795
2026-03-30 08:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6c217d42-0f94-58e5-b1d0-ba56c51ff6e8 with identifier: XP46795 to the API
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:45:40Z',
 'fuel_type': 'petrol',
 'id': '6c217d42-0f94-58e5-b1d0-ba56c51ff6e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP46795',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 107022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-09',
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2016}
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP46795%27 HTTP/1.1" 200 None
2026-03-30 08:00:53 [auto1.es] INFO: Saving data for XP46795: {'auction_closing_time': 1774971940.0, 'created_time': 1773842936.834305, 'last_price_update_time': 1774857653.782124}
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XP46795') HTTP/1.1" 204 0
2026-03-30 08:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e059e10>
2026-03-30 08:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_be7432aff112bebe33e717e2b1ea2696.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_be7432aff112bebe33e717e2b1ea2696.jpg saved to cache
2026-03-30 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 941fbdd5-5d11-5347-92a0-36630b5bf69d
2026-03-30 08:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_f781321f3f9ff3a251236b20ca53eada.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:53 [auto1.es] INFO: Found listing with ID: HW71789
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW71789%27 HTTP/1.1" 200 None
2026-03-30 08:00:53 [auto1.es] INFO: Scrape type for HW71789: 2
2026-03-30 08:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 360485cd-dd8c-57c5-ad2c-37fddce96b67 with identifier: HW71789
2026-03-30 08:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 360485cd-dd8c-57c5-ad2c-37fddce96b67 with scrape type 2
2026-03-30 08:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 360485cd-dd8c-57c5-ad2c-37fddce96b67 with scrape type 2
2026-03-30 08:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 360485cd-dd8c-57c5-ad2c-37fddce96b67, identifier: HW71789
2026-03-30 08:00:53 [auto1.es] INFO: Found listing with ID: RL76875
2026-03-30 08:00:53 [auto1.es] INFO: Found listing with ID: DL26730
2026-03-30 08:00:53 [auto1.es] INFO: Found listing with ID: EZ05250
2026-03-30 08:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ05250%27 HTTP/1.1" 200 None
2026-03-30 08:00:54 [auto1.es] INFO: Scrape type for EZ05250: 2
2026-03-30 08:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 455b13c0-808a-5ff5-8610-901beca5b1d7 with identifier: EZ05250
2026-03-30 08:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 455b13c0-808a-5ff5-8610-901beca5b1d7 with scrape type 2
2026-03-30 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 455b13c0-808a-5ff5-8610-901beca5b1d7 with scrape type 2
2026-03-30 08:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 455b13c0-808a-5ff5-8610-901beca5b1d7, identifier: EZ05250
2026-03-30 08:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 360485cd-dd8c-57c5-ad2c-37fddce96b67 with identifier: HW71789
2026-03-30 08:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 360485cd-dd8c-57c5-ad2c-37fddce96b67 with identifier: HW71789
2026-03-30 08:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 360485cd-dd8c-57c5-ad2c-37fddce96b67 with identifier: HW71789 to the API
2026-03-30 08:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:59:42Z',
 'fuel_type': 'diesel',
 'id': '360485cd-dd8c-57c5-ad2c-37fddce96b67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW71789',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 120863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-11',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-30 08:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW71789%27 HTTP/1.1" 200 None
2026-03-30 08:00:54 [auto1.es] INFO: Saving data for HW71789: {'auction_closing_time': 1774972782.0, 'created_time': 1774296247.604465, 'last_price_update_time': 1774857654.570797}
2026-03-30 08:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HW71789') HTTP/1.1" 204 0
2026-03-30 08:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_e571cddf918e3c6b97c803b3fce72571.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_e571cddf918e3c6b97c803b3fce72571.jpg not downloaded yet
2026-03-30 08:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 455b13c0-808a-5ff5-8610-901beca5b1d7 with identifier: EZ05250
2026-03-30 08:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 455b13c0-808a-5ff5-8610-901beca5b1d7 with identifier: EZ05250
2026-03-30 08:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 455b13c0-808a-5ff5-8610-901beca5b1d7 with identifier: EZ05250 to the API
2026-03-30 08:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:17:43Z',
 'fuel_type': 'diesel',
 'id': '455b13c0-808a-5ff5-8610-901beca5b1d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ05250',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 233974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-13',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ05250%27 HTTP/1.1" 200 None
2026-03-30 08:00:55 [auto1.es] INFO: Saving data for EZ05250: {'auction_closing_time': 1774970263.0, 'created_time': 1772625378.804791, 'last_price_update_time': 1774857655.091114}
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EZ05250') HTTP/1.1" 204 0
2026-03-30 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_5c63b06216e67dc62e67254bddc4bc4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:55 [auto1.es] INFO: Found listing with ID: SC66247
2026-03-30 08:00:55 [auto1.es] INFO: Found listing with ID: AY69334
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AY69334%27 HTTP/1.1" 200 None
2026-03-30 08:00:55 [auto1.es] INFO: Scrape type for AY69334: 2
2026-03-30 08:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95c8feab-ade7-5705-8112-4de4ca931f6a with identifier: AY69334
2026-03-30 08:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95c8feab-ade7-5705-8112-4de4ca931f6a with scrape type 2
2026-03-30 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95c8feab-ade7-5705-8112-4de4ca931f6a with scrape type 2
2026-03-30 08:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 95c8feab-ade7-5705-8112-4de4ca931f6a, identifier: AY69334
2026-03-30 08:00:55 [auto1.es] INFO: Found listing with ID: LZ54087
2026-03-30 08:00:55 [auto1.es] INFO: Found listing with ID: KV39877
2026-03-30 08:00:55 [auto1.es] INFO: Found listing with ID: KJ86287
2026-03-30 08:00:55 [auto1.es] INFO: Found listing with ID: RR39906
2026-03-30 08:00:55 [auto1.es] INFO: Found listing with ID: LJ17075
2026-03-30 08:00:55 [auto1.es] INFO: Found listing with ID: PA95147
2026-03-30 08:00:55 [auto1.es] INFO: Found listing with ID: AX32587
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX32587%27 HTTP/1.1" 200 None
2026-03-30 08:00:55 [auto1.es] INFO: Scrape type for AX32587: 2
2026-03-30 08:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85844361-4359-5f20-8db6-06f61726227d with identifier: AX32587
2026-03-30 08:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85844361-4359-5f20-8db6-06f61726227d with scrape type 2
2026-03-30 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85844361-4359-5f20-8db6-06f61726227d with scrape type 2
2026-03-30 08:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 85844361-4359-5f20-8db6-06f61726227d, identifier: AX32587
2026-03-30 08:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88df22310>
2026-03-30 08:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_ed1b5aa75aa490a7ff2d087e70abae6b.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_ed1b5aa75aa490a7ff2d087e70abae6b.jpg saved to cache
2026-03-30 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 941fbdd5-5d11-5347-92a0-36630b5bf69d
2026-03-30 08:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 95c8feab-ade7-5705-8112-4de4ca931f6a with identifier: AY69334
2026-03-30 08:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 95c8feab-ade7-5705-8112-4de4ca931f6a with identifier: AY69334
2026-03-30 08:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 95c8feab-ade7-5705-8112-4de4ca931f6a with identifier: AY69334 to the API
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:03:52Z',
 'fuel_type': 'diesel',
 'id': '95c8feab-ade7-5705-8112-4de4ca931f6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY69334',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 181462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-05',
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2008}
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AY69334%27 HTTP/1.1" 200 None
2026-03-30 08:00:55 [auto1.es] INFO: Saving data for AY69334: {'auction_closing_time': 1774969432.0, 'created_time': 1774468911.865393, 'last_price_update_time': 1774857655.84626}
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AY69334') HTTP/1.1" 204 0
2026-03-30 08:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 85844361-4359-5f20-8db6-06f61726227d with identifier: AX32587
2026-03-30 08:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 85844361-4359-5f20-8db6-06f61726227d with identifier: AX32587
2026-03-30 08:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 85844361-4359-5f20-8db6-06f61726227d with identifier: AX32587 to the API
2026-03-30 08:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:12:25Z',
 'fuel_type': 'diesel',
 'id': '85844361-4359-5f20-8db6-06f61726227d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX32587',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 91666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2019}
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX32587%27 HTTP/1.1" 200 None
2026-03-30 08:00:56 [auto1.es] INFO: Saving data for AX32587: {'auction_closing_time': 1774969945.0, 'created_time': 1772623781.8536, 'last_price_update_time': 1774857656.268813}
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AX32587') HTTP/1.1" 204 0
2026-03-30 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_ddce624159fa4140c9d1a9806a699ffd.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:56 [auto1.es] INFO: Found listing with ID: FG51952
2026-03-30 08:00:56 [auto1.es] INFO: Found listing with ID: VX31855
2026-03-30 08:00:56 [auto1.es] INFO: Found listing with ID: HW63971
2026-03-30 08:00:56 [auto1.es] INFO: Found listing with ID: CB77885
2026-03-30 08:00:56 [auto1.es] INFO: Found listing with ID: DT19492
2026-03-30 08:00:56 [auto1.es] INFO: Found listing with ID: FB21971
2026-03-30 08:00:56 [auto1.es] INFO: Found listing with ID: KY65056
2026-03-30 08:00:56 [auto1.es] INFO: Found listing with ID: XB50501
2026-03-30 08:00:56 [auto1.es] INFO: Found listing with ID: PP33108
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP33108%27 HTTP/1.1" 200 None
2026-03-30 08:00:56 [auto1.es] INFO: Scrape type for PP33108: 2
2026-03-30 08:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f0684d2-16c6-5a55-87e8-7086b1ad1f35 with identifier: PP33108
2026-03-30 08:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f0684d2-16c6-5a55-87e8-7086b1ad1f35 with scrape type 2
2026-03-30 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f0684d2-16c6-5a55-87e8-7086b1ad1f35 with scrape type 2
2026-03-30 08:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f0684d2-16c6-5a55-87e8-7086b1ad1f35, identifier: PP33108
2026-03-30 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ec854d0>
2026-03-30 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_f781321f3f9ff3a251236b20ca53eada.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_f781321f3f9ff3a251236b20ca53eada.jpg saved to cache
2026-03-30 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 941fbdd5-5d11-5347-92a0-36630b5bf69d
2026-03-30 08:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f0684d2-16c6-5a55-87e8-7086b1ad1f35 with identifier: PP33108
2026-03-30 08:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f0684d2-16c6-5a55-87e8-7086b1ad1f35 with identifier: PP33108
2026-03-30 08:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1f0684d2-16c6-5a55-87e8-7086b1ad1f35 with identifier: PP33108 to the API
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:26:52Z',
 'fuel_type': 'diesel',
 'id': '1f0684d2-16c6-5a55-87e8-7086b1ad1f35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP33108',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 97300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-19',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2017}
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP33108%27 HTTP/1.1" 200 None
2026-03-30 08:00:56 [auto1.es] INFO: Saving data for PP33108: {'auction_closing_time': 1774970812.0, 'created_time': 1774382553.272399, 'last_price_update_time': 1774857656.864766}
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PP33108') HTTP/1.1" 204 0
2026-03-30 08:00:57 [auto1.es] INFO: Found listing with ID: KK89963
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK89963%27 HTTP/1.1" 200 None
2026-03-30 08:00:57 [auto1.es] INFO: Scrape type for KK89963: 2
2026-03-30 08:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 994effc5-498a-569c-91b1-a8810d94147f with identifier: KK89963
2026-03-30 08:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994effc5-498a-569c-91b1-a8810d94147f with scrape type 2
2026-03-30 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 994effc5-498a-569c-91b1-a8810d94147f with scrape type 2
2026-03-30 08:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 994effc5-498a-569c-91b1-a8810d94147f, identifier: KK89963
2026-03-30 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e05e750>
2026-03-30 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_5c63b06216e67dc62e67254bddc4bc4b.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_5c63b06216e67dc62e67254bddc4bc4b.jpg saved to cache
2026-03-30 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 941fbdd5-5d11-5347-92a0-36630b5bf69d
2026-03-30 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_e571cddf918e3c6b97c803b3fce72571.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 994effc5-498a-569c-91b1-a8810d94147f with identifier: KK89963
2026-03-30 08:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 994effc5-498a-569c-91b1-a8810d94147f with identifier: KK89963
2026-03-30 08:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 994effc5-498a-569c-91b1-a8810d94147f with identifier: KK89963 to the API
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:52:58Z',
 'fuel_type': 'diesel',
 'id': '994effc5-498a-569c-91b1-a8810d94147f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK89963',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 163313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-13',
 'seller_name': None,
 'title': 'Seat Altea 1.6 TDI Style Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Ecomotive',
 'year': 2010}
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK89963%27 HTTP/1.1" 200 None
2026-03-30 08:00:57 [auto1.es] INFO: Saving data for KK89963: {'auction_closing_time': 1774972378.0, 'created_time': 1773928832.417072, 'last_price_update_time': 1774857657.523831}
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KK89963') HTTP/1.1" 204 0
2026-03-30 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_5756c705003ca2d4ee7eb59c16b0f139.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:00:57 [auto1.es] INFO: Found listing with ID: KA39853
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA39853%27 HTTP/1.1" 200 None
2026-03-30 08:00:57 [auto1.es] INFO: Scrape type for KA39853: 2
2026-03-30 08:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5feae1d4-c561-5466-8917-d730ce3d529a with identifier: KA39853
2026-03-30 08:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5feae1d4-c561-5466-8917-d730ce3d529a with scrape type 2
2026-03-30 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5feae1d4-c561-5466-8917-d730ce3d529a with scrape type 2
2026-03-30 08:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5feae1d4-c561-5466-8917-d730ce3d529a, identifier: KA39853
2026-03-30 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP50640/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5feae1d4-c561-5466-8917-d730ce3d529a with identifier: KA39853
2026-03-30 08:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5feae1d4-c561-5466-8917-d730ce3d529a with identifier: KA39853
2026-03-30 08:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5feae1d4-c561-5466-8917-d730ce3d529a with identifier: KA39853 to the API
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:00:05Z',
 'fuel_type': 'petrol',
 'id': '5feae1d4-c561-5466-8917-d730ce3d529a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA39853',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 144644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-04-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2001}
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA39853%27 HTTP/1.1" 200 None
2026-03-30 08:00:57 [auto1.es] INFO: Saving data for KA39853: {'auction_closing_time': 1774969205.0, 'created_time': 1774555435.487178, 'last_price_update_time': 1774857657.985444}
2026-03-30 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KA39853') HTTP/1.1" 204 0
2026-03-30 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e96ac10>
2026-03-30 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_ddce624159fa4140c9d1a9806a699ffd.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_ddce624159fa4140c9d1a9806a699ffd.jpg saved to cache
2026-03-30 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 941fbdd5-5d11-5347-92a0-36630b5bf69d
2026-03-30 08:00:58 [auto1.es] INFO: Found listing with ID: GJ09914
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ09914%27 HTTP/1.1" 200 None
2026-03-30 08:00:58 [auto1.es] INFO: Scrape type for GJ09914: 2
2026-03-30 08:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 168b4aa3-5e26-549e-9017-45361a6cd60c with identifier: GJ09914
2026-03-30 08:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 168b4aa3-5e26-549e-9017-45361a6cd60c with scrape type 2
2026-03-30 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 168b4aa3-5e26-549e-9017-45361a6cd60c with scrape type 2
2026-03-30 08:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 168b4aa3-5e26-549e-9017-45361a6cd60c, identifier: GJ09914
2026-03-30 08:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 168b4aa3-5e26-549e-9017-45361a6cd60c with identifier: GJ09914
2026-03-30 08:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 168b4aa3-5e26-549e-9017-45361a6cd60c with identifier: GJ09914
2026-03-30 08:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 168b4aa3-5e26-549e-9017-45361a6cd60c with identifier: GJ09914 to the API
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:14:04Z',
 'fuel_type': 'diesel',
 'id': '168b4aa3-5e26-549e-9017-45361a6cd60c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ09914',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 121830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-22',
 'seller_name': None,
 'title': 'Opel Grandland X 2.0 CDTI Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2018}
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ09914%27 HTTP/1.1" 200 None
2026-03-30 08:00:58 [auto1.es] INFO: Saving data for GJ09914: {'auction_closing_time': 1774970044.0, 'created_time': 1773130066.862098, 'last_price_update_time': 1774857658.595746}
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GJ09914') HTTP/1.1" 204 0
2026-03-30 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e9de410>
2026-03-30 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_e571cddf918e3c6b97c803b3fce72571.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_e571cddf918e3c6b97c803b3fce72571.jpg saved to cache
2026-03-30 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 941fbdd5-5d11-5347-92a0-36630b5bf69d
2026-03-30 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ec856d0>
2026-03-30 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fbf%252F58bf4540cbbf30476d08c25fd87d86ab%252Fpa%252FGF89520_5756c705003ca2d4ee7eb59c16b0f139.jpg') HTTP/1.1" 204 0
2026-03-30 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_5756c705003ca2d4ee7eb59c16b0f139.jpg saved to cache
2026-03-30 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 941fbdd5-5d11-5347-92a0-36630b5bf69d
2026-03-30 08:00:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 941fbdd5-5d11-5347-92a0-36630b5bf69d, skipping ID generation
2026-03-30 08:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 941fbdd5-5d11-5347-92a0-36630b5bf69d with scrape type 1
2026-03-30 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 941fbdd5-5d11-5347-92a0-36630b5bf69d sending to next pipeline
2026-03-30 08:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 941fbdd5-5d11-5347-92a0-36630b5bf69d, identifier: GF89520
2026-03-30 08:00:58 [auto1.es] INFO: Found listing with ID: XU70286
2026-03-30 08:00:58 [auto1.es] INFO: Found listing with ID: JK50290
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK50290%27 HTTP/1.1" 200 None
2026-03-30 08:00:58 [auto1.es] INFO: Scrape type for JK50290: 2
2026-03-30 08:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cca20fdf-16d0-59db-bdc1-8d75c9cee675 with identifier: JK50290
2026-03-30 08:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cca20fdf-16d0-59db-bdc1-8d75c9cee675 with scrape type 2
2026-03-30 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cca20fdf-16d0-59db-bdc1-8d75c9cee675 with scrape type 2
2026-03-30 08:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cca20fdf-16d0-59db-bdc1-8d75c9cee675, identifier: JK50290
2026-03-30 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT97247> (referer: https://www.auto1.com/v1/car-details-view/JT97247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 941fbdd5-5d11-5347-92a0-36630b5bf69d with identifier: GF89520
2026-03-30 08:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 941fbdd5-5d11-5347-92a0-36630b5bf69d with identifier: GF89520
2026-03-30 08:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 941fbdd5-5d11-5347-92a0-36630b5bf69d with identifier: GF89520 to the API
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_5756c705003ca2d4ee7eb59c16b0f139.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:13:00Z',
 'fuel_type': 'diesel',
 'id': '941fbdd5-5d11-5347-92a0-36630b5bf69d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF89520',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 136219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_103da45e7125d8d1a828016c7b3d579c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_fad783013d38c39067bf7fd7ed24ae8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_e55fc7d5f1a287f060561fad5ad35f16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_be7432aff112bebe33e717e2b1ea2696.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_ed1b5aa75aa490a7ff2d087e70abae6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_f781321f3f9ff3a251236b20ca53eada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_5c63b06216e67dc62e67254bddc4bc4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_ddce624159fa4140c9d1a9806a699ffd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_5756c705003ca2d4ee7eb59c16b0f139.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_941fbdd5-5d11-5347-92a0-36630b5bf69d/941fbdd5-5d11-5347-92a0-36630b5bf69d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/bf/58bf4540cbbf30476d08c25fd87d86ab/pa/GF89520_e571cddf918e3c6b97c803b3fce72571.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2013}
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF89520%27 HTTP/1.1" 200 None
2026-03-30 08:00:59 [auto1.es] INFO: Saving data for GF89520: {'created_time': 1774857659.382645, 'last_price_update_time': 1774857659.382655, 'auction_closing_time': 1774969980.0}
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GF89520') HTTP/1.1" 204 0
2026-03-30 08:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cca20fdf-16d0-59db-bdc1-8d75c9cee675 with identifier: JK50290
2026-03-30 08:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cca20fdf-16d0-59db-bdc1-8d75c9cee675 with identifier: JK50290
2026-03-30 08:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cca20fdf-16d0-59db-bdc1-8d75c9cee675 with identifier: JK50290 to the API
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:35:54Z',
 'fuel_type': 'diesel',
 'id': 'cca20fdf-16d0-59db-bdc1-8d75c9cee675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK50290',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Cordoba',
 'odometer': 316562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-22',
 'seller_name': None,
 'title': 'Seat Cordoba 1.9 TDI Top',
 'transmission': 'manual',
 'trim': 'Top',
 'year': 2006}
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK50290%27 HTTP/1.1" 200 None
2026-03-30 08:00:59 [auto1.es] INFO: Saving data for JK50290: {'auction_closing_time': 1774971354.0, 'created_time': 1774382607.331882, 'last_price_update_time': 1774857659.774887}
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JK50290') HTTP/1.1" 204 0
2026-03-30 08:00:59 [auto1.es] INFO: Found listing with ID: PU11377
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU11377%27 HTTP/1.1" 200 None
2026-03-30 08:00:59 [auto1.es] INFO: Scrape type for PU11377: 2
2026-03-30 08:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f94aaa9-5ee0-531c-a1f0-79272c61f712 with identifier: PU11377
2026-03-30 08:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f94aaa9-5ee0-531c-a1f0-79272c61f712 with scrape type 2
2026-03-30 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f94aaa9-5ee0-531c-a1f0-79272c61f712 with scrape type 2
2026-03-30 08:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4f94aaa9-5ee0-531c-a1f0-79272c61f712, identifier: PU11377
2026-03-30 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP76379> (referer: https://www.auto1.com/v1/car-details-view/EP76379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:00:59 [auto1.es] INFO: Channel: 24h | Page: 4 | totalHits: 2178 | hits on page: 40
2026-03-30 08:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4f94aaa9-5ee0-531c-a1f0-79272c61f712 with identifier: PU11377
2026-03-30 08:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4f94aaa9-5ee0-531c-a1f0-79272c61f712 with identifier: PU11377
2026-03-30 08:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4f94aaa9-5ee0-531c-a1f0-79272c61f712 with identifier: PU11377 to the API
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:14:13Z',
 'fuel_type': 'petrol',
 'id': '4f94aaa9-5ee0-531c-a1f0-79272c61f712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU11377',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 171819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-30',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Essence Plus',
 'transmission': 'manual',
 'trim': 'Essence Plus',
 'year': 2014}
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU11377%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [auto1.es] INFO: Saving data for PU11377: {'auction_closing_time': 1774970053.0, 'created_time': 1774436432.297157, 'last_price_update_time': 1774857660.33983}
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PU11377') HTTP/1.1" 204 0
2026-03-30 08:01:00 [auto1.es] INFO: Found listing with ID: BL04336
2026-03-30 08:01:00 [auto1.es] INFO: Found listing with ID: AK94783
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK94783%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [auto1.es] INFO: Scrape type for AK94783: 2
2026-03-30 08:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb with identifier: AK94783
2026-03-30 08:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb with scrape type 2
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb with scrape type 2
2026-03-30 08:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb, identifier: AK94783
2026-03-30 08:01:00 [auto1.es] INFO: Found listing with ID: KZ85451
2026-03-30 08:01:00 [auto1.es] INFO: Found listing with ID: PY75360
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY75360%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [auto1.es] INFO: Scrape type for PY75360: 2
2026-03-30 08:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4db1f10a-4007-5b4e-980c-f0fea7f27ae7 with identifier: PY75360
2026-03-30 08:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4db1f10a-4007-5b4e-980c-f0fea7f27ae7 with scrape type 2
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4db1f10a-4007-5b4e-980c-f0fea7f27ae7 with scrape type 2
2026-03-30 08:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4db1f10a-4007-5b4e-980c-f0fea7f27ae7, identifier: PY75360
2026-03-30 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f800220a-c87b-54ab-8016-16a49357fc9a with identifier: JT97247
2026-03-30 08:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f800220a-c87b-54ab-8016-16a49357fc9a with scrape type 1
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f800220a-c87b-54ab-8016-16a49357fc9a
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc4%252Fc4c4175d5dba7b452800aa5eeb85de98%252Fpa%252FJT97247_1682eefed6aa707270d32691ebfd8688.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_1682eefed6aa707270d32691ebfd8688.jpg already downloaded
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc4%252Fc4c4175d5dba7b452800aa5eeb85de98%252Fpa%252FJT97247_250b909b3762bd020a65e3aa6e322cfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_250b909b3762bd020a65e3aa6e322cfc.jpg already downloaded
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc4%252Fc4c4175d5dba7b452800aa5eeb85de98%252Fpa%252FJT97247_a9852476385be5e4e4f84db718c7b41c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_a9852476385be5e4e4f84db718c7b41c.jpg already downloaded
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc4%252Fc4c4175d5dba7b452800aa5eeb85de98%252Fpa%252FJT97247_c9abb9629bcae120010f33bd51b0fc9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_c9abb9629bcae120010f33bd51b0fc9c.jpg already downloaded
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc4%252Fc4c4175d5dba7b452800aa5eeb85de98%252Fpa%252FJT97247_ae3ef7f54cf8e45105d3fd4c3c431c88.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_ae3ef7f54cf8e45105d3fd4c3c431c88.jpg already downloaded
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc4%252Fc4c4175d5dba7b452800aa5eeb85de98%252Fpa%252FJT97247_5ce42a28a69794911e3e2e8761a67c86.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_5ce42a28a69794911e3e2e8761a67c86.jpg already downloaded
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc4%252Fc4c4175d5dba7b452800aa5eeb85de98%252Fpa%252FJT97247_bff46cf517d56f89b0af639b21473000.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_bff46cf517d56f89b0af639b21473000.jpg already downloaded
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc4%252Fc4c4175d5dba7b452800aa5eeb85de98%252Fpa%252FJT97247_b5f653e4908792232cd76cebcf1c8e1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_b5f653e4908792232cd76cebcf1c8e1b.jpg already downloaded
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc4%252Fc4c4175d5dba7b452800aa5eeb85de98%252Fpa%252FJT97247_4d425dc20874811e13c72e62cd7f03af.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_4d425dc20874811e13c72e62cd7f03af.jpg already downloaded
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc4%252Fc4c4175d5dba7b452800aa5eeb85de98%252Fpa%252FJT97247_7dda6a611453463697b9a180ebf85b52.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_7dda6a611453463697b9a180ebf85b52.jpg already downloaded
2026-03-30 08:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f800220a-c87b-54ab-8016-16a49357fc9a, identifier: JT97247
2026-03-30 08:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb with identifier: AK94783
2026-03-30 08:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb with identifier: AK94783
2026-03-30 08:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7755331e-2eb8-5ebb-9fbc-adb9e8f605fb with identifier: AK94783 to the API
2026-03-30 08:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:18:07Z',
 'fuel_type': 'diesel',
 'id': '7755331e-2eb8-5ebb-9fbc-adb9e8f605fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK94783',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 194572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-28',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2014}
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK94783%27 HTTP/1.1" 200 None
2026-03-30 08:01:01 [auto1.es] INFO: Saving data for AK94783: {'auction_closing_time': 1774970287.0, 'created_time': 1772626342.689027, 'last_price_update_time': 1774857661.192169}
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AK94783') HTTP/1.1" 204 0
2026-03-30 08:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4db1f10a-4007-5b4e-980c-f0fea7f27ae7 with identifier: PY75360
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 08:01:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4db1f10a-4007-5b4e-980c-f0fea7f27ae7 with identifier: PY75360
2026-03-30 08:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4db1f10a-4007-5b4e-980c-f0fea7f27ae7 with identifier: PY75360 to the API
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-31T15:03:46Z',
 'fuel_type': 'petrol',
 'id': '4db1f10a-4007-5b4e-980c-f0fea7f27ae7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY75360',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'S-TYPE',
 'odometer': 166517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-11-03',
 'seller_name': None,
 'title': 'Jaguar S-TYPE 4.0 V8',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY75360%27 HTTP/1.1" 200 None
2026-03-30 08:01:01 [auto1.es] INFO: Saving data for PY75360: {'auction_closing_time': 1774969426.0, 'created_time': 1773832076.291284, 'last_price_update_time': 1774857661.800278}
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PY75360') HTTP/1.1" 204 0
2026-03-30 08:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f800220a-c87b-54ab-8016-16a49357fc9a with identifier: JT97247
2026-03-30 08:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f800220a-c87b-54ab-8016-16a49357fc9a with identifier: JT97247
2026-03-30 08:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f800220a-c87b-54ab-8016-16a49357fc9a with identifier: JT97247 to the API
2026-03-30 08:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JT97247>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:18:57Z',
 'fuel_type': 'diesel',
 'id': 'f800220a-c87b-54ab-8016-16a49357fc9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT97247',
 'listing': 'auction',
 'location': 'ES, Lucena',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_1682eefed6aa707270d32691ebfd8688.jpg',
                'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_250b909b3762bd020a65e3aa6e322cfc.jpg',
                'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_a9852476385be5e4e4f84db718c7b41c.jpg',
                'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_c9abb9629bcae120010f33bd51b0fc9c.jpg',
                'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_ae3ef7f54cf8e45105d3fd4c3c431c88.jpg',
                'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_5ce42a28a69794911e3e2e8761a67c86.jpg',
                'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_bff46cf517d56f89b0af639b21473000.jpg',
                'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_b5f653e4908792232cd76cebcf1c8e1b.jpg',
                'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_4d425dc20874811e13c72e62cd7f03af.jpg',
                'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_7dda6a611453463697b9a180ebf85b52.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f800220a-c87b-54ab-8016-16a49357fc9a/f800220a-c87b-54ab-8016-16a49357fc9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_1682eefed6aa707270d32691ebfd8688.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f800220a-c87b-54ab-8016-16a49357fc9a/f800220a-c87b-54ab-8016-16a49357fc9a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_250b909b3762bd020a65e3aa6e322cfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f800220a-c87b-54ab-8016-16a49357fc9a/f800220a-c87b-54ab-8016-16a49357fc9a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_a9852476385be5e4e4f84db718c7b41c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f800220a-c87b-54ab-8016-16a49357fc9a/f800220a-c87b-54ab-8016-16a49357fc9a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_c9abb9629bcae120010f33bd51b0fc9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f800220a-c87b-54ab-8016-16a49357fc9a/f800220a-c87b-54ab-8016-16a49357fc9a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_ae3ef7f54cf8e45105d3fd4c3c431c88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f800220a-c87b-54ab-8016-16a49357fc9a/f800220a-c87b-54ab-8016-16a49357fc9a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_5ce42a28a69794911e3e2e8761a67c86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f800220a-c87b-54ab-8016-16a49357fc9a/f800220a-c87b-54ab-8016-16a49357fc9a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_bff46cf517d56f89b0af639b21473000.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f800220a-c87b-54ab-8016-16a49357fc9a/f800220a-c87b-54ab-8016-16a49357fc9a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_b5f653e4908792232cd76cebcf1c8e1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f800220a-c87b-54ab-8016-16a49357fc9a/f800220a-c87b-54ab-8016-16a49357fc9a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_4d425dc20874811e13c72e62cd7f03af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f800220a-c87b-54ab-8016-16a49357fc9a/f800220a-c87b-54ab-8016-16a49357fc9a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/c4/c4c4175d5dba7b452800aa5eeb85de98/pa/JT97247_7dda6a611453463697b9a180ebf85b52.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2017}
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT97247%27 HTTP/1.1" 200 None
2026-03-30 08:01:02 [auto1.es] INFO: Saving data for JT97247: {'created_time': 1774857662.204959, 'last_price_update_time': 1774857662.204969, 'auction_closing_time': 1774970337.0}
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JT97247') HTTP/1.1" 204 0
2026-03-30 08:01:02 [auto1.es] INFO: Found listing with ID: JE94628
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE94628%27 HTTP/1.1" 200 None
2026-03-30 08:01:02 [auto1.es] INFO: Scrape type for JE94628: 2
2026-03-30 08:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c5fcab1-65b3-5c9d-8390-f6b44aca290b with identifier: JE94628
2026-03-30 08:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c5fcab1-65b3-5c9d-8390-f6b44aca290b with scrape type 2
2026-03-30 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c5fcab1-65b3-5c9d-8390-f6b44aca290b with scrape type 2
2026-03-30 08:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c5fcab1-65b3-5c9d-8390-f6b44aca290b, identifier: JE94628
2026-03-30 08:01:02 [auto1.es] INFO: Found listing with ID: GS56941
2026-03-30 08:01:02 [auto1.es] INFO: Found listing with ID: JG42425
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG42425%27 HTTP/1.1" 200 None
2026-03-30 08:01:02 [auto1.es] INFO: Scrape type for JG42425: 2
2026-03-30 08:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 977b1845-8b53-5a0d-ba4d-b72841542a17 with identifier: JG42425
2026-03-30 08:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977b1845-8b53-5a0d-ba4d-b72841542a17 with scrape type 2
2026-03-30 08:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 977b1845-8b53-5a0d-ba4d-b72841542a17 with scrape type 2
2026-03-30 08:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 977b1845-8b53-5a0d-ba4d-b72841542a17, identifier: JG42425
2026-03-30 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS32637> (referer: https://www.auto1.com/v1/car-details-view/MS32637/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c5fcab1-65b3-5c9d-8390-f6b44aca290b with identifier: JE94628
2026-03-30 08:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c5fcab1-65b3-5c9d-8390-f6b44aca290b with identifier: JE94628
2026-03-30 08:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3c5fcab1-65b3-5c9d-8390-f6b44aca290b with identifier: JE94628 to the API
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:43:08Z',
 'fuel_type': 'diesel',
 'id': '3c5fcab1-65b3-5c9d-8390-f6b44aca290b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE94628',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 522091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-11-09',
 'seller_name': None,
 'title': 'Toyota Corolla 2.0 D-4D Compact Sol',
 'transmission': 'manual',
 'trim': 'Compact Sol',
 'year': 2003}
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE94628%27 HTTP/1.1" 200 None
2026-03-30 08:01:02 [auto1.es] INFO: Saving data for JE94628: {'auction_closing_time': 1774971788.0, 'created_time': 1772623010.024085, 'last_price_update_time': 1774857662.840088}
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JE94628') HTTP/1.1" 204 0
2026-03-30 08:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 977b1845-8b53-5a0d-ba4d-b72841542a17 with identifier: JG42425
2026-03-30 08:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 977b1845-8b53-5a0d-ba4d-b72841542a17 with identifier: JG42425
2026-03-30 08:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 977b1845-8b53-5a0d-ba4d-b72841542a17 with identifier: JG42425 to the API
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:05:27Z',
 'fuel_type': 'diesel',
 'id': '977b1845-8b53-5a0d-ba4d-b72841542a17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG42425',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 257810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-23',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 HDi LX Plus',
 'transmission': 'manual',
 'trim': 'LX Plus',
 'year': 2008}
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG42425%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [auto1.es] INFO: Saving data for JG42425: {'auction_closing_time': 1774969527.0, 'created_time': 1774382592.289424, 'last_price_update_time': 1774857663.448085}
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JG42425') HTTP/1.1" 204 0
2026-03-30 08:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f493c441-b067-5bf6-8f29-4d558470cda2 with identifier: EP76379
2026-03-30 08:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f493c441-b067-5bf6-8f29-4d558470cda2 with scrape type 1
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f493c441-b067-5bf6-8f29-4d558470cda2
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F1f%252F1e1f6c70ed3ef9422f7307bbd4762c5f%252Fpa%252FEP76379_db1434b4cc9652d5594391d0769b86c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_db1434b4cc9652d5594391d0769b86c6.jpg already downloaded
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F1f%252F1e1f6c70ed3ef9422f7307bbd4762c5f%252Fpa%252FEP76379_a5de50eb85923a93f9273a601f09c79f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_a5de50eb85923a93f9273a601f09c79f.jpg already downloaded
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F1f%252F1e1f6c70ed3ef9422f7307bbd4762c5f%252Fpa%252FEP76379_3ec0fefcaeb06fb44576de04aa42ca51.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_3ec0fefcaeb06fb44576de04aa42ca51.jpg already downloaded
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F1f%252F1e1f6c70ed3ef9422f7307bbd4762c5f%252Fpa%252FEP76379_3e76fc83aa9936e63c49010bfc80cfad.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_3e76fc83aa9936e63c49010bfc80cfad.jpg already downloaded
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F1f%252F1e1f6c70ed3ef9422f7307bbd4762c5f%252Fpa%252FEP76379_607ae5d5394a3dd83d1d59e9ec8fa0d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_607ae5d5394a3dd83d1d59e9ec8fa0d1.jpg already downloaded
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F1f%252F1e1f6c70ed3ef9422f7307bbd4762c5f%252Fpa%252FEP76379_f2c6bc294c7e2c4c1535146365756a0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_f2c6bc294c7e2c4c1535146365756a0e.jpg already downloaded
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F1f%252F1e1f6c70ed3ef9422f7307bbd4762c5f%252Fpa%252FEP76379_4f2da6a844cc1806bd2da78b44a67f0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_4f2da6a844cc1806bd2da78b44a67f0b.jpg already downloaded
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F1f%252F1e1f6c70ed3ef9422f7307bbd4762c5f%252Fpa%252FEP76379_df1eae33d9a1ba45bdad6f9a05bdd364.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_df1eae33d9a1ba45bdad6f9a05bdd364.jpg already downloaded
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F1f%252F1e1f6c70ed3ef9422f7307bbd4762c5f%252Fpa%252FEP76379_012f51dae23565ce6b4a803789d49d67.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_012f51dae23565ce6b4a803789d49d67.jpg already downloaded
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F1f%252F1e1f6c70ed3ef9422f7307bbd4762c5f%252Fpa%252FEP76379_523b9aa5a7a5ca0ce72c9cd411711f09.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_523b9aa5a7a5ca0ce72c9cd411711f09.jpg already downloaded
2026-03-30 08:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f493c441-b067-5bf6-8f29-4d558470cda2, identifier: EP76379
2026-03-30 08:01:03 [auto1.es] INFO: Found listing with ID: AA87480
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA87480%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [auto1.es] INFO: Scrape type for AA87480: 2
2026-03-30 08:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8273a898-93f5-5ec8-9a11-7bb99b150d99 with identifier: AA87480
2026-03-30 08:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8273a898-93f5-5ec8-9a11-7bb99b150d99 with scrape type 2
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8273a898-93f5-5ec8-9a11-7bb99b150d99 with scrape type 2
2026-03-30 08:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8273a898-93f5-5ec8-9a11-7bb99b150d99, identifier: AA87480
2026-03-30 08:01:03 [auto1.es] INFO: Found listing with ID: ZZ58056
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ58056%27 HTTP/1.1" 200 None
2026-03-30 08:01:03 [auto1.es] INFO: Scrape type for ZZ58056: 2
2026-03-30 08:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4664db3d-dd3d-57bc-9d0d-b7af81eecb00 with identifier: ZZ58056
2026-03-30 08:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4664db3d-dd3d-57bc-9d0d-b7af81eecb00 with scrape type 2
2026-03-30 08:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4664db3d-dd3d-57bc-9d0d-b7af81eecb00 with scrape type 2
2026-03-30 08:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4664db3d-dd3d-57bc-9d0d-b7af81eecb00, identifier: ZZ58056
2026-03-30 08:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f493c441-b067-5bf6-8f29-4d558470cda2 with identifier: EP76379
2026-03-30 08:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f493c441-b067-5bf6-8f29-4d558470cda2 with identifier: EP76379
2026-03-30 08:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f493c441-b067-5bf6-8f29-4d558470cda2 with identifier: EP76379 to the API
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EP76379>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:50:58Z',
 'fuel_type': 'diesel',
 'id': 'f493c441-b067-5bf6-8f29-4d558470cda2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP76379',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 148948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_db1434b4cc9652d5594391d0769b86c6.jpg',
                'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_a5de50eb85923a93f9273a601f09c79f.jpg',
                'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_3ec0fefcaeb06fb44576de04aa42ca51.jpg',
                'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_3e76fc83aa9936e63c49010bfc80cfad.jpg',
                'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_607ae5d5394a3dd83d1d59e9ec8fa0d1.jpg',
                'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_f2c6bc294c7e2c4c1535146365756a0e.jpg',
                'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_4f2da6a844cc1806bd2da78b44a67f0b.jpg',
                'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_df1eae33d9a1ba45bdad6f9a05bdd364.jpg',
                'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_012f51dae23565ce6b4a803789d49d67.jpg',
                'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_523b9aa5a7a5ca0ce72c9cd411711f09.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493c441-b067-5bf6-8f29-4d558470cda2/f493c441-b067-5bf6-8f29-4d558470cda2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_db1434b4cc9652d5594391d0769b86c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493c441-b067-5bf6-8f29-4d558470cda2/f493c441-b067-5bf6-8f29-4d558470cda2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_a5de50eb85923a93f9273a601f09c79f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493c441-b067-5bf6-8f29-4d558470cda2/f493c441-b067-5bf6-8f29-4d558470cda2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_3ec0fefcaeb06fb44576de04aa42ca51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493c441-b067-5bf6-8f29-4d558470cda2/f493c441-b067-5bf6-8f29-4d558470cda2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_3e76fc83aa9936e63c49010bfc80cfad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493c441-b067-5bf6-8f29-4d558470cda2/f493c441-b067-5bf6-8f29-4d558470cda2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_607ae5d5394a3dd83d1d59e9ec8fa0d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493c441-b067-5bf6-8f29-4d558470cda2/f493c441-b067-5bf6-8f29-4d558470cda2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_f2c6bc294c7e2c4c1535146365756a0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493c441-b067-5bf6-8f29-4d558470cda2/f493c441-b067-5bf6-8f29-4d558470cda2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_4f2da6a844cc1806bd2da78b44a67f0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493c441-b067-5bf6-8f29-4d558470cda2/f493c441-b067-5bf6-8f29-4d558470cda2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_df1eae33d9a1ba45bdad6f9a05bdd364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493c441-b067-5bf6-8f29-4d558470cda2/f493c441-b067-5bf6-8f29-4d558470cda2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_012f51dae23565ce6b4a803789d49d67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493c441-b067-5bf6-8f29-4d558470cda2/f493c441-b067-5bf6-8f29-4d558470cda2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/1f/1e1f6c70ed3ef9422f7307bbd4762c5f/pa/EP76379_523b9aa5a7a5ca0ce72c9cd411711f09.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Style 2WD',
 'transmission': 'manual',
 'trim': 'Style 2WD',
 'year': 2013}
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP76379%27 HTTP/1.1" 200 None
2026-03-30 08:01:04 [auto1.es] INFO: Saving data for EP76379: {'created_time': 1774857664.340708, 'last_price_update_time': 1774857664.340719, 'auction_closing_time': 1774972258.0}
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EP76379') HTTP/1.1" 204 0
2026-03-30 08:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8273a898-93f5-5ec8-9a11-7bb99b150d99 with identifier: AA87480
2026-03-30 08:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8273a898-93f5-5ec8-9a11-7bb99b150d99 with identifier: AA87480
2026-03-30 08:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8273a898-93f5-5ec8-9a11-7bb99b150d99 with identifier: AA87480 to the API
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:35:20Z',
 'fuel_type': 'diesel',
 'id': '8273a898-93f5-5ec8-9a11-7bb99b150d99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA87480',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 171137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Edition BlueMotion',
 'transmission': 'manual',
 'trim': 'Edition BlueMotion',
 'year': 2014}
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA87480%27 HTTP/1.1" 200 None
2026-03-30 08:01:04 [auto1.es] INFO: Saving data for AA87480: {'auction_closing_time': 1774971320.0, 'created_time': 1773918118.645644, 'last_price_update_time': 1774857664.717787}
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AA87480') HTTP/1.1" 204 0
2026-03-30 08:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4664db3d-dd3d-57bc-9d0d-b7af81eecb00 with identifier: ZZ58056
2026-03-30 08:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4664db3d-dd3d-57bc-9d0d-b7af81eecb00 with identifier: ZZ58056
2026-03-30 08:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4664db3d-dd3d-57bc-9d0d-b7af81eecb00 with identifier: ZZ58056 to the API
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:30:49Z',
 'fuel_type': 'petrol',
 'id': '4664db3d-dd3d-57bc-9d0d-b7af81eecb00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ58056',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 184666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ58056%27 HTTP/1.1" 200 None
2026-03-30 08:01:05 [auto1.es] INFO: Saving data for ZZ58056: {'auction_closing_time': 1774971049.0, 'created_time': 1772627975.134564, 'last_price_update_time': 1774857665.077718}
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZZ58056') HTTP/1.1" 204 0
2026-03-30 08:01:05 [auto1.es] INFO: Found listing with ID: WX28872
2026-03-30 08:01:05 [auto1.es] INFO: Found listing with ID: XY28790
2026-03-30 08:01:05 [auto1.es] INFO: Found listing with ID: AM26013
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM26013%27 HTTP/1.1" 200 None
2026-03-30 08:01:05 [auto1.es] INFO: Scrape type for AM26013: 2
2026-03-30 08:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de0efa5b-bdff-5c47-9054-3efdf5e18b2c with identifier: AM26013
2026-03-30 08:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de0efa5b-bdff-5c47-9054-3efdf5e18b2c with scrape type 2
2026-03-30 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de0efa5b-bdff-5c47-9054-3efdf5e18b2c with scrape type 2
2026-03-30 08:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de0efa5b-bdff-5c47-9054-3efdf5e18b2c, identifier: AM26013
2026-03-30 08:01:05 [auto1.es] INFO: Found listing with ID: GG87670
2026-03-30 08:01:05 [auto1.es] INFO: Found listing with ID: PZ69063
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ69063%27 HTTP/1.1" 200 None
2026-03-30 08:01:05 [auto1.es] INFO: Scrape type for PZ69063: 2
2026-03-30 08:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce49f02-6ced-5fbb-8bcf-60860f9080aa with identifier: PZ69063
2026-03-30 08:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce49f02-6ced-5fbb-8bcf-60860f9080aa with scrape type 2
2026-03-30 08:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ce49f02-6ced-5fbb-8bcf-60860f9080aa with scrape type 2
2026-03-30 08:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ce49f02-6ced-5fbb-8bcf-60860f9080aa, identifier: PZ69063
2026-03-30 08:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de0efa5b-bdff-5c47-9054-3efdf5e18b2c with identifier: AM26013
2026-03-30 08:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de0efa5b-bdff-5c47-9054-3efdf5e18b2c with identifier: AM26013
2026-03-30 08:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: de0efa5b-bdff-5c47-9054-3efdf5e18b2c with identifier: AM26013 to the API
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:14:54Z',
 'fuel_type': 'petrol',
 'id': 'de0efa5b-bdff-5c47-9054-3efdf5e18b2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM26013',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 174451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-29',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM26013%27 HTTP/1.1" 200 None
2026-03-30 08:01:05 [auto1.es] INFO: Saving data for AM26013: {'auction_closing_time': 1774970094.0, 'created_time': 1772628154.937176, 'last_price_update_time': 1774857665.791519}
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AM26013') HTTP/1.1" 204 0
2026-03-30 08:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ce49f02-6ced-5fbb-8bcf-60860f9080aa with identifier: PZ69063
2026-03-30 08:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ce49f02-6ced-5fbb-8bcf-60860f9080aa with identifier: PZ69063
2026-03-30 08:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3ce49f02-6ced-5fbb-8bcf-60860f9080aa with identifier: PZ69063 to the API
2026-03-30 08:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:24:13Z',
 'fuel_type': 'petrol',
 'id': '3ce49f02-6ced-5fbb-8bcf-60860f9080aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ69063',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 129053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-24',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ69063%27 HTTP/1.1" 200 None
2026-03-30 08:01:06 [auto1.es] INFO: Saving data for PZ69063: {'auction_closing_time': 1774970653.0, 'created_time': 1774296217.546026, 'last_price_update_time': 1774857666.162657}
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PZ69063') HTTP/1.1" 204 0
2026-03-30 08:01:06 [scrapy.extensions.logstats] INFO: Crawled 25 pages (at 25 pages/min), scraped 66 items (at 66 items/min)
2026-03-30 08:01:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 168MiB
2026-03-30 08:01:06 [auto1.es] INFO: Found listing with ID: GB45080
2026-03-30 08:01:06 [auto1.es] INFO: Found listing with ID: JR66808
2026-03-30 08:01:06 [auto1.es] INFO: Found listing with ID: GV33472
2026-03-30 08:01:06 [auto1.es] INFO: Found listing with ID: DB65151
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB65151%27 HTTP/1.1" 200 None
2026-03-30 08:01:06 [auto1.es] INFO: Scrape type for DB65151: 2
2026-03-30 08:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa1639a3-a119-51da-b55c-653d1d31893f with identifier: DB65151
2026-03-30 08:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa1639a3-a119-51da-b55c-653d1d31893f with scrape type 2
2026-03-30 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa1639a3-a119-51da-b55c-653d1d31893f with scrape type 2
2026-03-30 08:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aa1639a3-a119-51da-b55c-653d1d31893f, identifier: DB65151
2026-03-30 08:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5616cdfc-10da-54db-ac7d-efb35c055369 with identifier: MS32637
2026-03-30 08:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5616cdfc-10da-54db-ac7d-efb35c055369 with scrape type 1
2026-03-30 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5616cdfc-10da-54db-ac7d-efb35c055369
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_5a5eb504602f9a7e2a657aa7ba2b9320.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_5a5eb504602f9a7e2a657aa7ba2b9320.jpg not downloaded yet
2026-03-30 08:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aa1639a3-a119-51da-b55c-653d1d31893f with identifier: DB65151
2026-03-30 08:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aa1639a3-a119-51da-b55c-653d1d31893f with identifier: DB65151
2026-03-30 08:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aa1639a3-a119-51da-b55c-653d1d31893f with identifier: DB65151 to the API
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:05:05Z',
 'fuel_type': 'petrol',
 'id': 'aa1639a3-a119-51da-b55c-653d1d31893f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB65151',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 100312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-16',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2008}
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB65151%27 HTTP/1.1" 200 None
2026-03-30 08:01:06 [auto1.es] INFO: Saving data for DB65151: {'auction_closing_time': 1774969505.0, 'created_time': 1774263721.430687, 'last_price_update_time': 1774857666.635408}
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DB65151') HTTP/1.1" 204 0
2026-03-30 08:01:06 [auto1.es] INFO: Found listing with ID: PS72870
2026-03-30 08:01:06 [auto1.es] INFO: Found listing with ID: TV66398
2026-03-30 08:01:06 [auto1.es] INFO: Found listing with ID: CT93709
2026-03-30 08:01:06 [auto1.es] INFO: Found listing with ID: KD33160
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD33160%27 HTTP/1.1" 200 None
2026-03-30 08:01:06 [auto1.es] INFO: Scrape type for KD33160: 2
2026-03-30 08:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b2adb6e-d7fe-5f18-b40b-49416763d0d8 with identifier: KD33160
2026-03-30 08:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b2adb6e-d7fe-5f18-b40b-49416763d0d8 with scrape type 2
2026-03-30 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b2adb6e-d7fe-5f18-b40b-49416763d0d8 with scrape type 2
2026-03-30 08:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2b2adb6e-d7fe-5f18-b40b-49416763d0d8, identifier: KD33160
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_b9383459d4ff965cb4849e25f88e43ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_b9383459d4ff965cb4849e25f88e43ee.jpg not downloaded yet
2026-03-30 08:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2b2adb6e-d7fe-5f18-b40b-49416763d0d8 with identifier: KD33160
2026-03-30 08:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2b2adb6e-d7fe-5f18-b40b-49416763d0d8 with identifier: KD33160
2026-03-30 08:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2b2adb6e-d7fe-5f18-b40b-49416763d0d8 with identifier: KD33160 to the API
2026-03-30 08:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:30:22Z',
 'fuel_type': 'diesel',
 'id': '2b2adb6e-d7fe-5f18-b40b-49416763d0d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD33160',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 359582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-23',
 'seller_name': None,
 'title': 'Renault Trafic 2.5 dCi Passenger Privilege',
 'transmission': 'manual',
 'trim': 'Passenger Privilege',
 'year': 2006}
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD33160%27 HTTP/1.1" 200 None
2026-03-30 08:01:07 [auto1.es] INFO: Saving data for KD33160: {'auction_closing_time': 1774971022.0, 'created_time': 1772022876.291912, 'last_price_update_time': 1774857667.284158}
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KD33160') HTTP/1.1" 204 0
2026-03-30 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP50640> (referer: https://www.auto1.com/v1/car-details-view/KP50640/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:07 [auto1.es] INFO: Found listing with ID: WZ18115
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ18115%27 HTTP/1.1" 200 None
2026-03-30 08:01:07 [auto1.es] INFO: Scrape type for WZ18115: 2
2026-03-30 08:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ec7763a-6d24-519a-81e7-d07836604e9d with identifier: WZ18115
2026-03-30 08:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ec7763a-6d24-519a-81e7-d07836604e9d with scrape type 2
2026-03-30 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ec7763a-6d24-519a-81e7-d07836604e9d with scrape type 2
2026-03-30 08:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5ec7763a-6d24-519a-81e7-d07836604e9d, identifier: WZ18115
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_a787a5ecadc5bfe58ddc80c4157e0435.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_a787a5ecadc5bfe58ddc80c4157e0435.jpg not downloaded yet
2026-03-30 08:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5ec7763a-6d24-519a-81e7-d07836604e9d with identifier: WZ18115
2026-03-30 08:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5ec7763a-6d24-519a-81e7-d07836604e9d with identifier: WZ18115
2026-03-30 08:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5ec7763a-6d24-519a-81e7-d07836604e9d with identifier: WZ18115 to the API
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:10:42Z',
 'fuel_type': 'diesel',
 'id': '5ec7763a-6d24-519a-81e7-d07836604e9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ18115',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 82491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-19',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ18115%27 HTTP/1.1" 200 None
2026-03-30 08:01:07 [auto1.es] INFO: Saving data for WZ18115: {'auction_closing_time': 1774969842.0, 'created_time': 1774447283.162004, 'last_price_update_time': 1774857667.801825}
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WZ18115') HTTP/1.1" 204 0
2026-03-30 08:01:07 [auto1.es] INFO: Found listing with ID: YT69856
2026-03-30 08:01:07 [auto1.es] INFO: Found listing with ID: AJ10793
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ10793%27 HTTP/1.1" 200 None
2026-03-30 08:01:07 [auto1.es] INFO: Scrape type for AJ10793: 2
2026-03-30 08:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4592466-0abf-5cf9-9222-a78019e2b581 with identifier: AJ10793
2026-03-30 08:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4592466-0abf-5cf9-9222-a78019e2b581 with scrape type 2
2026-03-30 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4592466-0abf-5cf9-9222-a78019e2b581 with scrape type 2
2026-03-30 08:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4592466-0abf-5cf9-9222-a78019e2b581, identifier: AJ10793
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_4b7d4a550bf5b0c79d83ebf9edd68dcf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_4b7d4a550bf5b0c79d83ebf9edd68dcf.jpg not downloaded yet
2026-03-30 08:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4592466-0abf-5cf9-9222-a78019e2b581 with identifier: AJ10793
2026-03-30 08:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4592466-0abf-5cf9-9222-a78019e2b581 with identifier: AJ10793
2026-03-30 08:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e4592466-0abf-5cf9-9222-a78019e2b581 with identifier: AJ10793 to the API
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:21:59Z',
 'fuel_type': 'diesel',
 'id': 'e4592466-0abf-5cf9-9222-a78019e2b581',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ10793',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 250456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-17',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ10793%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [auto1.es] INFO: Saving data for AJ10793: {'auction_closing_time': 1774970519.0, 'created_time': 1772625841.706212, 'last_price_update_time': 1774857668.38601}
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AJ10793') HTTP/1.1" 204 0
2026-03-30 08:01:08 [auto1.es] INFO: Channel: 24h | Page: 5 | totalHits: 2178 | hits on page: 40
2026-03-30 08:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e with identifier: KP50640
2026-03-30 08:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e with scrape type 1
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F42%252F6942664d28877e0d4e99d7f572d76d62%252Fpa%252FKP50640_fbebd1ad1aebe72ecfd0c0721efa3561.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_fbebd1ad1aebe72ecfd0c0721efa3561.jpg already downloaded
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F42%252F6942664d28877e0d4e99d7f572d76d62%252Fpa%252FKP50640_0911251c2dd615cc6201d2eba558e5ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_0911251c2dd615cc6201d2eba558e5ff.jpg already downloaded
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F42%252F6942664d28877e0d4e99d7f572d76d62%252Fpa%252FKP50640_56c82d28ea097ea170309471152c4391.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_56c82d28ea097ea170309471152c4391.jpg already downloaded
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F42%252F6942664d28877e0d4e99d7f572d76d62%252Fpa%252FKP50640_9a439f7861d84052822ae3b16c744b99.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_9a439f7861d84052822ae3b16c744b99.jpg already downloaded
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F42%252F6942664d28877e0d4e99d7f572d76d62%252Fpa%252FKP50640_a5a02c49cb2939d249b27bed5e41bc94.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_a5a02c49cb2939d249b27bed5e41bc94.jpg already downloaded
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F42%252F6942664d28877e0d4e99d7f572d76d62%252Fpa%252FKP50640_eae7135c99134762c801bbe728261661.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_eae7135c99134762c801bbe728261661.jpg already downloaded
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F42%252F6942664d28877e0d4e99d7f572d76d62%252Fpa%252FKP50640_654c85d2a6eb4ef8a6888ac48edb18c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_654c85d2a6eb4ef8a6888ac48edb18c5.jpg already downloaded
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F42%252F6942664d28877e0d4e99d7f572d76d62%252Fpa%252FKP50640_8e6796166b6942fd50a7a7531deab761.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_8e6796166b6942fd50a7a7531deab761.jpg already downloaded
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F42%252F6942664d28877e0d4e99d7f572d76d62%252Fpa%252FKP50640_0abd66a9d572ff18fa8a1b3005556a8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_0abd66a9d572ff18fa8a1b3005556a8d.jpg already downloaded
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F42%252F6942664d28877e0d4e99d7f572d76d62%252Fpa%252FKP50640_be4145493a07749414f76755ce7796b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_be4145493a07749414f76755ce7796b5.jpg already downloaded
2026-03-30 08:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e, identifier: KP50640
2026-03-30 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_5a5eb504602f9a7e2a657aa7ba2b9320.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:08 [auto1.es] INFO: Found listing with ID: TR51915
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR51915%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [auto1.es] INFO: Scrape type for TR51915: 2
2026-03-30 08:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13464fcf-c99d-5144-a699-c5d9b7adbc7e with identifier: TR51915
2026-03-30 08:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13464fcf-c99d-5144-a699-c5d9b7adbc7e with scrape type 2
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13464fcf-c99d-5144-a699-c5d9b7adbc7e with scrape type 2
2026-03-30 08:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 13464fcf-c99d-5144-a699-c5d9b7adbc7e, identifier: TR51915
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_8ec7263e10ab23814e6123f7387fe8bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_8ec7263e10ab23814e6123f7387fe8bf.jpg not downloaded yet
2026-03-30 08:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e with identifier: KP50640
2026-03-30 08:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e with identifier: KP50640
2026-03-30 08:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e with identifier: KP50640 to the API
2026-03-30 08:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KP50640>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:51:37Z',
 'fuel_type': 'petrol',
 'id': '12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP50640',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 31497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_fbebd1ad1aebe72ecfd0c0721efa3561.jpg',
                'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_0911251c2dd615cc6201d2eba558e5ff.jpg',
                'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_56c82d28ea097ea170309471152c4391.jpg',
                'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_9a439f7861d84052822ae3b16c744b99.jpg',
                'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_a5a02c49cb2939d249b27bed5e41bc94.jpg',
                'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_eae7135c99134762c801bbe728261661.jpg',
                'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_654c85d2a6eb4ef8a6888ac48edb18c5.jpg',
                'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_8e6796166b6942fd50a7a7531deab761.jpg',
                'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_0abd66a9d572ff18fa8a1b3005556a8d.jpg',
                'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_be4145493a07749414f76755ce7796b5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e/12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5503720,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_fbebd1ad1aebe72ecfd0c0721efa3561.jpg',
             'Width': 4080},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e/12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_0911251c2dd615cc6201d2eba558e5ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e/12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_56c82d28ea097ea170309471152c4391.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e/12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_9a439f7861d84052822ae3b16c744b99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e/12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_a5a02c49cb2939d249b27bed5e41bc94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e/12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_eae7135c99134762c801bbe728261661.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e/12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_654c85d2a6eb4ef8a6888ac48edb18c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e/12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_8e6796166b6942fd50a7a7531deab761.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e/12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_0abd66a9d572ff18fa8a1b3005556a8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e/12712b8a-d9e1-5c66-b0c8-b9cd3fc5f23e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/42/6942664d28877e0d4e99d7f572d76d62/pa/KP50640_be4145493a07749414f76755ce7796b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Leon 1.5 eTSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2025}
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP50640%27 HTTP/1.1" 200 None
2026-03-30 08:01:09 [auto1.es] INFO: Saving data for KP50640: {'created_time': 1774857669.26464, 'last_price_update_time': 1774857669.264653, 'auction_closing_time': 1774972297.0}
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KP50640') HTTP/1.1" 204 0
2026-03-30 08:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 13464fcf-c99d-5144-a699-c5d9b7adbc7e with identifier: TR51915
2026-03-30 08:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 13464fcf-c99d-5144-a699-c5d9b7adbc7e with identifier: TR51915
2026-03-30 08:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 13464fcf-c99d-5144-a699-c5d9b7adbc7e with identifier: TR51915 to the API
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:42:20Z',
 'fuel_type': 'diesel',
 'id': '13464fcf-c99d-5144-a699-c5d9b7adbc7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR51915',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 208375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-04',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Magic',
 'transmission': 'manual',
 'trim': 'Magic',
 'year': 2004}
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR51915%27 HTTP/1.1" 200 None
2026-03-30 08:01:09 [auto1.es] INFO: Saving data for TR51915: {'auction_closing_time': 1774971740.0, 'created_time': 1774004456.948899, 'last_price_update_time': 1774857669.64747}
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TR51915') HTTP/1.1" 204 0
2026-03-30 08:01:09 [auto1.es] INFO: Found listing with ID: UU02684
2026-03-30 08:01:09 [auto1.es] INFO: Found listing with ID: FG09703
2026-03-30 08:01:09 [auto1.es] INFO: Found listing with ID: FX85730
2026-03-30 08:01:09 [auto1.es] INFO: Found listing with ID: MK12831
2026-03-30 08:01:09 [auto1.es] INFO: Found listing with ID: XH30785
2026-03-30 08:01:09 [auto1.es] INFO: Found listing with ID: ZM48966
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM48966%27 HTTP/1.1" 200 None
2026-03-30 08:01:09 [auto1.es] INFO: Scrape type for ZM48966: 2
2026-03-30 08:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f0e5881-ad4a-5e3a-9b1a-840217325170 with identifier: ZM48966
2026-03-30 08:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f0e5881-ad4a-5e3a-9b1a-840217325170 with scrape type 2
2026-03-30 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f0e5881-ad4a-5e3a-9b1a-840217325170 with scrape type 2
2026-03-30 08:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4f0e5881-ad4a-5e3a-9b1a-840217325170, identifier: ZM48966
2026-03-30 08:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_b9383459d4ff965cb4849e25f88e43ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:09 [auto1.es] INFO: Found listing with ID: UP08407
2026-03-30 08:01:09 [auto1.es] INFO: Found listing with ID: US86710
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US86710%27 HTTP/1.1" 200 None
2026-03-30 08:01:09 [auto1.es] INFO: Scrape type for US86710: 2
2026-03-30 08:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60a59006-aade-5dea-8e4a-7c7a200bedf9 with identifier: US86710
2026-03-30 08:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a59006-aade-5dea-8e4a-7c7a200bedf9 with scrape type 2
2026-03-30 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60a59006-aade-5dea-8e4a-7c7a200bedf9 with scrape type 2
2026-03-30 08:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 60a59006-aade-5dea-8e4a-7c7a200bedf9, identifier: US86710
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_fbae2783452683caf5eed1bbf1f8b29c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_fbae2783452683caf5eed1bbf1f8b29c.jpg not downloaded yet
2026-03-30 08:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4f0e5881-ad4a-5e3a-9b1a-840217325170 with identifier: ZM48966
2026-03-30 08:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4f0e5881-ad4a-5e3a-9b1a-840217325170 with identifier: ZM48966
2026-03-30 08:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4f0e5881-ad4a-5e3a-9b1a-840217325170 with identifier: ZM48966 to the API
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:46:58Z',
 'fuel_type': 'petrol',
 'id': '4f0e5881-ad4a-5e3a-9b1a-840217325170',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM48966',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 207823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-02',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM48966%27 HTTP/1.1" 200 None
2026-03-30 08:01:10 [auto1.es] INFO: Saving data for ZM48966: {'auction_closing_time': 1774972018.0, 'created_time': 1772625667.131438, 'last_price_update_time': 1774857670.414184}
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZM48966') HTTP/1.1" 204 0
2026-03-30 08:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 60a59006-aade-5dea-8e4a-7c7a200bedf9 with identifier: US86710
2026-03-30 08:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 60a59006-aade-5dea-8e4a-7c7a200bedf9 with identifier: US86710
2026-03-30 08:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 60a59006-aade-5dea-8e4a-7c7a200bedf9 with identifier: US86710 to the API
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-31T15:21:15Z',
 'fuel_type': 'petrol',
 'id': '60a59006-aade-5dea-8e4a-7c7a200bedf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US86710',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 35025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US86710%27 HTTP/1.1" 200 None
2026-03-30 08:01:10 [auto1.es] INFO: Saving data for US86710: {'auction_closing_time': 1774970475.0, 'created_time': 1774447297.634417, 'last_price_update_time': 1774857670.981187}
2026-03-30 08:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='US86710') HTTP/1.1" 204 0
2026-03-30 08:01:11 [auto1.es] INFO: Found listing with ID: TA62942
2026-03-30 08:01:11 [auto1.es] INFO: Found listing with ID: MJ10048
2026-03-30 08:01:11 [auto1.es] INFO: Found listing with ID: SK09082
2026-03-30 08:01:11 [auto1.es] INFO: Found listing with ID: VY65813
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY65813%27 HTTP/1.1" 200 None
2026-03-30 08:01:11 [auto1.es] INFO: Scrape type for VY65813: 2
2026-03-30 08:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4bb1d81-e5dc-5ff7-b89c-77dc12da0e9e with identifier: VY65813
2026-03-30 08:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4bb1d81-e5dc-5ff7-b89c-77dc12da0e9e with scrape type 2
2026-03-30 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4bb1d81-e5dc-5ff7-b89c-77dc12da0e9e with scrape type 2
2026-03-30 08:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d4bb1d81-e5dc-5ff7-b89c-77dc12da0e9e, identifier: VY65813
2026-03-30 08:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88eb813d0>
2026-03-30 08:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_5a5eb504602f9a7e2a657aa7ba2b9320.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_5a5eb504602f9a7e2a657aa7ba2b9320.jpg saved to cache
2026-03-30 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5616cdfc-10da-54db-ac7d-efb35c055369
2026-03-30 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_a787a5ecadc5bfe58ddc80c4157e0435.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:11 [auto1.es] INFO: Found listing with ID: ZC64439
2026-03-30 08:01:11 [auto1.es] INFO: Found listing with ID: XD33524
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD33524%27 HTTP/1.1" 200 None
2026-03-30 08:01:11 [auto1.es] INFO: Scrape type for XD33524: 2
2026-03-30 08:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fda36584-2b0e-5d60-999d-81cc7aa51fb4 with identifier: XD33524
2026-03-30 08:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda36584-2b0e-5d60-999d-81cc7aa51fb4 with scrape type 2
2026-03-30 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fda36584-2b0e-5d60-999d-81cc7aa51fb4 with scrape type 2
2026-03-30 08:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fda36584-2b0e-5d60-999d-81cc7aa51fb4, identifier: XD33524
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_a806924cb78523612407934c1b8ea77c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_a806924cb78523612407934c1b8ea77c.jpg not downloaded yet
2026-03-30 08:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d4bb1d81-e5dc-5ff7-b89c-77dc12da0e9e with identifier: VY65813
2026-03-30 08:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d4bb1d81-e5dc-5ff7-b89c-77dc12da0e9e with identifier: VY65813
2026-03-30 08:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d4bb1d81-e5dc-5ff7-b89c-77dc12da0e9e with identifier: VY65813 to the API
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:52:30Z',
 'fuel_type': 'petrol',
 'id': 'd4bb1d81-e5dc-5ff7-b89c-77dc12da0e9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY65813',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 47498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-29',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY65813%27 HTTP/1.1" 200 None
2026-03-30 08:01:11 [auto1.es] INFO: Saving data for VY65813: {'auction_closing_time': 1774972350.0, 'created_time': 1774469257.5054, 'last_price_update_time': 1774857671.66568}
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VY65813') HTTP/1.1" 204 0
2026-03-30 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_4b7d4a550bf5b0c79d83ebf9edd68dcf.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fda36584-2b0e-5d60-999d-81cc7aa51fb4 with identifier: XD33524
2026-03-30 08:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fda36584-2b0e-5d60-999d-81cc7aa51fb4 with identifier: XD33524
2026-03-30 08:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fda36584-2b0e-5d60-999d-81cc7aa51fb4 with identifier: XD33524 to the API
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:49:19Z',
 'fuel_type': 'diesel',
 'id': 'fda36584-2b0e-5d60-999d-81cc7aa51fb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD33524',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 242547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-10',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Advance BlueMotion',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion',
 'year': 2015}
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD33524%27 HTTP/1.1" 200 None
2026-03-30 08:01:12 [auto1.es] INFO: Saving data for XD33524: {'auction_closing_time': 1774972159.0, 'created_time': 1774468832.527608, 'last_price_update_time': 1774857672.045799}
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XD33524') HTTP/1.1" 204 0
2026-03-30 08:01:12 [auto1.es] INFO: Found listing with ID: MC76243
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC76243%27 HTTP/1.1" 200 None
2026-03-30 08:01:12 [auto1.es] INFO: Scrape type for MC76243: 2
2026-03-30 08:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cafb9d6c-c779-5404-8be6-a0b066ace1f9 with identifier: MC76243
2026-03-30 08:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cafb9d6c-c779-5404-8be6-a0b066ace1f9 with scrape type 2
2026-03-30 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cafb9d6c-c779-5404-8be6-a0b066ace1f9 with scrape type 2
2026-03-30 08:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cafb9d6c-c779-5404-8be6-a0b066ace1f9, identifier: MC76243
2026-03-30 08:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e030050>
2026-03-30 08:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_b9383459d4ff965cb4849e25f88e43ee.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_b9383459d4ff965cb4849e25f88e43ee.jpg saved to cache
2026-03-30 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5616cdfc-10da-54db-ac7d-efb35c055369
2026-03-30 08:01:12 [auto1.es] INFO: Found listing with ID: ZT32060
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT32060%27 HTTP/1.1" 200 None
2026-03-30 08:01:12 [auto1.es] INFO: Scrape type for ZT32060: 2
2026-03-30 08:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3800a56-c98b-55e7-ad38-e3b9ba7d99d8 with identifier: ZT32060
2026-03-30 08:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3800a56-c98b-55e7-ad38-e3b9ba7d99d8 with scrape type 2
2026-03-30 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3800a56-c98b-55e7-ad38-e3b9ba7d99d8 with scrape type 2
2026-03-30 08:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d3800a56-c98b-55e7-ad38-e3b9ba7d99d8, identifier: ZT32060
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_038269801213e7dfecb7d3ae1eeceba0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_038269801213e7dfecb7d3ae1eeceba0.jpg not downloaded yet
2026-03-30 08:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cafb9d6c-c779-5404-8be6-a0b066ace1f9 with identifier: MC76243
2026-03-30 08:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cafb9d6c-c779-5404-8be6-a0b066ace1f9 with identifier: MC76243
2026-03-30 08:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cafb9d6c-c779-5404-8be6-a0b066ace1f9 with identifier: MC76243 to the API
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:47:54Z',
 'fuel_type': 'petrol',
 'id': 'cafb9d6c-c779-5404-8be6-a0b066ace1f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC76243',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 14963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-11',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line Design',
 'transmission': 'automatic',
 'trim': 'ST-Line Design',
 'year': 2024}
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC76243%27 HTTP/1.1" 200 None
2026-03-30 08:01:12 [auto1.es] INFO: Saving data for MC76243: {'auction_closing_time': 1774972074.0, 'created_time': 1773832512.076499, 'last_price_update_time': 1774857672.701009}
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MC76243') HTTP/1.1" 204 0
2026-03-30 08:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d3800a56-c98b-55e7-ad38-e3b9ba7d99d8 with identifier: ZT32060
2026-03-30 08:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d3800a56-c98b-55e7-ad38-e3b9ba7d99d8 with identifier: ZT32060
2026-03-30 08:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d3800a56-c98b-55e7-ad38-e3b9ba7d99d8 with identifier: ZT32060 to the API
2026-03-30 08:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:14:50Z',
 'fuel_type': 'diesel',
 'id': 'd3800a56-c98b-55e7-ad38-e3b9ba7d99d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT32060',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 178515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Business BlueMotion Tech',
 'year': 2015}
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT32060%27 HTTP/1.1" 200 None
2026-03-30 08:01:13 [auto1.es] INFO: Saving data for ZT32060: {'auction_closing_time': 1774970090.0, 'created_time': 1773126774.457792, 'last_price_update_time': 1774857673.134461}
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZT32060') HTTP/1.1" 204 0
2026-03-30 08:01:13 [auto1.es] INFO: Found listing with ID: FJ90358
2026-03-30 08:01:13 [auto1.es] INFO: Found listing with ID: DN61356
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN61356%27 HTTP/1.1" 200 None
2026-03-30 08:01:13 [auto1.es] INFO: Scrape type for DN61356: 2
2026-03-30 08:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e4c2b99-e002-5123-be34-49cf2f3d21c8 with identifier: DN61356
2026-03-30 08:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e4c2b99-e002-5123-be34-49cf2f3d21c8 with scrape type 2
2026-03-30 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e4c2b99-e002-5123-be34-49cf2f3d21c8 with scrape type 2
2026-03-30 08:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e4c2b99-e002-5123-be34-49cf2f3d21c8, identifier: DN61356
2026-03-30 08:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e025090>
2026-03-30 08:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_a787a5ecadc5bfe58ddc80c4157e0435.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_a787a5ecadc5bfe58ddc80c4157e0435.jpg saved to cache
2026-03-30 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5616cdfc-10da-54db-ac7d-efb35c055369
2026-03-30 08:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_8ec7263e10ab23814e6123f7387fe8bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:13 [auto1.es] INFO: Found listing with ID: XS01276
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS01276%27 HTTP/1.1" 200 None
2026-03-30 08:01:13 [auto1.es] INFO: Scrape type for XS01276: 2
2026-03-30 08:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a578254d-aafb-588f-9fb4-a9c67c99c9f4 with identifier: XS01276
2026-03-30 08:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a578254d-aafb-588f-9fb4-a9c67c99c9f4 with scrape type 2
2026-03-30 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a578254d-aafb-588f-9fb4-a9c67c99c9f4 with scrape type 2
2026-03-30 08:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a578254d-aafb-588f-9fb4-a9c67c99c9f4, identifier: XS01276
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_176be39806dc78c6eba4fa280306939b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_176be39806dc78c6eba4fa280306939b.jpg not downloaded yet
2026-03-30 08:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e4c2b99-e002-5123-be34-49cf2f3d21c8 with identifier: DN61356
2026-03-30 08:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e4c2b99-e002-5123-be34-49cf2f3d21c8 with identifier: DN61356
2026-03-30 08:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8e4c2b99-e002-5123-be34-49cf2f3d21c8 with identifier: DN61356 to the API
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:42:36Z',
 'fuel_type': 'diesel',
 'id': '8e4c2b99-e002-5123-be34-49cf2f3d21c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN61356',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 147887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-30',
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN61356%27 HTTP/1.1" 200 None
2026-03-30 08:01:13 [auto1.es] INFO: Saving data for DN61356: {'auction_closing_time': 1774971756.0, 'created_time': 1774361164.848994, 'last_price_update_time': 1774857673.814492}
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DN61356') HTTP/1.1" 204 0
2026-03-30 08:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e99edd0>
2026-03-30 08:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_4b7d4a550bf5b0c79d83ebf9edd68dcf.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_4b7d4a550bf5b0c79d83ebf9edd68dcf.jpg saved to cache
2026-03-30 08:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5616cdfc-10da-54db-ac7d-efb35c055369
2026-03-30 08:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_fbae2783452683caf5eed1bbf1f8b29c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a578254d-aafb-588f-9fb4-a9c67c99c9f4 with identifier: XS01276
2026-03-30 08:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a578254d-aafb-588f-9fb4-a9c67c99c9f4 with identifier: XS01276
2026-03-30 08:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a578254d-aafb-588f-9fb4-a9c67c99c9f4 with identifier: XS01276 to the API
2026-03-30 08:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:03:36Z',
 'fuel_type': 'diesel',
 'id': 'a578254d-aafb-588f-9fb4-a9c67c99c9f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS01276',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 342591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-20',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Reference Plus',
 'transmission': 'manual',
 'trim': 'Reference Plus',
 'year': 2015}
2026-03-30 08:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS01276%27 HTTP/1.1" 200 None
2026-03-30 08:01:14 [auto1.es] INFO: Saving data for XS01276: {'auction_closing_time': 1774969416.0, 'created_time': 1773950542.170986, 'last_price_update_time': 1774857674.782658}
2026-03-30 08:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XS01276') HTTP/1.1" 204 0
2026-03-30 08:01:14 [auto1.es] INFO: Found listing with ID: GF58352
2026-03-30 08:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF58352%27 HTTP/1.1" 200 None
2026-03-30 08:01:14 [auto1.es] INFO: Scrape type for GF58352: 1
2026-03-30 08:01:14 [auto1.es] INFO: Found listing with ID: ZD82589
2026-03-30 08:01:14 [auto1.es] INFO: Found listing with ID: KX39687
2026-03-30 08:01:14 [auto1.es] INFO: Found listing with ID: GU11449
2026-03-30 08:01:14 [auto1.es] INFO: Found listing with ID: AE81876
2026-03-30 08:01:14 [auto1.es] INFO: Found listing with ID: ET53098
2026-03-30 08:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET53098%27 HTTP/1.1" 200 None
2026-03-30 08:01:14 [auto1.es] INFO: Scrape type for ET53098: 2
2026-03-30 08:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8affc66c-792d-5d67-b31c-30dd31d7ae2c with identifier: ET53098
2026-03-30 08:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8affc66c-792d-5d67-b31c-30dd31d7ae2c with scrape type 2
2026-03-30 08:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8affc66c-792d-5d67-b31c-30dd31d7ae2c with scrape type 2
2026-03-30 08:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8affc66c-792d-5d67-b31c-30dd31d7ae2c, identifier: ET53098
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_68a18ab3acf54a5e334ba6b120a7eeb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_68a18ab3acf54a5e334ba6b120a7eeb4.jpg not downloaded yet
2026-03-30 08:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_a806924cb78523612407934c1b8ea77c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8affc66c-792d-5d67-b31c-30dd31d7ae2c with identifier: ET53098
2026-03-30 08:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8affc66c-792d-5d67-b31c-30dd31d7ae2c with identifier: ET53098
2026-03-30 08:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8affc66c-792d-5d67-b31c-30dd31d7ae2c with identifier: ET53098 to the API
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:40:40Z',
 'fuel_type': 'diesel',
 'id': '8affc66c-792d-5d67-b31c-30dd31d7ae2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET53098',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 85767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET53098%27 HTTP/1.1" 200 None
2026-03-30 08:01:15 [auto1.es] INFO: Saving data for ET53098: {'auction_closing_time': 1774971640.0, 'created_time': 1773691355.473167, 'last_price_update_time': 1774857675.599077}
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ET53098') HTTP/1.1" 204 0
2026-03-30 08:01:15 [auto1.es] INFO: Found listing with ID: JL56851
2026-03-30 08:01:15 [auto1.es] INFO: Found listing with ID: DW89580
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW89580%27 HTTP/1.1" 200 None
2026-03-30 08:01:15 [auto1.es] INFO: Scrape type for DW89580: 2
2026-03-30 08:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 391eded5-b5b5-5f29-b462-d1bfd001ea8c with identifier: DW89580
2026-03-30 08:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 391eded5-b5b5-5f29-b462-d1bfd001ea8c with scrape type 2
2026-03-30 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 391eded5-b5b5-5f29-b462-d1bfd001ea8c with scrape type 2
2026-03-30 08:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 391eded5-b5b5-5f29-b462-d1bfd001ea8c, identifier: DW89580
2026-03-30 08:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e007f90>
2026-03-30 08:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_8ec7263e10ab23814e6123f7387fe8bf.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_8ec7263e10ab23814e6123f7387fe8bf.jpg saved to cache
2026-03-30 08:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5616cdfc-10da-54db-ac7d-efb35c055369
2026-03-30 08:01:15 [auto1.es] INFO: Found listing with ID: XN19340
2026-03-30 08:01:15 [auto1.es] INFO: Found listing with ID: YM13898
2026-03-30 08:01:15 [auto1.es] INFO: Found listing with ID: NR52566
2026-03-30 08:01:15 [auto1.es] INFO: Found listing with ID: BE54244
2026-03-30 08:01:15 [auto1.es] INFO: Found listing with ID: XC34643
2026-03-30 08:01:15 [auto1.es] INFO: Found listing with ID: TC87542
2026-03-30 08:01:15 [auto1.es] INFO: Found listing with ID: WU38219
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU38219%27 HTTP/1.1" 200 None
2026-03-30 08:01:15 [auto1.es] INFO: Scrape type for WU38219: 1
2026-03-30 08:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 391eded5-b5b5-5f29-b462-d1bfd001ea8c with identifier: DW89580
2026-03-30 08:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 391eded5-b5b5-5f29-b462-d1bfd001ea8c with identifier: DW89580
2026-03-30 08:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 391eded5-b5b5-5f29-b462-d1bfd001ea8c with identifier: DW89580 to the API
2026-03-30 08:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:02:31Z',
 'fuel_type': 'diesel',
 'id': '391eded5-b5b5-5f29-b462-d1bfd001ea8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW89580',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 271172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-30',
 'seller_name': None,
 'title': 'Honda CR-V 2.2 CTDI Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2007}
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW89580%27 HTTP/1.1" 200 None
2026-03-30 08:01:16 [auto1.es] INFO: Saving data for DW89580: {'auction_closing_time': 1774969351.0, 'created_time': 1772623233.622924, 'last_price_update_time': 1774857676.20529}
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DW89580') HTTP/1.1" 204 0
2026-03-30 08:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_038269801213e7dfecb7d3ae1eeceba0.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:16 [auto1.es] INFO: Found listing with ID: RS73329
2026-03-30 08:01:16 [auto1.es] INFO: Found listing with ID: VL94048
2026-03-30 08:01:16 [auto1.es] INFO: Found listing with ID: LU76914
2026-03-30 08:01:16 [auto1.es] INFO: Found listing with ID: AA17148
2026-03-30 08:01:16 [auto1.es] INFO: Found listing with ID: YH68644
2026-03-30 08:01:16 [auto1.es] INFO: Found listing with ID: UR10895
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR10895%27 HTTP/1.1" 200 None
2026-03-30 08:01:16 [auto1.es] INFO: Scrape type for UR10895: 2
2026-03-30 08:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40ce9bff-7e8e-5ab6-99e5-4313b9e9e731 with identifier: UR10895
2026-03-30 08:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40ce9bff-7e8e-5ab6-99e5-4313b9e9e731 with scrape type 2
2026-03-30 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40ce9bff-7e8e-5ab6-99e5-4313b9e9e731 with scrape type 2
2026-03-30 08:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 40ce9bff-7e8e-5ab6-99e5-4313b9e9e731, identifier: UR10895
2026-03-30 08:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e953ed0>
2026-03-30 08:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_fbae2783452683caf5eed1bbf1f8b29c.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_fbae2783452683caf5eed1bbf1f8b29c.jpg saved to cache
2026-03-30 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5616cdfc-10da-54db-ac7d-efb35c055369
2026-03-30 08:01:16 [auto1.es] INFO: Found listing with ID: XB87201
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB87201%27 HTTP/1.1" 200 None
2026-03-30 08:01:16 [auto1.es] INFO: Scrape type for XB87201: 2
2026-03-30 08:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7018ecda-ed26-5792-852f-5298995a1788 with identifier: XB87201
2026-03-30 08:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7018ecda-ed26-5792-852f-5298995a1788 with scrape type 2
2026-03-30 08:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7018ecda-ed26-5792-852f-5298995a1788 with scrape type 2
2026-03-30 08:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7018ecda-ed26-5792-852f-5298995a1788, identifier: XB87201
2026-03-30 08:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 40ce9bff-7e8e-5ab6-99e5-4313b9e9e731 with identifier: UR10895
2026-03-30 08:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 40ce9bff-7e8e-5ab6-99e5-4313b9e9e731 with identifier: UR10895
2026-03-30 08:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 40ce9bff-7e8e-5ab6-99e5-4313b9e9e731 with identifier: UR10895 to the API
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:30:11Z',
 'fuel_type': 'diesel',
 'id': '40ce9bff-7e8e-5ab6-99e5-4313b9e9e731',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR10895',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 178773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-11',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Business Class',
 'transmission': 'automatic',
 'trim': 'Business Class',
 'year': 2011}
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR10895%27 HTTP/1.1" 200 None
2026-03-30 08:01:17 [auto1.es] INFO: Saving data for UR10895: {'auction_closing_time': 1774971011.0, 'created_time': 1773132020.052464, 'last_price_update_time': 1774857677.039575}
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UR10895') HTTP/1.1" 204 0
2026-03-30 08:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7018ecda-ed26-5792-852f-5298995a1788 with identifier: XB87201
2026-03-30 08:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7018ecda-ed26-5792-852f-5298995a1788 with identifier: XB87201
2026-03-30 08:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7018ecda-ed26-5792-852f-5298995a1788 with identifier: XB87201 to the API
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:40:19Z',
 'fuel_type': 'petrol',
 'id': '7018ecda-ed26-5792-852f-5298995a1788',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB87201',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 165157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-15',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Cup 2WD',
 'transmission': 'manual',
 'trim': 'Cup 2WD',
 'year': 2008}
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB87201%27 HTTP/1.1" 200 None
2026-03-30 08:01:17 [auto1.es] INFO: Saving data for XB87201: {'auction_closing_time': 1774971619.0, 'created_time': 1774447261.639487, 'last_price_update_time': 1774857677.434646}
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XB87201') HTTP/1.1" 204 0
2026-03-30 08:01:17 [auto1.es] INFO: Found listing with ID: XZ34869
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ34869%27 HTTP/1.1" 200 None
2026-03-30 08:01:17 [auto1.es] INFO: Scrape type for XZ34869: 2
2026-03-30 08:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0686f36e-0a75-56a3-b15b-fa1660ffbc40 with identifier: XZ34869
2026-03-30 08:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0686f36e-0a75-56a3-b15b-fa1660ffbc40 with scrape type 2
2026-03-30 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0686f36e-0a75-56a3-b15b-fa1660ffbc40 with scrape type 2
2026-03-30 08:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0686f36e-0a75-56a3-b15b-fa1660ffbc40, identifier: XZ34869
2026-03-30 08:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ebbdf10>
2026-03-30 08:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_a806924cb78523612407934c1b8ea77c.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_a806924cb78523612407934c1b8ea77c.jpg saved to cache
2026-03-30 08:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5616cdfc-10da-54db-ac7d-efb35c055369
2026-03-30 08:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_176be39806dc78c6eba4fa280306939b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:17 [auto1.es] INFO: Found listing with ID: HV65502
2026-03-30 08:01:17 [auto1.es] INFO: Found listing with ID: LE33983
2026-03-30 08:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0686f36e-0a75-56a3-b15b-fa1660ffbc40 with identifier: XZ34869
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 08:01:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0686f36e-0a75-56a3-b15b-fa1660ffbc40 with identifier: XZ34869
2026-03-30 08:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0686f36e-0a75-56a3-b15b-fa1660ffbc40 with identifier: XZ34869 to the API
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 404,
 'expiration_date': '2026-03-31T15:01:46Z',
 'fuel_type': 'hybrid',
 'id': '0686f36e-0a75-56a3-b15b-fa1660ffbc40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ34869',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 106228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-26',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 2.0 Hybrid HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2019}
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ34869%27 HTTP/1.1" 200 None
2026-03-30 08:01:18 [auto1.es] INFO: Saving data for XZ34869: {'auction_closing_time': 1774969306.0, 'created_time': 1774447307.50916, 'last_price_update_time': 1774857678.08566}
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ34869') HTTP/1.1" 204 0
2026-03-30 08:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_68a18ab3acf54a5e334ba6b120a7eeb4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:18 [auto1.es] INFO: Found listing with ID: ZL13799
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL13799%27 HTTP/1.1" 200 None
2026-03-30 08:01:18 [auto1.es] INFO: Scrape type for ZL13799: 2
2026-03-30 08:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87aed0e0-f3cb-5b65-a210-8622a3202892 with identifier: ZL13799
2026-03-30 08:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87aed0e0-f3cb-5b65-a210-8622a3202892 with scrape type 2
2026-03-30 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87aed0e0-f3cb-5b65-a210-8622a3202892 with scrape type 2
2026-03-30 08:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 87aed0e0-f3cb-5b65-a210-8622a3202892, identifier: ZL13799
2026-03-30 08:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 87aed0e0-f3cb-5b65-a210-8622a3202892 with identifier: ZL13799
2026-03-30 08:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 87aed0e0-f3cb-5b65-a210-8622a3202892 with identifier: ZL13799
2026-03-30 08:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 87aed0e0-f3cb-5b65-a210-8622a3202892 with identifier: ZL13799 to the API
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:25:00Z',
 'fuel_type': 'diesel',
 'id': '87aed0e0-f3cb-5b65-a210-8622a3202892',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL13799',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 201681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL13799%27 HTTP/1.1" 200 None
2026-03-30 08:01:18 [auto1.es] INFO: Saving data for ZL13799: {'auction_closing_time': 1774970700.0, 'created_time': 1773133653.819669, 'last_price_update_time': 1774857678.650772}
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL13799') HTTP/1.1" 204 0
2026-03-30 08:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88df220d0>
2026-03-30 08:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_038269801213e7dfecb7d3ae1eeceba0.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_038269801213e7dfecb7d3ae1eeceba0.jpg saved to cache
2026-03-30 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5616cdfc-10da-54db-ac7d-efb35c055369
2026-03-30 08:01:18 [auto1.es] INFO: Found listing with ID: MJ09800
2026-03-30 08:01:18 [auto1.es] INFO: Found listing with ID: PR87201
2026-03-30 08:01:18 [auto1.es] INFO: Found listing with ID: JL97970
2026-03-30 08:01:18 [auto1.es] INFO: Found listing with ID: TM82806
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM82806%27 HTTP/1.1" 200 None
2026-03-30 08:01:18 [auto1.es] INFO: Scrape type for TM82806: 2
2026-03-30 08:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 306f7d14-2b40-5baf-96dd-139cf61ef483 with identifier: TM82806
2026-03-30 08:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306f7d14-2b40-5baf-96dd-139cf61ef483 with scrape type 2
2026-03-30 08:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 306f7d14-2b40-5baf-96dd-139cf61ef483 with scrape type 2
2026-03-30 08:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 306f7d14-2b40-5baf-96dd-139cf61ef483, identifier: TM82806
2026-03-30 08:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 306f7d14-2b40-5baf-96dd-139cf61ef483 with identifier: TM82806
2026-03-30 08:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 306f7d14-2b40-5baf-96dd-139cf61ef483 with identifier: TM82806
2026-03-30 08:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 306f7d14-2b40-5baf-96dd-139cf61ef483 with identifier: TM82806 to the API
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:26:38Z',
 'fuel_type': 'petrol',
 'id': '306f7d14-2b40-5baf-96dd-139cf61ef483',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM82806',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 100760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-21',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM82806%27 HTTP/1.1" 200 None
2026-03-30 08:01:19 [auto1.es] INFO: Saving data for TM82806: {'auction_closing_time': 1774970798.0, 'created_time': 1773518517.932436, 'last_price_update_time': 1774857679.345504}
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TM82806') HTTP/1.1" 204 0
2026-03-30 08:01:19 [auto1.es] INFO: Found listing with ID: NE32180
2026-03-30 08:01:19 [auto1.es] INFO: Found listing with ID: NC38071
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC38071%27 HTTP/1.1" 200 None
2026-03-30 08:01:19 [auto1.es] INFO: Scrape type for NC38071: 1
2026-03-30 08:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ebbf350>
2026-03-30 08:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_176be39806dc78c6eba4fa280306939b.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_176be39806dc78c6eba4fa280306939b.jpg saved to cache
2026-03-30 08:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5616cdfc-10da-54db-ac7d-efb35c055369
2026-03-30 08:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc894afd010>
2026-03-30 08:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F80%252Fd9806eda8de14f2ede8cf9a6ecb5c906%252Fpa%252FMS32637_68a18ab3acf54a5e334ba6b120a7eeb4.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_68a18ab3acf54a5e334ba6b120a7eeb4.jpg saved to cache
2026-03-30 08:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5616cdfc-10da-54db-ac7d-efb35c055369
2026-03-30 08:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5616cdfc-10da-54db-ac7d-efb35c055369, skipping ID generation
2026-03-30 08:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5616cdfc-10da-54db-ac7d-efb35c055369 with scrape type 1
2026-03-30 08:01:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5616cdfc-10da-54db-ac7d-efb35c055369 sending to next pipeline
2026-03-30 08:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5616cdfc-10da-54db-ac7d-efb35c055369, identifier: MS32637
2026-03-30 08:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5616cdfc-10da-54db-ac7d-efb35c055369 with identifier: MS32637
2026-03-30 08:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5616cdfc-10da-54db-ac7d-efb35c055369 with identifier: MS32637
2026-03-30 08:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5616cdfc-10da-54db-ac7d-efb35c055369 with identifier: MS32637 to the API
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_68a18ab3acf54a5e334ba6b120a7eeb4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:07:54Z',
 'fuel_type': 'diesel',
 'id': '5616cdfc-10da-54db-ac7d-efb35c055369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS32637',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 304394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_5a5eb504602f9a7e2a657aa7ba2b9320.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_b9383459d4ff965cb4849e25f88e43ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_a787a5ecadc5bfe58ddc80c4157e0435.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_4b7d4a550bf5b0c79d83ebf9edd68dcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_8ec7263e10ab23814e6123f7387fe8bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_fbae2783452683caf5eed1bbf1f8b29c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_a806924cb78523612407934c1b8ea77c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_038269801213e7dfecb7d3ae1eeceba0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_176be39806dc78c6eba4fa280306939b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5616cdfc-10da-54db-ac7d-efb35c055369/5616cdfc-10da-54db-ac7d-efb35c055369_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/80/d9806eda8de14f2ede8cf9a6ecb5c906/pa/MS32637_68a18ab3acf54a5e334ba6b120a7eeb4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 08:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS32637%27 HTTP/1.1" 200 None
2026-03-30 08:01:20 [auto1.es] INFO: Saving data for MS32637: {'created_time': 1774857680.006418, 'last_price_update_time': 1774857680.006429, 'auction_closing_time': 1774969674.0}
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MS32637') HTTP/1.1" 204 0
2026-03-30 08:01:20 [auto1.es] INFO: Found listing with ID: PX21457
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX21457%27 HTTP/1.1" 200 None
2026-03-30 08:01:20 [auto1.es] INFO: Scrape type for PX21457: 2
2026-03-30 08:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee20bdb9-d23b-5708-a1d0-b22a3e6d5aea with identifier: PX21457
2026-03-30 08:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee20bdb9-d23b-5708-a1d0-b22a3e6d5aea with scrape type 2
2026-03-30 08:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee20bdb9-d23b-5708-a1d0-b22a3e6d5aea with scrape type 2
2026-03-30 08:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee20bdb9-d23b-5708-a1d0-b22a3e6d5aea, identifier: PX21457
2026-03-30 08:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee20bdb9-d23b-5708-a1d0-b22a3e6d5aea with identifier: PX21457
2026-03-30 08:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee20bdb9-d23b-5708-a1d0-b22a3e6d5aea with identifier: PX21457
2026-03-30 08:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ee20bdb9-d23b-5708-a1d0-b22a3e6d5aea with identifier: PX21457 to the API
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:00:39Z',
 'fuel_type': 'diesel',
 'id': 'ee20bdb9-d23b-5708-a1d0-b22a3e6d5aea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX21457',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 297788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-22',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 Blue-HDi Confort M',
 'transmission': 'manual',
 'trim': 'Confort M',
 'year': 2016}
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX21457%27 HTTP/1.1" 200 None
2026-03-30 08:01:20 [auto1.es] INFO: Saving data for PX21457: {'auction_closing_time': 1774969239.0, 'created_time': 1774036895.627643, 'last_price_update_time': 1774857680.552472}
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PX21457') HTTP/1.1" 204 0
2026-03-30 08:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:20 [auto1.es] INFO: Channel: 24h | Page: 6 | totalHits: 2178 | hits on page: 40
2026-03-30 08:01:20 [auto1.es] INFO: Found listing with ID: KB34619
2026-03-30 08:01:20 [auto1.es] INFO: Found listing with ID: MY97846
2026-03-30 08:01:20 [auto1.es] INFO: Found listing with ID: EV84602
2026-03-30 08:01:20 [auto1.es] INFO: Found listing with ID: HG89264
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG89264%27 HTTP/1.1" 200 None
2026-03-30 08:01:20 [auto1.es] INFO: Scrape type for HG89264: 2
2026-03-30 08:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e4444b-20d7-5bc7-89b7-98a4a9915c1b with identifier: HG89264
2026-03-30 08:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e4444b-20d7-5bc7-89b7-98a4a9915c1b with scrape type 2
2026-03-30 08:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75e4444b-20d7-5bc7-89b7-98a4a9915c1b with scrape type 2
2026-03-30 08:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75e4444b-20d7-5bc7-89b7-98a4a9915c1b, identifier: HG89264
2026-03-30 08:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF58352/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75e4444b-20d7-5bc7-89b7-98a4a9915c1b with identifier: HG89264
2026-03-30 08:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75e4444b-20d7-5bc7-89b7-98a4a9915c1b with identifier: HG89264
2026-03-30 08:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 75e4444b-20d7-5bc7-89b7-98a4a9915c1b with identifier: HG89264 to the API
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:11:20Z',
 'fuel_type': 'diesel',
 'id': '75e4444b-20d7-5bc7-89b7-98a4a9915c1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG89264',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 213008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-04',
 'seller_name': None,
 'title': 'Honda CR-V 2.2 DTEC Executive 4WD',
 'transmission': 'automatic',
 'trim': 'Executive 4WD',
 'year': 2013}
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG89264%27 HTTP/1.1" 200 None
2026-03-30 08:01:21 [auto1.es] INFO: Saving data for HG89264: {'auction_closing_time': 1774969880.0, 'created_time': 1773864758.245488, 'last_price_update_time': 1774857681.10633}
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HG89264') HTTP/1.1" 204 0
2026-03-30 08:01:21 [auto1.es] INFO: Found listing with ID: PY76001
2026-03-30 08:01:21 [auto1.es] INFO: Found listing with ID: YS16436
2026-03-30 08:01:21 [auto1.es] INFO: Found listing with ID: GD38057
2026-03-30 08:01:21 [auto1.es] INFO: Found listing with ID: XM10177
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM10177%27 HTTP/1.1" 200 None
2026-03-30 08:01:21 [auto1.es] INFO: Scrape type for XM10177: 2
2026-03-30 08:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f14f40-01f4-5213-8ec7-009afe1ffedb with identifier: XM10177
2026-03-30 08:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f14f40-01f4-5213-8ec7-009afe1ffedb with scrape type 2
2026-03-30 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5f14f40-01f4-5213-8ec7-009afe1ffedb with scrape type 2
2026-03-30 08:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c5f14f40-01f4-5213-8ec7-009afe1ffedb, identifier: XM10177
2026-03-30 08:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:21 [auto1.es] INFO: Found listing with ID: CG22215
2026-03-30 08:01:21 [auto1.es] INFO: Found listing with ID: NV08430
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV08430%27 HTTP/1.1" 200 None
2026-03-30 08:01:21 [auto1.es] INFO: Scrape type for NV08430: 2
2026-03-30 08:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba558384-2ff6-5050-9dc5-c0f9eb9e09f0 with identifier: NV08430
2026-03-30 08:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba558384-2ff6-5050-9dc5-c0f9eb9e09f0 with scrape type 2
2026-03-30 08:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba558384-2ff6-5050-9dc5-c0f9eb9e09f0 with scrape type 2
2026-03-30 08:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ba558384-2ff6-5050-9dc5-c0f9eb9e09f0, identifier: NV08430
2026-03-30 08:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c5f14f40-01f4-5213-8ec7-009afe1ffedb with identifier: XM10177
2026-03-30 08:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c5f14f40-01f4-5213-8ec7-009afe1ffedb with identifier: XM10177
2026-03-30 08:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c5f14f40-01f4-5213-8ec7-009afe1ffedb with identifier: XM10177 to the API
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-31T15:39:45Z',
 'fuel_type': 'petrol',
 'id': 'c5f14f40-01f4-5213-8ec7-009afe1ffedb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM10177',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 25646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-19',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM10177%27 HTTP/1.1" 200 None
2026-03-30 08:01:21 [auto1.es] INFO: Saving data for XM10177: {'auction_closing_time': 1774971585.0, 'created_time': 1773950509.605885, 'last_price_update_time': 1774857681.87711}
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XM10177') HTTP/1.1" 204 0
2026-03-30 08:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ba558384-2ff6-5050-9dc5-c0f9eb9e09f0 with identifier: NV08430
2026-03-30 08:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ba558384-2ff6-5050-9dc5-c0f9eb9e09f0 with identifier: NV08430
2026-03-30 08:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ba558384-2ff6-5050-9dc5-c0f9eb9e09f0 with identifier: NV08430 to the API
2026-03-30 08:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:44:02Z',
 'fuel_type': 'petrol',
 'id': 'ba558384-2ff6-5050-9dc5-c0f9eb9e09f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV08430',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 94662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-29',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2010}
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV08430%27 HTTP/1.1" 200 None
2026-03-30 08:01:22 [auto1.es] INFO: Saving data for NV08430: {'auction_closing_time': 1774971842.0, 'created_time': 1773132204.5923, 'last_price_update_time': 1774857682.353177}
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NV08430') HTTP/1.1" 204 0
2026-03-30 08:01:22 [auto1.es] INFO: Found listing with ID: JW81079
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW81079%27 HTTP/1.1" 200 None
2026-03-30 08:01:22 [auto1.es] INFO: Scrape type for JW81079: 2
2026-03-30 08:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ed4a635-43a0-5fe7-947f-b1241f4cbc58 with identifier: JW81079
2026-03-30 08:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed4a635-43a0-5fe7-947f-b1241f4cbc58 with scrape type 2
2026-03-30 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ed4a635-43a0-5fe7-947f-b1241f4cbc58 with scrape type 2
2026-03-30 08:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0ed4a635-43a0-5fe7-947f-b1241f4cbc58, identifier: JW81079
2026-03-30 08:01:22 [auto1.es] INFO: Found listing with ID: EF44253
2026-03-30 08:01:22 [auto1.es] INFO: Found listing with ID: CA16323
2026-03-30 08:01:22 [auto1.es] INFO: Found listing with ID: AE58330
2026-03-30 08:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0ed4a635-43a0-5fe7-947f-b1241f4cbc58 with identifier: JW81079
2026-03-30 08:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0ed4a635-43a0-5fe7-947f-b1241f4cbc58 with identifier: JW81079
2026-03-30 08:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0ed4a635-43a0-5fe7-947f-b1241f4cbc58 with identifier: JW81079 to the API
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:38:40Z',
 'fuel_type': 'petrol',
 'id': '0ed4a635-43a0-5fe7-947f-b1241f4cbc58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW81079',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 40697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-25',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Concept 2WD',
 'transmission': 'manual',
 'trim': 'Concept 2WD',
 'year': 2019}
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW81079%27 HTTP/1.1" 200 None
2026-03-30 08:01:22 [auto1.es] INFO: Saving data for JW81079: {'auction_closing_time': 1774971520.0, 'created_time': 1774469256.364949, 'last_price_update_time': 1774857682.838726}
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JW81079') HTTP/1.1" 204 0
2026-03-30 08:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU38219/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:22 [auto1.es] INFO: Found listing with ID: KT28761
2026-03-30 08:01:22 [auto1.es] INFO: Found listing with ID: EJ87348
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ87348%27 HTTP/1.1" 200 None
2026-03-30 08:01:22 [auto1.es] INFO: Scrape type for EJ87348: 2
2026-03-30 08:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8916c69-b31a-557d-b580-46ebf4a97120 with identifier: EJ87348
2026-03-30 08:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8916c69-b31a-557d-b580-46ebf4a97120 with scrape type 2
2026-03-30 08:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8916c69-b31a-557d-b580-46ebf4a97120 with scrape type 2
2026-03-30 08:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b8916c69-b31a-557d-b580-46ebf4a97120, identifier: EJ87348
2026-03-30 08:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b8916c69-b31a-557d-b580-46ebf4a97120 with identifier: EJ87348
2026-03-30 08:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b8916c69-b31a-557d-b580-46ebf4a97120 with identifier: EJ87348
2026-03-30 08:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b8916c69-b31a-557d-b580-46ebf4a97120 with identifier: EJ87348 to the API
2026-03-30 08:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:57:13Z',
 'fuel_type': 'petrol',
 'id': 'b8916c69-b31a-557d-b580-46ebf4a97120',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ87348',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 19677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-27',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-30 08:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ87348%27 HTTP/1.1" 200 None
2026-03-30 08:01:23 [auto1.es] INFO: Saving data for EJ87348: {'auction_closing_time': 1774972633.0, 'created_time': 1774382539.688854, 'last_price_update_time': 1774857683.395876}
2026-03-30 08:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EJ87348') HTTP/1.1" 204 0
2026-03-30 08:01:23 [auto1.es] INFO: Found listing with ID: MG81187
2026-03-30 08:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG81187%27 HTTP/1.1" 200 None
2026-03-30 08:01:23 [auto1.es] INFO: Scrape type for MG81187: 2
2026-03-30 08:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2a4d294-0df4-5d39-8df2-78a78aa11dea with identifier: MG81187
2026-03-30 08:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2a4d294-0df4-5d39-8df2-78a78aa11dea with scrape type 2
2026-03-30 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2a4d294-0df4-5d39-8df2-78a78aa11dea with scrape type 2
2026-03-30 08:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c2a4d294-0df4-5d39-8df2-78a78aa11dea, identifier: MG81187
2026-03-30 08:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c2a4d294-0df4-5d39-8df2-78a78aa11dea with identifier: MG81187
2026-03-30 08:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c2a4d294-0df4-5d39-8df2-78a78aa11dea with identifier: MG81187
2026-03-30 08:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c2a4d294-0df4-5d39-8df2-78a78aa11dea with identifier: MG81187 to the API
2026-03-30 08:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:40:07Z',
 'fuel_type': 'petrol',
 'id': 'c2a4d294-0df4-5d39-8df2-78a78aa11dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG81187',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 246560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-28',
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG81187%27 HTTP/1.1" 200 None
2026-03-30 08:01:24 [auto1.es] INFO: Saving data for MG81187: {'auction_closing_time': 1774971607.0, 'created_time': 1773128917.253189, 'last_price_update_time': 1774857684.350285}
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MG81187') HTTP/1.1" 204 0
2026-03-30 08:01:24 [auto1.es] INFO: Found listing with ID: BB78010
2026-03-30 08:01:24 [auto1.es] INFO: Found listing with ID: ZL69555
2026-03-30 08:01:24 [auto1.es] INFO: Found listing with ID: JY39879
2026-03-30 08:01:24 [auto1.es] INFO: Found listing with ID: HX96572
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX96572%27 HTTP/1.1" 200 None
2026-03-30 08:01:24 [auto1.es] INFO: Scrape type for HX96572: 2
2026-03-30 08:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf30f6c-f5a4-54eb-a4a3-e97b2a04d28a with identifier: HX96572
2026-03-30 08:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf30f6c-f5a4-54eb-a4a3-e97b2a04d28a with scrape type 2
2026-03-30 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bf30f6c-f5a4-54eb-a4a3-e97b2a04d28a with scrape type 2
2026-03-30 08:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4bf30f6c-f5a4-54eb-a4a3-e97b2a04d28a, identifier: HX96572
2026-03-30 08:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4bf30f6c-f5a4-54eb-a4a3-e97b2a04d28a with identifier: HX96572
2026-03-30 08:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4bf30f6c-f5a4-54eb-a4a3-e97b2a04d28a with identifier: HX96572
2026-03-30 08:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4bf30f6c-f5a4-54eb-a4a3-e97b2a04d28a with identifier: HX96572 to the API
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:44:27Z',
 'fuel_type': 'diesel',
 'id': '4bf30f6c-f5a4-54eb-a4a3-e97b2a04d28a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX96572',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 112300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-04',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX96572%27 HTTP/1.1" 200 None
2026-03-30 08:01:24 [auto1.es] INFO: Saving data for HX96572: {'auction_closing_time': 1774971867.0, 'created_time': 1774447237.940679, 'last_price_update_time': 1774857684.937032}
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HX96572') HTTP/1.1" 204 0
2026-03-30 08:01:24 [auto1.es] INFO: Found listing with ID: CK47947
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CK47947%27 HTTP/1.1" 200 None
2026-03-30 08:01:24 [auto1.es] INFO: Scrape type for CK47947: 1
2026-03-30 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC38071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:24 [auto1.es] INFO: Found listing with ID: DS79816
2026-03-30 08:01:24 [auto1.es] INFO: Found listing with ID: TU44986
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU44986%27 HTTP/1.1" 200 None
2026-03-30 08:01:24 [auto1.es] INFO: Scrape type for TU44986: 2
2026-03-30 08:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d7daa5d-06ce-5101-9c64-e213404d1bd9 with identifier: TU44986
2026-03-30 08:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d7daa5d-06ce-5101-9c64-e213404d1bd9 with scrape type 2
2026-03-30 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d7daa5d-06ce-5101-9c64-e213404d1bd9 with scrape type 2
2026-03-30 08:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5d7daa5d-06ce-5101-9c64-e213404d1bd9, identifier: TU44986
2026-03-30 08:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5d7daa5d-06ce-5101-9c64-e213404d1bd9 with identifier: TU44986
2026-03-30 08:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5d7daa5d-06ce-5101-9c64-e213404d1bd9 with identifier: TU44986
2026-03-30 08:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5d7daa5d-06ce-5101-9c64-e213404d1bd9 with identifier: TU44986 to the API
2026-03-30 08:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:04:03Z',
 'fuel_type': 'diesel',
 'id': '5d7daa5d-06ce-5101-9c64-e213404d1bd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU44986',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 146024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-18',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2010}
2026-03-30 08:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU44986%27 HTTP/1.1" 200 None
2026-03-30 08:01:25 [auto1.es] INFO: Saving data for TU44986: {'auction_closing_time': 1774969443.0, 'created_time': 1773133885.413319, 'last_price_update_time': 1774857685.463923}
2026-03-30 08:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TU44986') HTTP/1.1" 204 0
2026-03-30 08:01:25 [auto1.es] INFO: Found listing with ID: SS95298
2026-03-30 08:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SS95298%27 HTTP/1.1" 200 None
2026-03-30 08:01:25 [auto1.es] INFO: Scrape type for SS95298: 2
2026-03-30 08:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff46e5db-a1db-5f17-a3b4-3726e429cbc5 with identifier: SS95298
2026-03-30 08:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff46e5db-a1db-5f17-a3b4-3726e429cbc5 with scrape type 2
2026-03-30 08:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff46e5db-a1db-5f17-a3b4-3726e429cbc5 with scrape type 2
2026-03-30 08:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ff46e5db-a1db-5f17-a3b4-3726e429cbc5, identifier: SS95298
2026-03-30 08:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ff46e5db-a1db-5f17-a3b4-3726e429cbc5 with identifier: SS95298
2026-03-30 08:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ff46e5db-a1db-5f17-a3b4-3726e429cbc5 with identifier: SS95298
2026-03-30 08:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ff46e5db-a1db-5f17-a3b4-3726e429cbc5 with identifier: SS95298 to the API
2026-03-30 08:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:33:07Z',
 'fuel_type': 'diesel',
 'id': 'ff46e5db-a1db-5f17-a3b4-3726e429cbc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS95298',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 82530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-30',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2013}
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SS95298%27 HTTP/1.1" 200 None
2026-03-30 08:01:26 [auto1.es] INFO: Saving data for SS95298: {'auction_closing_time': 1774971187.0, 'created_time': 1774447306.502176, 'last_price_update_time': 1774857686.064038}
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SS95298') HTTP/1.1" 204 0
2026-03-30 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:26 [auto1.es] INFO: Found listing with ID: CG34681
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG34681%27 HTTP/1.1" 200 None
2026-03-30 08:01:26 [auto1.es] INFO: Scrape type for CG34681: 2
2026-03-30 08:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e6d08ed-a3f8-5e42-aec9-e7af7008fe44 with identifier: CG34681
2026-03-30 08:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e6d08ed-a3f8-5e42-aec9-e7af7008fe44 with scrape type 2
2026-03-30 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e6d08ed-a3f8-5e42-aec9-e7af7008fe44 with scrape type 2
2026-03-30 08:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5e6d08ed-a3f8-5e42-aec9-e7af7008fe44, identifier: CG34681
2026-03-30 08:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5e6d08ed-a3f8-5e42-aec9-e7af7008fe44 with identifier: CG34681
2026-03-30 08:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5e6d08ed-a3f8-5e42-aec9-e7af7008fe44 with identifier: CG34681
2026-03-30 08:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5e6d08ed-a3f8-5e42-aec9-e7af7008fe44 with identifier: CG34681 to the API
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:29:36Z',
 'fuel_type': 'diesel',
 'id': '5e6d08ed-a3f8-5e42-aec9-e7af7008fe44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG34681',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 136514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-12',
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2020}
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG34681%27 HTTP/1.1" 200 None
2026-03-30 08:01:26 [auto1.es] INFO: Saving data for CG34681: {'auction_closing_time': 1774970976.0, 'created_time': 1773128214.096631, 'last_price_update_time': 1774857686.590311}
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CG34681') HTTP/1.1" 204 0
2026-03-30 08:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:26 [auto1.es] INFO: Found listing with ID: RC36042
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC36042%27 HTTP/1.1" 200 None
2026-03-30 08:01:26 [auto1.es] INFO: Scrape type for RC36042: 2
2026-03-30 08:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdd8c18a-34f0-57d6-aad0-72835bfcd798 with identifier: RC36042
2026-03-30 08:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdd8c18a-34f0-57d6-aad0-72835bfcd798 with scrape type 2
2026-03-30 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdd8c18a-34f0-57d6-aad0-72835bfcd798 with scrape type 2
2026-03-30 08:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cdd8c18a-34f0-57d6-aad0-72835bfcd798, identifier: RC36042
2026-03-30 08:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cdd8c18a-34f0-57d6-aad0-72835bfcd798 with identifier: RC36042
2026-03-30 08:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cdd8c18a-34f0-57d6-aad0-72835bfcd798 with identifier: RC36042
2026-03-30 08:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cdd8c18a-34f0-57d6-aad0-72835bfcd798 with identifier: RC36042 to the API
2026-03-30 08:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:48:06Z',
 'fuel_type': 'diesel',
 'id': 'cdd8c18a-34f0-57d6-aad0-72835bfcd798',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC36042',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 377885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-26',
 'seller_name': None,
 'title': 'Honda Civic 2.2 CTDI Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2009}
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC36042%27 HTTP/1.1" 200 None
2026-03-30 08:01:27 [auto1.es] INFO: Saving data for RC36042: {'auction_closing_time': 1774972086.0, 'created_time': 1773133861.663028, 'last_price_update_time': 1774857687.158886}
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RC36042') HTTP/1.1" 204 0
2026-03-30 08:01:27 [auto1.es] INFO: Channel: 24h | Page: 7 | totalHits: 2178 | hits on page: 40
2026-03-30 08:01:27 [auto1.es] INFO: Found listing with ID: VC11143
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC11143%27 HTTP/1.1" 200 None
2026-03-30 08:01:27 [auto1.es] INFO: Scrape type for VC11143: 2
2026-03-30 08:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ba5dc0-6778-5620-963e-1b7692445eb1 with identifier: VC11143
2026-03-30 08:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ba5dc0-6778-5620-963e-1b7692445eb1 with scrape type 2
2026-03-30 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7ba5dc0-6778-5620-963e-1b7692445eb1 with scrape type 2
2026-03-30 08:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7ba5dc0-6778-5620-963e-1b7692445eb1, identifier: VC11143
2026-03-30 08:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7ba5dc0-6778-5620-963e-1b7692445eb1 with identifier: VC11143
2026-03-30 08:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7ba5dc0-6778-5620-963e-1b7692445eb1 with identifier: VC11143
2026-03-30 08:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e7ba5dc0-6778-5620-963e-1b7692445eb1 with identifier: VC11143 to the API
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:45:42Z',
 'fuel_type': 'petrol',
 'id': 'e7ba5dc0-6778-5620-963e-1b7692445eb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC11143',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 43537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-28',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC11143%27 HTTP/1.1" 200 None
2026-03-30 08:01:27 [auto1.es] INFO: Saving data for VC11143: {'auction_closing_time': 1774971942.0, 'created_time': 1774252831.506003, 'last_price_update_time': 1774857687.77506}
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VC11143') HTTP/1.1" 204 0
2026-03-30 08:01:27 [auto1.es] INFO: Found listing with ID: NM85037
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM85037%27 HTTP/1.1" 200 None
2026-03-30 08:01:27 [auto1.es] INFO: Scrape type for NM85037: 1
2026-03-30 08:01:27 [auto1.es] INFO: Found listing with ID: YZ39389
2026-03-30 08:01:27 [auto1.es] INFO: Found listing with ID: YH22245
2026-03-30 08:01:27 [auto1.es] INFO: Found listing with ID: YH03872
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH03872%27 HTTP/1.1" 200 None
2026-03-30 08:01:27 [auto1.es] INFO: Scrape type for YH03872: 2
2026-03-30 08:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea96f27a-349e-5da4-895b-3c68c9be5e9d with identifier: YH03872
2026-03-30 08:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea96f27a-349e-5da4-895b-3c68c9be5e9d with scrape type 2
2026-03-30 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea96f27a-349e-5da4-895b-3c68c9be5e9d with scrape type 2
2026-03-30 08:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ea96f27a-349e-5da4-895b-3c68c9be5e9d, identifier: YH03872
2026-03-30 08:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ea96f27a-349e-5da4-895b-3c68c9be5e9d with identifier: YH03872
2026-03-30 08:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ea96f27a-349e-5da4-895b-3c68c9be5e9d with identifier: YH03872
2026-03-30 08:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ea96f27a-349e-5da4-895b-3c68c9be5e9d with identifier: YH03872 to the API
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:09:24Z',
 'fuel_type': 'diesel',
 'id': 'ea96f27a-349e-5da4-895b-3c68c9be5e9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH03872',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 142279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Control M',
 'transmission': 'manual',
 'trim': 'Control M',
 'year': 2019}
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH03872%27 HTTP/1.1" 200 None
2026-03-30 08:01:28 [auto1.es] INFO: Saving data for YH03872: {'auction_closing_time': 1774969764.0, 'created_time': 1774469369.649357, 'last_price_update_time': 1774857688.402207}
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YH03872') HTTP/1.1" 204 0
2026-03-30 08:01:28 [auto1.es] INFO: Found listing with ID: BV63051
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV63051%27 HTTP/1.1" 200 None
2026-03-30 08:01:28 [auto1.es] INFO: Scrape type for BV63051: 1
2026-03-30 08:01:28 [auto1.es] INFO: Found listing with ID: CE52648
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE52648%27 HTTP/1.1" 200 None
2026-03-30 08:01:28 [auto1.es] INFO: Scrape type for CE52648: 2
2026-03-30 08:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8431c2d-3b7a-5b12-bdb7-dfa0f9fa74a8 with identifier: CE52648
2026-03-30 08:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8431c2d-3b7a-5b12-bdb7-dfa0f9fa74a8 with scrape type 2
2026-03-30 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8431c2d-3b7a-5b12-bdb7-dfa0f9fa74a8 with scrape type 2
2026-03-30 08:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e8431c2d-3b7a-5b12-bdb7-dfa0f9fa74a8, identifier: CE52648
2026-03-30 08:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e8431c2d-3b7a-5b12-bdb7-dfa0f9fa74a8 with identifier: CE52648
2026-03-30 08:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e8431c2d-3b7a-5b12-bdb7-dfa0f9fa74a8 with identifier: CE52648
2026-03-30 08:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e8431c2d-3b7a-5b12-bdb7-dfa0f9fa74a8 with identifier: CE52648 to the API
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:15:00Z',
 'fuel_type': 'petrol',
 'id': 'e8431c2d-3b7a-5b12-bdb7-dfa0f9fa74a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE52648',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 201762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-01',
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 2008}
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE52648%27 HTTP/1.1" 200 None
2026-03-30 08:01:28 [auto1.es] INFO: Saving data for CE52648: {'auction_closing_time': 1774970100.0, 'created_time': 1773907234.493699, 'last_price_update_time': 1774857688.957797}
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CE52648') HTTP/1.1" 204 0
2026-03-30 08:01:28 [auto1.es] INFO: Found listing with ID: WG88272
2026-03-30 08:01:28 [auto1.es] INFO: Found listing with ID: SA85956
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA85956%27 HTTP/1.1" 200 None
2026-03-30 08:01:28 [auto1.es] INFO: Scrape type for SA85956: 2
2026-03-30 08:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bd0cfeb-e133-5ba8-8f41-3541cf8cc5c4 with identifier: SA85956
2026-03-30 08:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bd0cfeb-e133-5ba8-8f41-3541cf8cc5c4 with scrape type 2
2026-03-30 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bd0cfeb-e133-5ba8-8f41-3541cf8cc5c4 with scrape type 2
2026-03-30 08:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0bd0cfeb-e133-5ba8-8f41-3541cf8cc5c4, identifier: SA85956
2026-03-30 08:01:29 [auto1.es] INFO: Found listing with ID: YZ96653
2026-03-30 08:01:29 [auto1.es] INFO: Found listing with ID: KG08685
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG08685%27 HTTP/1.1" 200 None
2026-03-30 08:01:29 [auto1.es] INFO: Scrape type for KG08685: 2
2026-03-30 08:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35b1ed70-44ca-5771-823b-ac1415ed6920 with identifier: KG08685
2026-03-30 08:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35b1ed70-44ca-5771-823b-ac1415ed6920 with scrape type 2
2026-03-30 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35b1ed70-44ca-5771-823b-ac1415ed6920 with scrape type 2
2026-03-30 08:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 35b1ed70-44ca-5771-823b-ac1415ed6920, identifier: KG08685
2026-03-30 08:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0bd0cfeb-e133-5ba8-8f41-3541cf8cc5c4 with identifier: SA85956
2026-03-30 08:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0bd0cfeb-e133-5ba8-8f41-3541cf8cc5c4 with identifier: SA85956
2026-03-30 08:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0bd0cfeb-e133-5ba8-8f41-3541cf8cc5c4 with identifier: SA85956 to the API
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:56:08Z',
 'fuel_type': 'diesel',
 'id': '0bd0cfeb-e133-5ba8-8f41-3541cf8cc5c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA85956',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 260798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-26',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 e-HDi Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2015}
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA85956%27 HTTP/1.1" 200 None
2026-03-30 08:01:29 [auto1.es] INFO: Saving data for SA85956: {'auction_closing_time': 1774972568.0, 'created_time': 1773777870.353885, 'last_price_update_time': 1774857689.521424}
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SA85956') HTTP/1.1" 204 0
2026-03-30 08:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK47947/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 35b1ed70-44ca-5771-823b-ac1415ed6920 with identifier: KG08685
2026-03-30 08:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 35b1ed70-44ca-5771-823b-ac1415ed6920 with identifier: KG08685
2026-03-30 08:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 35b1ed70-44ca-5771-823b-ac1415ed6920 with identifier: KG08685 to the API
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:11:57Z',
 'fuel_type': 'petrol',
 'id': '35b1ed70-44ca-5771-823b-ac1415ed6920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG08685',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 200695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-02-11',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG08685%27 HTTP/1.1" 200 None
2026-03-30 08:01:29 [auto1.es] INFO: Saving data for KG08685: {'auction_closing_time': 1774969917.0, 'created_time': 1774361249.547793, 'last_price_update_time': 1774857689.969368}
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KG08685') HTTP/1.1" 204 0
2026-03-30 08:01:29 [auto1.es] INFO: Found listing with ID: BX69808
2026-03-30 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX69808%27 HTTP/1.1" 200 None
2026-03-30 08:01:30 [auto1.es] INFO: Scrape type for BX69808: 1
2026-03-30 08:01:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-03-30 08:01:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-03-30 08:01:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-03-30 08:01:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-03-30 08:01:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-03-30 08:01:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-03-30 08:01:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: invalid literal for int() with base 10: 'other'
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-03-30 08:01:30 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/auto1.py", line 231, in parse_api_search
    item = self._listing_from_search_result(car, channel, car_stock_number)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/auto1.py", line 346, in _listing_from_search_result
    item["doors_number"] = int(car.get("doors"))
                           ^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'other'
2026-03-30 08:01:30 [auto1.es] INFO: Found listing with ID: GT40833
2026-03-30 08:01:30 [auto1.es] INFO: Found listing with ID: LF82591
2026-03-30 08:01:30 [auto1.es] INFO: Found listing with ID: XE21936
2026-03-30 08:01:30 [auto1.es] INFO: Found listing with ID: YT21640
2026-03-30 08:01:30 [auto1.es] INFO: Found listing with ID: XS13258
2026-03-30 08:01:30 [auto1.es] INFO: Found listing with ID: WT17927
2026-03-30 08:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT17927%27 HTTP/1.1" 200 None
2026-03-30 08:01:30 [auto1.es] INFO: Scrape type for WT17927: 2
2026-03-30 08:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 368eef76-72db-5947-b1f1-9a675f9ed8d5 with identifier: WT17927
2026-03-30 08:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 368eef76-72db-5947-b1f1-9a675f9ed8d5 with scrape type 2
2026-03-30 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 368eef76-72db-5947-b1f1-9a675f9ed8d5 with scrape type 2
2026-03-30 08:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 368eef76-72db-5947-b1f1-9a675f9ed8d5, identifier: WT17927
2026-03-30 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF58352> (referer: https://www.auto1.com/v1/car-details-view/GF58352/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 368eef76-72db-5947-b1f1-9a675f9ed8d5 with identifier: WT17927
2026-03-30 08:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 368eef76-72db-5947-b1f1-9a675f9ed8d5 with identifier: WT17927
2026-03-30 08:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 368eef76-72db-5947-b1f1-9a675f9ed8d5 with identifier: WT17927 to the API
2026-03-30 08:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:54:22Z',
 'fuel_type': 'petrol',
 'id': '368eef76-72db-5947-b1f1-9a675f9ed8d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT17927',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 297486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-28',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2008}
2026-03-30 08:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT17927%27 HTTP/1.1" 200 None
2026-03-30 08:01:31 [auto1.es] INFO: Saving data for WT17927: {'auction_closing_time': 1774972462.0, 'created_time': 1774447232.590423, 'last_price_update_time': 1774857691.576659}
2026-03-30 08:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WT17927') HTTP/1.1" 204 0
2026-03-30 08:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU38219> (referer: https://www.auto1.com/v1/car-details-view/WU38219/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:31 [auto1.es] INFO: Found listing with ID: NR71685
2026-03-30 08:01:31 [auto1.es] INFO: Found listing with ID: KW01886
2026-03-30 08:01:31 [auto1.es] INFO: Found listing with ID: HY48394
2026-03-30 08:01:31 [auto1.es] INFO: Found listing with ID: LG14006
2026-03-30 08:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG14006%27 HTTP/1.1" 200 None
2026-03-30 08:01:31 [auto1.es] INFO: Scrape type for LG14006: 2
2026-03-30 08:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e73e1155-d17c-500c-9944-a1c5788c20b9 with identifier: LG14006
2026-03-30 08:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e73e1155-d17c-500c-9944-a1c5788c20b9 with scrape type 2
2026-03-30 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e73e1155-d17c-500c-9944-a1c5788c20b9 with scrape type 2
2026-03-30 08:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e73e1155-d17c-500c-9944-a1c5788c20b9, identifier: LG14006
2026-03-30 08:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC38071> (referer: https://www.auto1.com/v1/car-details-view/NC38071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e73e1155-d17c-500c-9944-a1c5788c20b9 with identifier: LG14006
2026-03-30 08:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e73e1155-d17c-500c-9944-a1c5788c20b9 with identifier: LG14006
2026-03-30 08:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e73e1155-d17c-500c-9944-a1c5788c20b9 with identifier: LG14006 to the API
2026-03-30 08:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:31:50Z',
 'fuel_type': 'diesel',
 'id': 'e73e1155-d17c-500c-9944-a1c5788c20b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG14006',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 217318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-31',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG14006%27 HTTP/1.1" 200 None
2026-03-30 08:01:32 [auto1.es] INFO: Saving data for LG14006: {'auction_closing_time': 1774971110.0, 'created_time': 1774468972.941907, 'last_price_update_time': 1774857692.166978}
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LG14006') HTTP/1.1" 204 0
2026-03-30 08:01:32 [auto1.es] INFO: Found listing with ID: CF95684
2026-03-30 08:01:32 [auto1.es] INFO: Found listing with ID: CT36127
2026-03-30 08:01:32 [auto1.es] INFO: Found listing with ID: DE32472
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE32472%27 HTTP/1.1" 200 None
2026-03-30 08:01:32 [auto1.es] INFO: Scrape type for DE32472: 2
2026-03-30 08:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8d84837-49fc-5a55-a5fc-cebb8985ac17 with identifier: DE32472
2026-03-30 08:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d84837-49fc-5a55-a5fc-cebb8985ac17 with scrape type 2
2026-03-30 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8d84837-49fc-5a55-a5fc-cebb8985ac17 with scrape type 2
2026-03-30 08:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8d84837-49fc-5a55-a5fc-cebb8985ac17, identifier: DE32472
2026-03-30 08:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8d84837-49fc-5a55-a5fc-cebb8985ac17 with identifier: DE32472
2026-03-30 08:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8d84837-49fc-5a55-a5fc-cebb8985ac17 with identifier: DE32472
2026-03-30 08:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c8d84837-49fc-5a55-a5fc-cebb8985ac17 with identifier: DE32472 to the API
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:36:56Z',
 'fuel_type': 'diesel',
 'id': 'c8d84837-49fc-5a55-a5fc-cebb8985ac17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE32472',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 330064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE32472%27 HTTP/1.1" 200 None
2026-03-30 08:01:32 [auto1.es] INFO: Saving data for DE32472: {'auction_closing_time': 1774971416.0, 'created_time': 1773127297.871218, 'last_price_update_time': 1774857692.769826}
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DE32472') HTTP/1.1" 204 0
2026-03-30 08:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8 with identifier: GF58352
2026-03-30 08:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8 with scrape type 1
2026-03-30 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb5%252F52b5e7a7ca99900ec6844d171a997f5f%252Fpa%252FGF58352_62cbb64d6e3139e27505ad81cd247139.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_62cbb64d6e3139e27505ad81cd247139.jpg already downloaded
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb5%252F52b5e7a7ca99900ec6844d171a997f5f%252Fpa%252FGF58352_1666108229c18ae817919a37f69cb858.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_1666108229c18ae817919a37f69cb858.jpg already downloaded
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb5%252F52b5e7a7ca99900ec6844d171a997f5f%252Fpa%252FGF58352_fb9fdc6785e0b27fab22b6de71071c99.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_fb9fdc6785e0b27fab22b6de71071c99.jpg already downloaded
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb5%252F52b5e7a7ca99900ec6844d171a997f5f%252Fpa%252FGF58352_ca8967a700194f3510eaf6c0807398a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_ca8967a700194f3510eaf6c0807398a8.jpg already downloaded
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb5%252F52b5e7a7ca99900ec6844d171a997f5f%252Fpa%252FGF58352_786d91f44116135f0f3bba7b7625a5ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_786d91f44116135f0f3bba7b7625a5ca.jpg already downloaded
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb5%252F52b5e7a7ca99900ec6844d171a997f5f%252Fpa%252FGF58352_5ca65a3630d28ad7b30e385b06b3e4ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_5ca65a3630d28ad7b30e385b06b3e4ac.jpg already downloaded
2026-03-30 08:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8, identifier: GF58352
2026-03-30 08:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88879703-2e63-5973-8d65-f9ac3f6d9419 with identifier: WU38219
2026-03-30 08:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88879703-2e63-5973-8d65-f9ac3f6d9419 with scrape type 1
2026-03-30 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88879703-2e63-5973-8d65-f9ac3f6d9419
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F72%252F2a720dca3d062dfd235648d3018acfea%252Fpa%252FWU38219_8ec7ab654e222f8fd2004147032b538e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_8ec7ab654e222f8fd2004147032b538e.jpg already downloaded
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F72%252F2a720dca3d062dfd235648d3018acfea%252Fpa%252FWU38219_31e03269166c0f347875ab3a4d0d934e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_31e03269166c0f347875ab3a4d0d934e.jpg already downloaded
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F72%252F2a720dca3d062dfd235648d3018acfea%252Fpa%252FWU38219_05f2afb765d6220cf5daa38cff1a01c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_05f2afb765d6220cf5daa38cff1a01c3.jpg already downloaded
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F72%252F2a720dca3d062dfd235648d3018acfea%252Fpa%252FWU38219_6b3e1dc0b95df04636e6d10e7ac16098.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_6b3e1dc0b95df04636e6d10e7ac16098.jpg already downloaded
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F72%252F2a720dca3d062dfd235648d3018acfea%252Fpa%252FWU38219_91c937fa636abb5748c8e72ad5a391a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_91c937fa636abb5748c8e72ad5a391a5.jpg already downloaded
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F72%252F2a720dca3d062dfd235648d3018acfea%252Fpa%252FWU38219_571b633a979273820e1183e41d16b5ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_571b633a979273820e1183e41d16b5ae.jpg already downloaded
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F72%252F2a720dca3d062dfd235648d3018acfea%252Fpa%252FWU38219_5993646386bfc85cabea520b668f7f4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_5993646386bfc85cabea520b668f7f4b.jpg already downloaded
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F72%252F2a720dca3d062dfd235648d3018acfea%252Fpa%252FWU38219_b91fa9d9836f1183cec38da7e9fc01a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_b91fa9d9836f1183cec38da7e9fc01a2.jpg already downloaded
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F72%252F2a720dca3d062dfd235648d3018acfea%252Fpa%252FWU38219_c5fdc08e60c881cd54004ad5fd085970.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_c5fdc08e60c881cd54004ad5fd085970.jpg already downloaded
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F72%252F2a720dca3d062dfd235648d3018acfea%252Fpa%252FWU38219_8d413379a0f6ef7214da18e2d9f16147.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_8d413379a0f6ef7214da18e2d9f16147.jpg already downloaded
2026-03-30 08:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 88879703-2e63-5973-8d65-f9ac3f6d9419, identifier: WU38219
2026-03-30 08:01:33 [auto1.es] INFO: Found listing with ID: HP66589
2026-03-30 08:01:33 [auto1.es] INFO: Found listing with ID: CZ03495
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ03495%27 HTTP/1.1" 200 None
2026-03-30 08:01:33 [auto1.es] INFO: Scrape type for CZ03495: 2
2026-03-30 08:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 281795d2-692e-5ec9-94aa-2cab70b9e63f with identifier: CZ03495
2026-03-30 08:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 281795d2-692e-5ec9-94aa-2cab70b9e63f with scrape type 2
2026-03-30 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 281795d2-692e-5ec9-94aa-2cab70b9e63f with scrape type 2
2026-03-30 08:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 281795d2-692e-5ec9-94aa-2cab70b9e63f, identifier: CZ03495
2026-03-30 08:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8 with identifier: GF58352
2026-03-30 08:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8 with identifier: GF58352
2026-03-30 08:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8 with identifier: GF58352 to the API
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GF58352>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:26:43Z',
 'fuel_type': 'diesel',
 'id': 'd7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF58352',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 359609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_62cbb64d6e3139e27505ad81cd247139.jpg',
                'https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_1666108229c18ae817919a37f69cb858.jpg',
                'https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_fb9fdc6785e0b27fab22b6de71071c99.jpg',
                'https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_ca8967a700194f3510eaf6c0807398a8.jpg',
                'https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_786d91f44116135f0f3bba7b7625a5ca.jpg',
                'https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_5ca65a3630d28ad7b30e385b06b3e4ac.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8/d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_62cbb64d6e3139e27505ad81cd247139.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8/d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_1666108229c18ae817919a37f69cb858.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8/d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_fb9fdc6785e0b27fab22b6de71071c99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8/d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_ca8967a700194f3510eaf6c0807398a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8/d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_786d91f44116135f0f3bba7b7625a5ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8/d7b2f44e-0c6b-5ed7-ad26-e1dc5a959ad8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b5/52b5e7a7ca99900ec6844d171a997f5f/pa/GF58352_5ca65a3630d28ad7b30e385b06b3e4ac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Kombi',
 'transmission': 'manual',
 'trim': 'Kombi',
 'year': 2016}
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF58352%27 HTTP/1.1" 200 None
2026-03-30 08:01:34 [auto1.es] INFO: Saving data for GF58352: {'created_time': 1774857694.036668, 'last_price_update_time': 1774857694.036679, 'auction_closing_time': 1774970803.0}
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GF58352') HTTP/1.1" 204 0
2026-03-30 08:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 88879703-2e63-5973-8d65-f9ac3f6d9419 with identifier: WU38219
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 08:01:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 88879703-2e63-5973-8d65-f9ac3f6d9419 with identifier: WU38219
2026-03-30 08:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 88879703-2e63-5973-8d65-f9ac3f6d9419 with identifier: WU38219 to the API
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WU38219>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:44:04Z',
 'fuel_type': 'petrol',
 'id': '88879703-2e63-5973-8d65-f9ac3f6d9419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU38219',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 147083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_8ec7ab654e222f8fd2004147032b538e.jpg',
                'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_31e03269166c0f347875ab3a4d0d934e.jpg',
                'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_05f2afb765d6220cf5daa38cff1a01c3.jpg',
                'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_6b3e1dc0b95df04636e6d10e7ac16098.jpg',
                'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_91c937fa636abb5748c8e72ad5a391a5.jpg',
                'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_571b633a979273820e1183e41d16b5ae.jpg',
                'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_5993646386bfc85cabea520b668f7f4b.jpg',
                'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_b91fa9d9836f1183cec38da7e9fc01a2.jpg',
                'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_c5fdc08e60c881cd54004ad5fd085970.jpg',
                'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_8d413379a0f6ef7214da18e2d9f16147.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88879703-2e63-5973-8d65-f9ac3f6d9419/88879703-2e63-5973-8d65-f9ac3f6d9419_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_8ec7ab654e222f8fd2004147032b538e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88879703-2e63-5973-8d65-f9ac3f6d9419/88879703-2e63-5973-8d65-f9ac3f6d9419_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_31e03269166c0f347875ab3a4d0d934e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88879703-2e63-5973-8d65-f9ac3f6d9419/88879703-2e63-5973-8d65-f9ac3f6d9419_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_05f2afb765d6220cf5daa38cff1a01c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88879703-2e63-5973-8d65-f9ac3f6d9419/88879703-2e63-5973-8d65-f9ac3f6d9419_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_6b3e1dc0b95df04636e6d10e7ac16098.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88879703-2e63-5973-8d65-f9ac3f6d9419/88879703-2e63-5973-8d65-f9ac3f6d9419_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_91c937fa636abb5748c8e72ad5a391a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88879703-2e63-5973-8d65-f9ac3f6d9419/88879703-2e63-5973-8d65-f9ac3f6d9419_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_571b633a979273820e1183e41d16b5ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88879703-2e63-5973-8d65-f9ac3f6d9419/88879703-2e63-5973-8d65-f9ac3f6d9419_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_5993646386bfc85cabea520b668f7f4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88879703-2e63-5973-8d65-f9ac3f6d9419/88879703-2e63-5973-8d65-f9ac3f6d9419_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_b91fa9d9836f1183cec38da7e9fc01a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88879703-2e63-5973-8d65-f9ac3f6d9419/88879703-2e63-5973-8d65-f9ac3f6d9419_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_c5fdc08e60c881cd54004ad5fd085970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88879703-2e63-5973-8d65-f9ac3f6d9419/88879703-2e63-5973-8d65-f9ac3f6d9419_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/72/2a720dca3d062dfd235648d3018acfea/pa/WU38219_8d413379a0f6ef7214da18e2d9f16147.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU38219%27 HTTP/1.1" 200 None
2026-03-30 08:01:34 [auto1.es] INFO: Saving data for WU38219: {'created_time': 1774857694.599705, 'last_price_update_time': 1774857694.599715, 'auction_closing_time': 1774971844.0}
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WU38219') HTTP/1.1" 204 0
2026-03-30 08:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 281795d2-692e-5ec9-94aa-2cab70b9e63f with identifier: CZ03495
2026-03-30 08:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 281795d2-692e-5ec9-94aa-2cab70b9e63f with identifier: CZ03495
2026-03-30 08:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 281795d2-692e-5ec9-94aa-2cab70b9e63f with identifier: CZ03495 to the API
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:41:58Z',
 'fuel_type': 'diesel',
 'id': '281795d2-692e-5ec9-94aa-2cab70b9e63f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ03495',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 189596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-22',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ03495%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [auto1.es] INFO: Saving data for CZ03495: {'auction_closing_time': 1774971718.0, 'created_time': 1774382498.944522, 'last_price_update_time': 1774857695.062878}
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CZ03495') HTTP/1.1" 204 0
2026-03-30 08:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aecbada5-4c50-59e4-987a-8331446772b8 with identifier: NC38071
2026-03-30 08:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aecbada5-4c50-59e4-987a-8331446772b8 with scrape type 1
2026-03-30 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aecbada5-4c50-59e4-987a-8331446772b8
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_bd8377e181515e02318f0275704d4226.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_bd8377e181515e02318f0275704d4226.jpg not downloaded yet
2026-03-30 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV63051/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM85037/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_fab945f8ead77185e64860b8451d8544.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_fab945f8ead77185e64860b8451d8544.jpg not downloaded yet
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_7fc0eabe685df69e55bafa4d905ffb31.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_7fc0eabe685df69e55bafa4d905ffb31.jpg not downloaded yet
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_b23e5eec2653311504b6d4ea53f06e28.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_b23e5eec2653311504b6d4ea53f06e28.jpg not downloaded yet
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_04696a67c8d0bc14abe64ff5fa4a45f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_04696a67c8d0bc14abe64ff5fa4a45f8.jpg not downloaded yet
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_59bc8c6e73d128a995603a8e110925ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_59bc8c6e73d128a995603a8e110925ed.jpg not downloaded yet
2026-03-30 08:01:35 [auto1.es] INFO: Channel: 24h | Page: 8 | totalHits: 2178 | hits on page: 40
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_3d239ef2867e3e1128354bbab726992d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_3d239ef2867e3e1128354bbab726992d.jpg not downloaded yet
2026-03-30 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_fab945f8ead77185e64860b8451d8544.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:35 [auto1.es] INFO: Found listing with ID: FH96205
2026-03-30 08:01:35 [auto1.es] INFO: Found listing with ID: XT23333
2026-03-30 08:01:35 [auto1.es] INFO: Found listing with ID: PY60818
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY60818%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [auto1.es] INFO: Scrape type for PY60818: 2
2026-03-30 08:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caf328fa-1d54-5339-a468-bb662a763908 with identifier: PY60818
2026-03-30 08:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caf328fa-1d54-5339-a468-bb662a763908 with scrape type 2
2026-03-30 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caf328fa-1d54-5339-a468-bb662a763908 with scrape type 2
2026-03-30 08:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: caf328fa-1d54-5339-a468-bb662a763908, identifier: PY60818
2026-03-30 08:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_7fc0eabe685df69e55bafa4d905ffb31.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_f34b87be26ac883467b827e86201b429.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_f34b87be26ac883467b827e86201b429.jpg not downloaded yet
2026-03-30 08:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: caf328fa-1d54-5339-a468-bb662a763908 with identifier: PY60818
2026-03-30 08:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: caf328fa-1d54-5339-a468-bb662a763908 with identifier: PY60818
2026-03-30 08:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: caf328fa-1d54-5339-a468-bb662a763908 with identifier: PY60818 to the API
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-31T15:52:18Z',
 'fuel_type': 'diesel',
 'id': 'caf328fa-1d54-5339-a468-bb662a763908',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY60818',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 328210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-27',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 1.5 dCi Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2010}
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY60818%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [auto1.es] INFO: Saving data for PY60818: {'auction_closing_time': 1774972338.0, 'created_time': 1774296365.376656, 'last_price_update_time': 1774857695.805249}
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PY60818') HTTP/1.1" 204 0
2026-03-30 08:01:35 [auto1.es] INFO: Found listing with ID: FS16711
2026-03-30 08:01:35 [auto1.es] INFO: Found listing with ID: PE83631
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE83631%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [auto1.es] INFO: Scrape type for PE83631: 1
2026-03-30 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_04696a67c8d0bc14abe64ff5fa4a45f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_b23e5eec2653311504b6d4ea53f06e28.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_4cc45dd3b86488785e3c2454077f7512.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_4cc45dd3b86488785e3c2454077f7512.jpg not downloaded yet
2026-03-30 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_59bc8c6e73d128a995603a8e110925ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:35 [auto1.es] INFO: Found listing with ID: HB69486
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB69486%27 HTTP/1.1" 200 None
2026-03-30 08:01:35 [auto1.es] INFO: Scrape type for HB69486: 2
2026-03-30 08:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fe3187c-b0a7-554c-bc70-4f99d4e0acdd with identifier: HB69486
2026-03-30 08:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fe3187c-b0a7-554c-bc70-4f99d4e0acdd with scrape type 2
2026-03-30 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fe3187c-b0a7-554c-bc70-4f99d4e0acdd with scrape type 2
2026-03-30 08:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9fe3187c-b0a7-554c-bc70-4f99d4e0acdd, identifier: HB69486
2026-03-30 08:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e0d76d0>
2026-03-30 08:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_fab945f8ead77185e64860b8451d8544.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_fab945f8ead77185e64860b8451d8544.jpg saved to cache
2026-03-30 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aecbada5-4c50-59e4-987a-8331446772b8
2026-03-30 08:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e9cf390>
2026-03-30 08:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_7fc0eabe685df69e55bafa4d905ffb31.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_7fc0eabe685df69e55bafa4d905ffb31.jpg saved to cache
2026-03-30 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aecbada5-4c50-59e4-987a-8331446772b8
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_fd350611619a1352847b423bdc9a86ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_fd350611619a1352847b423bdc9a86ee.jpg not downloaded yet
2026-03-30 08:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9fe3187c-b0a7-554c-bc70-4f99d4e0acdd with identifier: HB69486
2026-03-30 08:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9fe3187c-b0a7-554c-bc70-4f99d4e0acdd with identifier: HB69486
2026-03-30 08:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9fe3187c-b0a7-554c-bc70-4f99d4e0acdd with identifier: HB69486 to the API
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-31T15:44:55Z',
 'fuel_type': 'diesel',
 'id': '9fe3187c-b0a7-554c-bc70-4f99d4e0acdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB69486',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 315985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-20',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB69486%27 HTTP/1.1" 200 None
2026-03-30 08:01:36 [auto1.es] INFO: Saving data for HB69486: {'auction_closing_time': 1774971895.0, 'created_time': 1773248505.422583, 'last_price_update_time': 1774857696.469893}
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HB69486') HTTP/1.1" 204 0
2026-03-30 08:01:36 [auto1.es] INFO: Found listing with ID: GL45539
2026-03-30 08:01:36 [auto1.es] INFO: Found listing with ID: TS74128
2026-03-30 08:01:36 [auto1.es] INFO: Found listing with ID: DF81839
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF81839%27 HTTP/1.1" 200 None
2026-03-30 08:01:36 [auto1.es] INFO: Scrape type for DF81839: 2
2026-03-30 08:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a711b4e6-ad52-52b9-a08b-e737875b660e with identifier: DF81839
2026-03-30 08:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a711b4e6-ad52-52b9-a08b-e737875b660e with scrape type 2
2026-03-30 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a711b4e6-ad52-52b9-a08b-e737875b660e with scrape type 2
2026-03-30 08:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a711b4e6-ad52-52b9-a08b-e737875b660e, identifier: DF81839
2026-03-30 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_3d239ef2867e3e1128354bbab726992d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a711b4e6-ad52-52b9-a08b-e737875b660e with identifier: DF81839
2026-03-30 08:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a711b4e6-ad52-52b9-a08b-e737875b660e with identifier: DF81839
2026-03-30 08:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a711b4e6-ad52-52b9-a08b-e737875b660e with identifier: DF81839 to the API
2026-03-30 08:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:54:46Z',
 'fuel_type': 'petrol',
 'id': 'a711b4e6-ad52-52b9-a08b-e737875b660e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF81839',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 173743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-23',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 2.0 Acenta 4x4',
 'transmission': 'manual',
 'trim': 'Acenta 4x4',
 'year': 2011}
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF81839%27 HTTP/1.1" 200 None
2026-03-30 08:01:37 [auto1.es] INFO: Saving data for DF81839: {'auction_closing_time': 1774972486.0, 'created_time': 1773496890.038064, 'last_price_update_time': 1774857697.135326}
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DF81839') HTTP/1.1" 204 0
2026-03-30 08:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_f34b87be26ac883467b827e86201b429.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:37 [auto1.es] INFO: Found listing with ID: AB03508
2026-03-30 08:01:37 [auto1.es] INFO: Found listing with ID: LJ76960
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ76960%27 HTTP/1.1" 200 None
2026-03-30 08:01:37 [auto1.es] INFO: Scrape type for LJ76960: 2
2026-03-30 08:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1fe9bf6-19b2-57a4-82d5-b5b9200515d5 with identifier: LJ76960
2026-03-30 08:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1fe9bf6-19b2-57a4-82d5-b5b9200515d5 with scrape type 2
2026-03-30 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1fe9bf6-19b2-57a4-82d5-b5b9200515d5 with scrape type 2
2026-03-30 08:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a1fe9bf6-19b2-57a4-82d5-b5b9200515d5, identifier: LJ76960
2026-03-30 08:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK47947> (referer: https://www.auto1.com/v1/car-details-view/CK47947/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e924cd0>
2026-03-30 08:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_04696a67c8d0bc14abe64ff5fa4a45f8.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_04696a67c8d0bc14abe64ff5fa4a45f8.jpg saved to cache
2026-03-30 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aecbada5-4c50-59e4-987a-8331446772b8
2026-03-30 08:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e02cfd0>
2026-03-30 08:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_b23e5eec2653311504b6d4ea53f06e28.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_b23e5eec2653311504b6d4ea53f06e28.jpg saved to cache
2026-03-30 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aecbada5-4c50-59e4-987a-8331446772b8
2026-03-30 08:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ec900d0>
2026-03-30 08:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_59bc8c6e73d128a995603a8e110925ed.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_59bc8c6e73d128a995603a8e110925ed.jpg saved to cache
2026-03-30 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aecbada5-4c50-59e4-987a-8331446772b8
2026-03-30 08:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a1fe9bf6-19b2-57a4-82d5-b5b9200515d5 with identifier: LJ76960
2026-03-30 08:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a1fe9bf6-19b2-57a4-82d5-b5b9200515d5 with identifier: LJ76960
2026-03-30 08:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a1fe9bf6-19b2-57a4-82d5-b5b9200515d5 with identifier: LJ76960 to the API
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:22:48Z',
 'fuel_type': 'petrol',
 'id': 'a1fe9bf6-19b2-57a4-82d5-b5b9200515d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ76960',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 117128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ76960%27 HTTP/1.1" 200 None
2026-03-30 08:01:37 [auto1.es] INFO: Saving data for LJ76960: {'auction_closing_time': 1774970568.0, 'created_time': 1773127784.347231, 'last_price_update_time': 1774857697.801308}
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LJ76960') HTTP/1.1" 204 0
2026-03-30 08:01:37 [auto1.es] INFO: Found listing with ID: XN68994
2026-03-30 08:01:37 [auto1.es] INFO: Found listing with ID: AY38423
2026-03-30 08:01:37 [auto1.es] INFO: Found listing with ID: LE58276
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE58276%27 HTTP/1.1" 200 None
2026-03-30 08:01:37 [auto1.es] INFO: Scrape type for LE58276: 2
2026-03-30 08:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb630e4d-cf54-5de7-8ad7-0c4b8c4a893c with identifier: LE58276
2026-03-30 08:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb630e4d-cf54-5de7-8ad7-0c4b8c4a893c with scrape type 2
2026-03-30 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb630e4d-cf54-5de7-8ad7-0c4b8c4a893c with scrape type 2
2026-03-30 08:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fb630e4d-cf54-5de7-8ad7-0c4b8c4a893c, identifier: LE58276
2026-03-30 08:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc89530d110>
2026-03-30 08:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_3d239ef2867e3e1128354bbab726992d.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_3d239ef2867e3e1128354bbab726992d.jpg saved to cache
2026-03-30 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aecbada5-4c50-59e4-987a-8331446772b8
2026-03-30 08:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_4cc45dd3b86488785e3c2454077f7512.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fb630e4d-cf54-5de7-8ad7-0c4b8c4a893c with identifier: LE58276
2026-03-30 08:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fb630e4d-cf54-5de7-8ad7-0c4b8c4a893c with identifier: LE58276
2026-03-30 08:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fb630e4d-cf54-5de7-8ad7-0c4b8c4a893c with identifier: LE58276 to the API
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:24Z',
 'fuel_type': 'diesel',
 'id': 'fb630e4d-cf54-5de7-8ad7-0c4b8c4a893c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE58276',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 75201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-03',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE58276%27 HTTP/1.1" 200 None
2026-03-30 08:01:38 [auto1.es] INFO: Saving data for LE58276: {'auction_closing_time': 1774972704.0, 'created_time': 1774296079.912516, 'last_price_update_time': 1774857698.503256}
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LE58276') HTTP/1.1" 204 0
2026-03-30 08:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_fd350611619a1352847b423bdc9a86ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:38 [auto1.es] INFO: Found listing with ID: TV56423
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV56423%27 HTTP/1.1" 200 None
2026-03-30 08:01:38 [auto1.es] INFO: Scrape type for TV56423: 2
2026-03-30 08:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7027f04b-de64-5a03-a0bd-ee3dce61bc2a with identifier: TV56423
2026-03-30 08:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7027f04b-de64-5a03-a0bd-ee3dce61bc2a with scrape type 2
2026-03-30 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7027f04b-de64-5a03-a0bd-ee3dce61bc2a with scrape type 2
2026-03-30 08:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7027f04b-de64-5a03-a0bd-ee3dce61bc2a, identifier: TV56423
2026-03-30 08:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7027f04b-de64-5a03-a0bd-ee3dce61bc2a with identifier: TV56423
2026-03-30 08:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7027f04b-de64-5a03-a0bd-ee3dce61bc2a with identifier: TV56423
2026-03-30 08:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7027f04b-de64-5a03-a0bd-ee3dce61bc2a with identifier: TV56423 to the API
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-31T15:28:52Z',
 'fuel_type': 'petrol',
 'id': '7027f04b-de64-5a03-a0bd-ee3dce61bc2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV56423',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 86312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-18',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV56423%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [auto1.es] INFO: Saving data for TV56423: {'auction_closing_time': 1774970932.0, 'created_time': 1773129169.164921, 'last_price_update_time': 1774857699.060882}
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TV56423') HTTP/1.1" 204 0
2026-03-30 08:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e99f050>
2026-03-30 08:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_f34b87be26ac883467b827e86201b429.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_f34b87be26ac883467b827e86201b429.jpg saved to cache
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aecbada5-4c50-59e4-987a-8331446772b8
2026-03-30 08:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47360c9b-4968-5335-a307-0dd1a8537764 with identifier: CK47947
2026-03-30 08:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47360c9b-4968-5335-a307-0dd1a8537764 with scrape type 1
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47360c9b-4968-5335-a307-0dd1a8537764
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F34%252F2d34bb289b17c000e6ef755c4329492d%252Fpa%252FCK47947_02e1de05d6b5639ae45a1ceb068d193a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_02e1de05d6b5639ae45a1ceb068d193a.jpg already downloaded
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F34%252F2d34bb289b17c000e6ef755c4329492d%252Fpa%252FCK47947_b8a6a3c59bc1638a098016ae07ffc613.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_b8a6a3c59bc1638a098016ae07ffc613.jpg already downloaded
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F34%252F2d34bb289b17c000e6ef755c4329492d%252Fpa%252FCK47947_a37e81c05637250ac0ea36f3617b81bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_a37e81c05637250ac0ea36f3617b81bb.jpg already downloaded
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F34%252F2d34bb289b17c000e6ef755c4329492d%252Fpa%252FCK47947_4d9fe39c4bb0debf18e5a8d9df9acc21.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_4d9fe39c4bb0debf18e5a8d9df9acc21.jpg already downloaded
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F34%252F2d34bb289b17c000e6ef755c4329492d%252Fpa%252FCK47947_9d6d795c6c20a802117173b5022ea8f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_9d6d795c6c20a802117173b5022ea8f9.jpg already downloaded
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F34%252F2d34bb289b17c000e6ef755c4329492d%252Fpa%252FCK47947_c71f27ab6254cbae5274f794601f848a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_c71f27ab6254cbae5274f794601f848a.jpg already downloaded
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F34%252F2d34bb289b17c000e6ef755c4329492d%252Fpa%252FCK47947_721a17e9b39e9e16947b3836551a82be.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_721a17e9b39e9e16947b3836551a82be.jpg already downloaded
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F34%252F2d34bb289b17c000e6ef755c4329492d%252Fpa%252FCK47947_d593f0479a6aa930283ab044cd665a8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_d593f0479a6aa930283ab044cd665a8b.jpg already downloaded
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F34%252F2d34bb289b17c000e6ef755c4329492d%252Fpa%252FCK47947_478882c0833439b2bafd547e68c1acdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_478882c0833439b2bafd547e68c1acdf.jpg already downloaded
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F34%252F2d34bb289b17c000e6ef755c4329492d%252Fpa%252FCK47947_9671e0b362905a132d9fe9f0ec4c50d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_9671e0b362905a132d9fe9f0ec4c50d7.jpg already downloaded
2026-03-30 08:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 47360c9b-4968-5335-a307-0dd1a8537764, identifier: CK47947
2026-03-30 08:01:39 [auto1.es] INFO: Found listing with ID: NH02350
2026-03-30 08:01:39 [auto1.es] INFO: Found listing with ID: HY00110
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY00110%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [auto1.es] INFO: Scrape type for HY00110: 2
2026-03-30 08:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6c79c8b-774b-5678-aef3-2e9e08849ea9 with identifier: HY00110
2026-03-30 08:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c79c8b-774b-5678-aef3-2e9e08849ea9 with scrape type 2
2026-03-30 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6c79c8b-774b-5678-aef3-2e9e08849ea9 with scrape type 2
2026-03-30 08:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6c79c8b-774b-5678-aef3-2e9e08849ea9, identifier: HY00110
2026-03-30 08:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 47360c9b-4968-5335-a307-0dd1a8537764 with identifier: CK47947
2026-03-30 08:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 47360c9b-4968-5335-a307-0dd1a8537764 with identifier: CK47947
2026-03-30 08:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 47360c9b-4968-5335-a307-0dd1a8537764 with identifier: CK47947 to the API
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CK47947>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:10:04Z',
 'fuel_type': 'diesel',
 'id': '47360c9b-4968-5335-a307-0dd1a8537764',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK47947',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 76822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_02e1de05d6b5639ae45a1ceb068d193a.jpg',
                'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_b8a6a3c59bc1638a098016ae07ffc613.jpg',
                'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_a37e81c05637250ac0ea36f3617b81bb.jpg',
                'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_4d9fe39c4bb0debf18e5a8d9df9acc21.jpg',
                'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_9d6d795c6c20a802117173b5022ea8f9.jpg',
                'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_c71f27ab6254cbae5274f794601f848a.jpg',
                'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_721a17e9b39e9e16947b3836551a82be.jpg',
                'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_d593f0479a6aa930283ab044cd665a8b.jpg',
                'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_478882c0833439b2bafd547e68c1acdf.jpg',
                'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_9671e0b362905a132d9fe9f0ec4c50d7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47360c9b-4968-5335-a307-0dd1a8537764/47360c9b-4968-5335-a307-0dd1a8537764_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_02e1de05d6b5639ae45a1ceb068d193a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47360c9b-4968-5335-a307-0dd1a8537764/47360c9b-4968-5335-a307-0dd1a8537764_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_b8a6a3c59bc1638a098016ae07ffc613.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47360c9b-4968-5335-a307-0dd1a8537764/47360c9b-4968-5335-a307-0dd1a8537764_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_a37e81c05637250ac0ea36f3617b81bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47360c9b-4968-5335-a307-0dd1a8537764/47360c9b-4968-5335-a307-0dd1a8537764_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_4d9fe39c4bb0debf18e5a8d9df9acc21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47360c9b-4968-5335-a307-0dd1a8537764/47360c9b-4968-5335-a307-0dd1a8537764_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_9d6d795c6c20a802117173b5022ea8f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47360c9b-4968-5335-a307-0dd1a8537764/47360c9b-4968-5335-a307-0dd1a8537764_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_c71f27ab6254cbae5274f794601f848a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47360c9b-4968-5335-a307-0dd1a8537764/47360c9b-4968-5335-a307-0dd1a8537764_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_721a17e9b39e9e16947b3836551a82be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47360c9b-4968-5335-a307-0dd1a8537764/47360c9b-4968-5335-a307-0dd1a8537764_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_d593f0479a6aa930283ab044cd665a8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47360c9b-4968-5335-a307-0dd1a8537764/47360c9b-4968-5335-a307-0dd1a8537764_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_478882c0833439b2bafd547e68c1acdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47360c9b-4968-5335-a307-0dd1a8537764/47360c9b-4968-5335-a307-0dd1a8537764_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/34/2d34bb289b17c000e6ef755c4329492d/pa/CK47947_9671e0b362905a132d9fe9f0ec4c50d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Vivaro 1.5 CDTI M Express',
 'transmission': 'manual',
 'trim': 'M Express',
 'year': 2019}
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CK47947%27 HTTP/1.1" 200 None
2026-03-30 08:01:39 [auto1.es] INFO: Saving data for CK47947: {'created_time': 1774857699.88314, 'last_price_update_time': 1774857699.883154, 'auction_closing_time': 1774969804.0}
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CK47947') HTTP/1.1" 204 0
2026-03-30 08:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6c79c8b-774b-5678-aef3-2e9e08849ea9 with identifier: HY00110
2026-03-30 08:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6c79c8b-774b-5678-aef3-2e9e08849ea9 with identifier: HY00110
2026-03-30 08:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6c79c8b-774b-5678-aef3-2e9e08849ea9 with identifier: HY00110 to the API
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:46:25Z',
 'fuel_type': 'diesel',
 'id': 'd6c79c8b-774b-5678-aef3-2e9e08849ea9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY00110',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 259839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-17',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Advance',
 'transmission': 'automatic',
 'trim': 'quattro Advance',
 'year': 2011}
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY00110%27 HTTP/1.1" 200 None
2026-03-30 08:01:40 [auto1.es] INFO: Saving data for HY00110: {'auction_closing_time': 1774971985.0, 'created_time': 1773900623.816827, 'last_price_update_time': 1774857700.362743}
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HY00110') HTTP/1.1" 204 0
2026-03-30 08:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e905590>
2026-03-30 08:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_4cc45dd3b86488785e3c2454077f7512.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_4cc45dd3b86488785e3c2454077f7512.jpg saved to cache
2026-03-30 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aecbada5-4c50-59e4-987a-8331446772b8
2026-03-30 08:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e069410>
2026-03-30 08:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_fd350611619a1352847b423bdc9a86ee.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_fd350611619a1352847b423bdc9a86ee.jpg saved to cache
2026-03-30 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aecbada5-4c50-59e4-987a-8331446772b8
2026-03-30 08:01:40 [auto1.es] INFO: Found listing with ID: BK02277
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK02277%27 HTTP/1.1" 200 None
2026-03-30 08:01:40 [auto1.es] INFO: Scrape type for BK02277: 2
2026-03-30 08:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bdbc5ac-ca3d-5580-a1a9-a4fb33a3f190 with identifier: BK02277
2026-03-30 08:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bdbc5ac-ca3d-5580-a1a9-a4fb33a3f190 with scrape type 2
2026-03-30 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bdbc5ac-ca3d-5580-a1a9-a4fb33a3f190 with scrape type 2
2026-03-30 08:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0bdbc5ac-ca3d-5580-a1a9-a4fb33a3f190, identifier: BK02277
2026-03-30 08:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE83631/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0bdbc5ac-ca3d-5580-a1a9-a4fb33a3f190 with identifier: BK02277
2026-03-30 08:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0bdbc5ac-ca3d-5580-a1a9-a4fb33a3f190 with identifier: BK02277
2026-03-30 08:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0bdbc5ac-ca3d-5580-a1a9-a4fb33a3f190 with identifier: BK02277 to the API
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-31T15:38:06Z',
 'fuel_type': 'diesel',
 'id': '0bdbc5ac-ca3d-5580-a1a9-a4fb33a3f190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK02277',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 195463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-07',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2014}
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK02277%27 HTTP/1.1" 200 None
2026-03-30 08:01:40 [auto1.es] INFO: Saving data for BK02277: {'auction_closing_time': 1774971486.0, 'created_time': 1773496888.1444, 'last_price_update_time': 1774857700.96997}
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BK02277') HTTP/1.1" 204 0
2026-03-30 08:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM85037> (referer: https://www.auto1.com/v1/car-details-view/NM85037/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:40 [auto1.es] INFO: Found listing with ID: HU62060
2026-03-30 08:01:40 [auto1.es] INFO: Found listing with ID: ZH31692
2026-03-30 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH31692%27 HTTP/1.1" 200 None
2026-03-30 08:01:41 [auto1.es] INFO: Scrape type for ZH31692: 1
2026-03-30 08:01:41 [auto1.es] INFO: Found listing with ID: FC86593
2026-03-30 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC86593%27 HTTP/1.1" 200 None
2026-03-30 08:01:41 [auto1.es] INFO: Scrape type for FC86593: 2
2026-03-30 08:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccc098db-4135-573e-b749-5f2557e979a7 with identifier: FC86593
2026-03-30 08:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccc098db-4135-573e-b749-5f2557e979a7 with scrape type 2
2026-03-30 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccc098db-4135-573e-b749-5f2557e979a7 with scrape type 2
2026-03-30 08:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ccc098db-4135-573e-b749-5f2557e979a7, identifier: FC86593
2026-03-30 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ccc098db-4135-573e-b749-5f2557e979a7 with identifier: FC86593
2026-03-30 08:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ccc098db-4135-573e-b749-5f2557e979a7 with identifier: FC86593
2026-03-30 08:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ccc098db-4135-573e-b749-5f2557e979a7 with identifier: FC86593 to the API
2026-03-30 08:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:29:38Z',
 'fuel_type': 'petrol',
 'id': 'ccc098db-4135-573e-b749-5f2557e979a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC86593',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 138512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-31',
 'seller_name': None,
 'title': 'Seat Leon 1.6 Last Edition',
 'transmission': 'manual',
 'trim': 'Last Edition',
 'year': 2005}
2026-03-30 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC86593%27 HTTP/1.1" 200 None
2026-03-30 08:01:41 [auto1.es] INFO: Saving data for FC86593: {'auction_closing_time': 1774970978.0, 'created_time': 1773127624.413428, 'last_price_update_time': 1774857701.576737}
2026-03-30 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FC86593') HTTP/1.1" 204 0
2026-03-30 08:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:41 [auto1.es] INFO: Found listing with ID: KV49695
2026-03-30 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV49695%27 HTTP/1.1" 200 None
2026-03-30 08:01:41 [auto1.es] INFO: Scrape type for KV49695: 2
2026-03-30 08:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ce391d-f29b-5425-839a-016dc14a112a with identifier: KV49695
2026-03-30 08:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ce391d-f29b-5425-839a-016dc14a112a with scrape type 2
2026-03-30 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9ce391d-f29b-5425-839a-016dc14a112a with scrape type 2
2026-03-30 08:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9ce391d-f29b-5425-839a-016dc14a112a, identifier: KV49695
2026-03-30 08:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9ce391d-f29b-5425-839a-016dc14a112a with identifier: KV49695
2026-03-30 08:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9ce391d-f29b-5425-839a-016dc14a112a with identifier: KV49695
2026-03-30 08:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f9ce391d-f29b-5425-839a-016dc14a112a with identifier: KV49695 to the API
2026-03-30 08:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:28:33Z',
 'fuel_type': 'diesel',
 'id': 'f9ce391d-f29b-5425-839a-016dc14a112a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV49695',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 305136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2015}
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV49695%27 HTTP/1.1" 200 None
2026-03-30 08:01:42 [auto1.es] INFO: Saving data for KV49695: {'auction_closing_time': 1774970913.0, 'created_time': 1773133639.650089, 'last_price_update_time': 1774857702.122313}
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KV49695') HTTP/1.1" 204 0
2026-03-30 08:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 912ea90b-f0a1-50f3-847e-4bf5fa174e47 with identifier: NM85037
2026-03-30 08:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47 with scrape type 1
2026-03-30 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_d3395f36faa10fd7cb5192ec04bbafd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_d3395f36faa10fd7cb5192ec04bbafd3.jpg not downloaded yet
2026-03-30 08:01:42 [auto1.es] INFO: Found listing with ID: AG88258
2026-03-30 08:01:42 [auto1.es] INFO: Found listing with ID: TE03576
2026-03-30 08:01:42 [auto1.es] INFO: Found listing with ID: LP64738
2026-03-30 08:01:42 [auto1.es] INFO: Found listing with ID: HX04467
2026-03-30 08:01:42 [auto1.es] INFO: Found listing with ID: NG91820
2026-03-30 08:01:42 [auto1.es] INFO: Found listing with ID: CH18424
2026-03-30 08:01:42 [auto1.es] INFO: Found listing with ID: BP46708
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP46708%27 HTTP/1.1" 200 None
2026-03-30 08:01:42 [auto1.es] INFO: Scrape type for BP46708: 2
2026-03-30 08:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bae3910-cbd5-573e-991e-301d02bc38de with identifier: BP46708
2026-03-30 08:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bae3910-cbd5-573e-991e-301d02bc38de with scrape type 2
2026-03-30 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bae3910-cbd5-573e-991e-301d02bc38de with scrape type 2
2026-03-30 08:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3bae3910-cbd5-573e-991e-301d02bc38de, identifier: BP46708
2026-03-30 08:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV63051> (referer: https://www.auto1.com/v1/car-details-view/BV63051/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3bae3910-cbd5-573e-991e-301d02bc38de with identifier: BP46708
2026-03-30 08:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3bae3910-cbd5-573e-991e-301d02bc38de with identifier: BP46708
2026-03-30 08:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3bae3910-cbd5-573e-991e-301d02bc38de with identifier: BP46708 to the API
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:41:52Z',
 'fuel_type': 'diesel',
 'id': '3bae3910-cbd5-573e-991e-301d02bc38de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP46708',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 283239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-02',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2013}
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP46708%27 HTTP/1.1" 200 None
2026-03-30 08:01:42 [auto1.es] INFO: Saving data for BP46708: {'auction_closing_time': 1774971712.0, 'created_time': 1773777803.654497, 'last_price_update_time': 1774857702.669969}
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BP46708') HTTP/1.1" 204 0
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_265df1ac6de227f0505264f470221ecc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_265df1ac6de227f0505264f470221ecc.jpg not downloaded yet
2026-03-30 08:01:42 [auto1.es] INFO: Channel: 24h | Page: 9 | totalHits: 2178 | hits on page: 40
2026-03-30 08:01:42 [auto1.es] INFO: Found listing with ID: GW46978
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW46978%27 HTTP/1.1" 200 None
2026-03-30 08:01:42 [auto1.es] INFO: Scrape type for GW46978: 2
2026-03-30 08:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0347fef3-23eb-55c8-b86e-d728d1c4fd03 with identifier: GW46978
2026-03-30 08:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0347fef3-23eb-55c8-b86e-d728d1c4fd03 with scrape type 2
2026-03-30 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0347fef3-23eb-55c8-b86e-d728d1c4fd03 with scrape type 2
2026-03-30 08:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0347fef3-23eb-55c8-b86e-d728d1c4fd03, identifier: GW46978
2026-03-30 08:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0347fef3-23eb-55c8-b86e-d728d1c4fd03 with identifier: GW46978
2026-03-30 08:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0347fef3-23eb-55c8-b86e-d728d1c4fd03 with identifier: GW46978
2026-03-30 08:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0347fef3-23eb-55c8-b86e-d728d1c4fd03 with identifier: GW46978 to the API
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-31T15:08:56Z',
 'fuel_type': 'petrol',
 'id': '0347fef3-23eb-55c8-b86e-d728d1c4fd03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW46978',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 38711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2021}
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW46978%27 HTTP/1.1" 200 None
2026-03-30 08:01:43 [auto1.es] INFO: Saving data for GW46978: {'auction_closing_time': 1774969736.0, 'created_time': 1773745312.543132, 'last_price_update_time': 1774857703.303763}
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GW46978') HTTP/1.1" 204 0
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_44180d6fd33c78fd7e95c82473a3f691.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_44180d6fd33c78fd7e95c82473a3f691.jpg not downloaded yet
2026-03-30 08:01:43 [auto1.es] INFO: Found listing with ID: EH00837
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH00837%27 HTTP/1.1" 200 None
2026-03-30 08:01:43 [auto1.es] INFO: Scrape type for EH00837: 2
2026-03-30 08:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf6b556b-e08e-58fd-b102-e09f01142303 with identifier: EH00837
2026-03-30 08:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6b556b-e08e-58fd-b102-e09f01142303 with scrape type 2
2026-03-30 08:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf6b556b-e08e-58fd-b102-e09f01142303 with scrape type 2
2026-03-30 08:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf6b556b-e08e-58fd-b102-e09f01142303, identifier: EH00837
2026-03-30 08:01:43 [auto1.es] INFO: Found listing with ID: ZA22926
2026-03-30 08:01:43 [auto1.es] INFO: Found listing with ID: DH89256
2026-03-30 08:01:43 [auto1.es] INFO: Found listing with ID: HT29464
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT29464%27 HTTP/1.1" 200 None
2026-03-30 08:01:43 [auto1.es] INFO: Scrape type for HT29464: 2
2026-03-30 08:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a566dd25-66d0-59e2-8e12-e3ac5c9415ce with identifier: HT29464
2026-03-30 08:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a566dd25-66d0-59e2-8e12-e3ac5c9415ce with scrape type 2
2026-03-30 08:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a566dd25-66d0-59e2-8e12-e3ac5c9415ce with scrape type 2
2026-03-30 08:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a566dd25-66d0-59e2-8e12-e3ac5c9415ce, identifier: HT29464
2026-03-30 08:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf6b556b-e08e-58fd-b102-e09f01142303 with identifier: EH00837
2026-03-30 08:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf6b556b-e08e-58fd-b102-e09f01142303 with identifier: EH00837
2026-03-30 08:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cf6b556b-e08e-58fd-b102-e09f01142303 with identifier: EH00837 to the API
2026-03-30 08:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-31T15:10:50Z',
 'fuel_type': 'diesel',
 'id': 'cf6b556b-e08e-58fd-b102-e09f01142303',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH00837',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 263966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-26',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH00837%27 HTTP/1.1" 200 None
2026-03-30 08:01:44 [auto1.es] INFO: Saving data for EH00837: {'auction_closing_time': 1774969850.0, 'created_time': 1773238902.10234, 'last_price_update_time': 1774857704.154396}
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EH00837') HTTP/1.1" 204 0
2026-03-30 08:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6 with identifier: BV63051
2026-03-30 08:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6 with scrape type 1
2026-03-30 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F86%252Fee8600bc98f49960eb4091b0e10faa23%252Fpa%252FBV63051_5df957462896ca58e6a981e2b5565765.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_5df957462896ca58e6a981e2b5565765.jpg already downloaded
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F86%252Fee8600bc98f49960eb4091b0e10faa23%252Fpa%252FBV63051_87898047036697f722bfb06e27e599cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_87898047036697f722bfb06e27e599cf.jpg already downloaded
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F86%252Fee8600bc98f49960eb4091b0e10faa23%252Fpa%252FBV63051_8d214f2af418f744bf2e051f047c65ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_8d214f2af418f744bf2e051f047c65ba.jpg already downloaded
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F86%252Fee8600bc98f49960eb4091b0e10faa23%252Fpa%252FBV63051_eee3f28b31fc176e6e7fd1a2f4743527.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_eee3f28b31fc176e6e7fd1a2f4743527.jpg already downloaded
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F86%252Fee8600bc98f49960eb4091b0e10faa23%252Fpa%252FBV63051_4daa1b0c3697c8dfa8fa6a0984cf0532.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_4daa1b0c3697c8dfa8fa6a0984cf0532.jpg already downloaded
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F86%252Fee8600bc98f49960eb4091b0e10faa23%252Fpa%252FBV63051_deeff57b96db79b279a75a4e8a6be233.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_deeff57b96db79b279a75a4e8a6be233.jpg already downloaded
2026-03-30 08:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6, identifier: BV63051
2026-03-30 08:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a566dd25-66d0-59e2-8e12-e3ac5c9415ce with identifier: HT29464
2026-03-30 08:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a566dd25-66d0-59e2-8e12-e3ac5c9415ce with identifier: HT29464
2026-03-30 08:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a566dd25-66d0-59e2-8e12-e3ac5c9415ce with identifier: HT29464 to the API
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-31T15:30:17Z',
 'fuel_type': 'diesel',
 'id': 'a566dd25-66d0-59e2-8e12-e3ac5c9415ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT29464',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 230860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-22',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2006}
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT29464%27 HTTP/1.1" 200 None
2026-03-30 08:01:44 [auto1.es] INFO: Saving data for HT29464: {'auction_closing_time': 1774971017.0, 'created_time': 1772142402.460958, 'last_price_update_time': 1774857704.843473}
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HT29464') HTTP/1.1" 204 0
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_30062f0fd19fb3a3c4439e52a54d5e14.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_30062f0fd19fb3a3c4439e52a54d5e14.jpg not downloaded yet
2026-03-30 08:01:44 [auto1.es] INFO: Found listing with ID: MZ63101
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ63101%27 HTTP/1.1" 200 None
2026-03-30 08:01:44 [auto1.es] INFO: Scrape type for MZ63101: 1
2026-03-30 08:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6 with identifier: BV63051
2026-03-30 08:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6 with identifier: BV63051
2026-03-30 08:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6 with identifier: BV63051 to the API
2026-03-30 08:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BV63051>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:27:30Z',
 'fuel_type': 'petrol',
 'id': '1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV63051',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 169223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_5df957462896ca58e6a981e2b5565765.jpg',
                'https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_87898047036697f722bfb06e27e599cf.jpg',
                'https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_8d214f2af418f744bf2e051f047c65ba.jpg',
                'https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_eee3f28b31fc176e6e7fd1a2f4743527.jpg',
                'https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_4daa1b0c3697c8dfa8fa6a0984cf0532.jpg',
                'https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_deeff57b96db79b279a75a4e8a6be233.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6/1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_5df957462896ca58e6a981e2b5565765.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6/1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_87898047036697f722bfb06e27e599cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6/1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_8d214f2af418f744bf2e051f047c65ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6/1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_eee3f28b31fc176e6e7fd1a2f4743527.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6/1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_4daa1b0c3697c8dfa8fa6a0984cf0532.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6/1ecc0e91-9ec7-5e4f-89ec-998ef1d5c9a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/86/ee8600bc98f49960eb4091b0e10faa23/pa/BV63051_deeff57b96db79b279a75a4e8a6be233.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 GL 5 portes',
 'transmission': 'manual',
 'trim': 'GL 5 portes',
 'year': 2010}
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV63051%27 HTTP/1.1" 200 None
2026-03-30 08:01:45 [auto1.es] INFO: Saving data for BV63051: {'created_time': 1774857705.219025, 'last_price_update_time': 1774857705.219039, 'auction_closing_time': 1774970850.0}
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BV63051') HTTP/1.1" 204 0
2026-03-30 08:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_d3395f36faa10fd7cb5192ec04bbafd3.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:45 [auto1.es] INFO: Found listing with ID: AR83818
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR83818%27 HTTP/1.1" 200 None
2026-03-30 08:01:45 [auto1.es] INFO: Scrape type for AR83818: 2
2026-03-30 08:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e62fc21-84df-5efa-a90e-a1c3d105eef2 with identifier: AR83818
2026-03-30 08:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2 with scrape type 2
2026-03-30 08:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e62fc21-84df-5efa-a90e-a1c3d105eef2 with scrape type 2
2026-03-30 08:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1e62fc21-84df-5efa-a90e-a1c3d105eef2, identifier: AR83818
2026-03-30 08:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1e62fc21-84df-5efa-a90e-a1c3d105eef2 with identifier: AR83818
2026-03-30 08:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1e62fc21-84df-5efa-a90e-a1c3d105eef2 with identifier: AR83818
2026-03-30 08:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1e62fc21-84df-5efa-a90e-a1c3d105eef2 with identifier: AR83818 to the API
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:15:27Z',
 'fuel_type': 'petrol',
 'id': '1e62fc21-84df-5efa-a90e-a1c3d105eef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR83818',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 66305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-18',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2018}
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR83818%27 HTTP/1.1" 200 None
2026-03-30 08:01:45 [auto1.es] INFO: Saving data for AR83818: {'auction_closing_time': 1774970127.0, 'created_time': 1773659946.300942, 'last_price_update_time': 1774857705.689191}
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AR83818') HTTP/1.1" 204 0
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_c72a00e664a346d296f2edbc034bad15.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_c72a00e664a346d296f2edbc034bad15.jpg not downloaded yet
2026-03-30 08:01:45 [auto1.es] INFO: Found listing with ID: NA64654
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA64654%27 HTTP/1.1" 200 None
2026-03-30 08:01:45 [auto1.es] INFO: Scrape type for NA64654: 2
2026-03-30 08:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9 with identifier: NA64654
2026-03-30 08:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9 with scrape type 2
2026-03-30 08:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9 with scrape type 2
2026-03-30 08:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9, identifier: NA64654
2026-03-30 08:01:45 [auto1.es] INFO: Found listing with ID: EB95108
2026-03-30 08:01:45 [auto1.es] INFO: Found listing with ID: PR72166
2026-03-30 08:01:45 [auto1.es] INFO: Found listing with ID: AZ96253
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ96253%27 HTTP/1.1" 200 None
2026-03-30 08:01:45 [auto1.es] INFO: Scrape type for AZ96253: 2
2026-03-30 08:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d73223b-0b2e-588e-9685-41e960cc0459 with identifier: AZ96253
2026-03-30 08:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d73223b-0b2e-588e-9685-41e960cc0459 with scrape type 2
2026-03-30 08:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d73223b-0b2e-588e-9685-41e960cc0459 with scrape type 2
2026-03-30 08:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1d73223b-0b2e-588e-9685-41e960cc0459, identifier: AZ96253
2026-03-30 08:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9 with identifier: NA64654
2026-03-30 08:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9 with identifier: NA64654
2026-03-30 08:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 708f0a8e-9f33-522c-b86b-0b4a09e7ccb9 with identifier: NA64654 to the API
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:44:34Z',
 'fuel_type': 'diesel',
 'id': '708f0a8e-9f33-522c-b86b-0b4a09e7ccb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA64654',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 281934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-26',
 'seller_name': None,
 'title': 'Seat Leon 1.9 TDI Last Edition',
 'transmission': 'manual',
 'trim': 'Last Edition',
 'year': 2006}
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA64654%27 HTTP/1.1" 200 None
2026-03-30 08:01:46 [auto1.es] INFO: Saving data for NA64654: {'auction_closing_time': 1774971874.0, 'created_time': 1773131038.728098, 'last_price_update_time': 1774857706.419773}
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NA64654') HTTP/1.1" 204 0
2026-03-30 08:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1d73223b-0b2e-588e-9685-41e960cc0459 with identifier: AZ96253
2026-03-30 08:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1d73223b-0b2e-588e-9685-41e960cc0459 with identifier: AZ96253
2026-03-30 08:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1d73223b-0b2e-588e-9685-41e960cc0459 with identifier: AZ96253 to the API
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:44:50Z',
 'fuel_type': 'diesel',
 'id': '1d73223b-0b2e-588e-9685-41e960cc0459',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ96253',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 139643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ96253%27 HTTP/1.1" 200 None
2026-03-30 08:01:46 [auto1.es] INFO: Saving data for AZ96253: {'auction_closing_time': 1774971890.0, 'created_time': 1773669828.941264, 'last_price_update_time': 1774857706.892366}
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AZ96253') HTTP/1.1" 204 0
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_07f0f547b63b378c14b9bd90f6d57644.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_07f0f547b63b378c14b9bd90f6d57644.jpg not downloaded yet
2026-03-30 08:01:46 [auto1.es] INFO: Found listing with ID: SF48857
2026-03-30 08:01:46 [auto1.es] INFO: Found listing with ID: NK96984
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK96984%27 HTTP/1.1" 200 None
2026-03-30 08:01:46 [auto1.es] INFO: Scrape type for NK96984: 1
2026-03-30 08:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_44180d6fd33c78fd7e95c82473a3f691.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_265df1ac6de227f0505264f470221ecc.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:46 [auto1.es] INFO: Found listing with ID: DN29660
2026-03-30 08:01:46 [auto1.es] INFO: Found listing with ID: WK92895
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK92895%27 HTTP/1.1" 200 None
2026-03-30 08:01:46 [auto1.es] INFO: Scrape type for WK92895: 1
2026-03-30 08:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH31692/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e9ae610>
2026-03-30 08:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_d3395f36faa10fd7cb5192ec04bbafd3.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_d3395f36faa10fd7cb5192ec04bbafd3.jpg saved to cache
2026-03-30 08:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_03d6cd579d2486b55d1b9882a0f768ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_03d6cd579d2486b55d1b9882a0f768ee.jpg not downloaded yet
2026-03-30 08:01:47 [auto1.es] INFO: Found listing with ID: CS79839
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS79839%27 HTTP/1.1" 200 None
2026-03-30 08:01:47 [auto1.es] INFO: Scrape type for CS79839: 2
2026-03-30 08:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fd0c1b9-b918-545d-b72c-4afed6aa18a6 with identifier: CS79839
2026-03-30 08:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fd0c1b9-b918-545d-b72c-4afed6aa18a6 with scrape type 2
2026-03-30 08:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fd0c1b9-b918-545d-b72c-4afed6aa18a6 with scrape type 2
2026-03-30 08:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0fd0c1b9-b918-545d-b72c-4afed6aa18a6, identifier: CS79839
2026-03-30 08:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_30062f0fd19fb3a3c4439e52a54d5e14.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:47 [auto1.es] INFO: Found listing with ID: MW98976
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW98976%27 HTTP/1.1" 200 None
2026-03-30 08:01:47 [auto1.es] INFO: Scrape type for MW98976: 2
2026-03-30 08:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d11eb47a-b81b-5916-b055-6e03489846aa with identifier: MW98976
2026-03-30 08:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d11eb47a-b81b-5916-b055-6e03489846aa with scrape type 2
2026-03-30 08:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d11eb47a-b81b-5916-b055-6e03489846aa with scrape type 2
2026-03-30 08:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d11eb47a-b81b-5916-b055-6e03489846aa, identifier: MW98976
2026-03-30 08:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0fd0c1b9-b918-545d-b72c-4afed6aa18a6 with identifier: CS79839
2026-03-30 08:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0fd0c1b9-b918-545d-b72c-4afed6aa18a6 with identifier: CS79839
2026-03-30 08:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0fd0c1b9-b918-545d-b72c-4afed6aa18a6 with identifier: CS79839 to the API
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:10:43Z',
 'fuel_type': 'diesel',
 'id': '0fd0c1b9-b918-545d-b72c-4afed6aa18a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS79839',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 115081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-26',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2019}
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS79839%27 HTTP/1.1" 200 None
2026-03-30 08:01:47 [auto1.es] INFO: Saving data for CS79839: {'auction_closing_time': 1774969843.0, 'created_time': 1773248738.602501, 'last_price_update_time': 1774857707.923025}
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CS79839') HTTP/1.1" 204 0
2026-03-30 08:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d11eb47a-b81b-5916-b055-6e03489846aa with identifier: MW98976
2026-03-30 08:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d11eb47a-b81b-5916-b055-6e03489846aa with identifier: MW98976
2026-03-30 08:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d11eb47a-b81b-5916-b055-6e03489846aa with identifier: MW98976 to the API
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:01:23Z',
 'fuel_type': 'diesel',
 'id': 'd11eb47a-b81b-5916-b055-6e03489846aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW98976',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 156419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-03',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI X-Perience 4Drive',
 'transmission': 'automatic',
 'trim': 'X-Perience 4Drive',
 'year': 2016}
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW98976%27 HTTP/1.1" 200 None
2026-03-30 08:01:48 [auto1.es] INFO: Saving data for MW98976: {'auction_closing_time': 1774969283.0, 'created_time': 1773127687.184634, 'last_price_update_time': 1774857708.272797}
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MW98976') HTTP/1.1" 204 0
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_c4b853c7581035005834804eb2cfe24d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_c4b853c7581035005834804eb2cfe24d.jpg not downloaded yet
2026-03-30 08:01:48 [auto1.es] INFO: Found listing with ID: NA59982
2026-03-30 08:01:48 [auto1.es] INFO: Found listing with ID: SA96918
2026-03-30 08:01:48 [auto1.es] INFO: Found listing with ID: AV99168
2026-03-30 08:01:48 [auto1.es] INFO: Found listing with ID: NX58407
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX58407%27 HTTP/1.1" 200 None
2026-03-30 08:01:48 [auto1.es] INFO: Scrape type for NX58407: 2
2026-03-30 08:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa261169-b42d-5133-8cfc-1786abc021fe with identifier: NX58407
2026-03-30 08:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa261169-b42d-5133-8cfc-1786abc021fe with scrape type 2
2026-03-30 08:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa261169-b42d-5133-8cfc-1786abc021fe with scrape type 2
2026-03-30 08:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fa261169-b42d-5133-8cfc-1786abc021fe, identifier: NX58407
2026-03-30 08:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_c72a00e664a346d296f2edbc034bad15.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fa261169-b42d-5133-8cfc-1786abc021fe with identifier: NX58407
2026-03-30 08:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fa261169-b42d-5133-8cfc-1786abc021fe with identifier: NX58407
2026-03-30 08:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fa261169-b42d-5133-8cfc-1786abc021fe with identifier: NX58407 to the API
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:24:13Z',
 'fuel_type': 'diesel',
 'id': 'fa261169-b42d-5133-8cfc-1786abc021fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX58407',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 272743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-30',
 'seller_name': None,
 'title': 'Renault Espace 2.0 dCi Privilege',
 'transmission': 'manual',
 'trim': 'Privilege',
 'year': 2006}
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX58407%27 HTTP/1.1" 200 None
2026-03-30 08:01:48 [auto1.es] INFO: Saving data for NX58407: {'auction_closing_time': 1774970653.0, 'created_time': 1773130877.923891, 'last_price_update_time': 1774857708.962141}
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NX58407') HTTP/1.1" 204 0
2026-03-30 08:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE83631> (referer: https://www.auto1.com/v1/car-details-view/PE83631/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e9b6ad0>
2026-03-30 08:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_44180d6fd33c78fd7e95c82473a3f691.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_44180d6fd33c78fd7e95c82473a3f691.jpg saved to cache
2026-03-30 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47
2026-03-30 08:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e04a650>
2026-03-30 08:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_265df1ac6de227f0505264f470221ecc.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_265df1ac6de227f0505264f470221ecc.jpg saved to cache
2026-03-30 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_f112fb5b91ddd71d5816afb3e40f9969.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_f112fb5b91ddd71d5816afb3e40f9969.jpg not downloaded yet
2026-03-30 08:01:49 [auto1.es] INFO: Found listing with ID: EA93149
2026-03-30 08:01:49 [auto1.es] INFO: Found listing with ID: BF07220
2026-03-30 08:01:49 [auto1.es] INFO: Found listing with ID: UA87015
2026-03-30 08:01:49 [auto1.es] INFO: Found listing with ID: EA60639
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA60639%27 HTTP/1.1" 200 None
2026-03-30 08:01:49 [auto1.es] INFO: Scrape type for EA60639: 2
2026-03-30 08:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f95d6df-07c3-542d-9cab-f5b89161978c with identifier: EA60639
2026-03-30 08:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f95d6df-07c3-542d-9cab-f5b89161978c with scrape type 2
2026-03-30 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f95d6df-07c3-542d-9cab-f5b89161978c with scrape type 2
2026-03-30 08:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f95d6df-07c3-542d-9cab-f5b89161978c, identifier: EA60639
2026-03-30 08:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f95d6df-07c3-542d-9cab-f5b89161978c with identifier: EA60639
2026-03-30 08:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f95d6df-07c3-542d-9cab-f5b89161978c with identifier: EA60639
2026-03-30 08:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f95d6df-07c3-542d-9cab-f5b89161978c with identifier: EA60639 to the API
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:09:55Z',
 'fuel_type': 'diesel',
 'id': '3f95d6df-07c3-542d-9cab-f5b89161978c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA60639',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 55285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-23',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Outdoor',
 'transmission': 'manual',
 'trim': 'Outdoor',
 'year': 2016}
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA60639%27 HTTP/1.1" 200 None
2026-03-30 08:01:49 [auto1.es] INFO: Saving data for EA60639: {'auction_closing_time': 1774969795.0, 'created_time': 1773181415.289155, 'last_price_update_time': 1774857709.563858}
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EA60639') HTTP/1.1" 204 0
2026-03-30 08:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e9761d0>
2026-03-30 08:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_30062f0fd19fb3a3c4439e52a54d5e14.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_30062f0fd19fb3a3c4439e52a54d5e14.jpg saved to cache
2026-03-30 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47
2026-03-30 08:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_03d6cd579d2486b55d1b9882a0f768ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_07f0f547b63b378c14b9bd90f6d57644.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_97ca4b1af01cddbccd6e79802695a635.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_97ca4b1af01cddbccd6e79802695a635.jpg not downloaded yet
2026-03-30 08:01:49 [auto1.es] INFO: Found listing with ID: LS25075
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS25075%27 HTTP/1.1" 200 None
2026-03-30 08:01:49 [auto1.es] INFO: Scrape type for LS25075: 2
2026-03-30 08:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f15b73df-6dbe-52e8-bd3a-d2dedf076a17 with identifier: LS25075
2026-03-30 08:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f15b73df-6dbe-52e8-bd3a-d2dedf076a17 with scrape type 2
2026-03-30 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f15b73df-6dbe-52e8-bd3a-d2dedf076a17 with scrape type 2
2026-03-30 08:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f15b73df-6dbe-52e8-bd3a-d2dedf076a17, identifier: LS25075
2026-03-30 08:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f15b73df-6dbe-52e8-bd3a-d2dedf076a17 with identifier: LS25075
2026-03-30 08:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f15b73df-6dbe-52e8-bd3a-d2dedf076a17 with identifier: LS25075
2026-03-30 08:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f15b73df-6dbe-52e8-bd3a-d2dedf076a17 with identifier: LS25075 to the API
2026-03-30 08:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:49:32Z',
 'fuel_type': 'petrol',
 'id': 'f15b73df-6dbe-52e8-bd3a-d2dedf076a17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS25075',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 102702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-15',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2015}
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS25075%27 HTTP/1.1" 200 None
2026-03-30 08:01:50 [auto1.es] INFO: Saving data for LS25075: {'auction_closing_time': 1774972172.0, 'created_time': 1774123341.536083, 'last_price_update_time': 1774857710.259064}
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LS25075') HTTP/1.1" 204 0
2026-03-30 08:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e0c1c90>
2026-03-30 08:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_c72a00e664a346d296f2edbc034bad15.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_c72a00e664a346d296f2edbc034bad15.jpg saved to cache
2026-03-30 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47
2026-03-30 08:01:50 [auto1.es] INFO: Channel: 24h | Page: 10 | totalHits: 2178 | hits on page: 40
2026-03-30 08:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a27bdb5-9067-59e3-bb12-2dcee26bb422 with identifier: PE83631
2026-03-30 08:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a27bdb5-9067-59e3-bb12-2dcee26bb422 with scrape type 1
2026-03-30 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9a27bdb5-9067-59e3-bb12-2dcee26bb422
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F16%252F5716f4ede79c384380a068dff62764cc%252Fpa%252FPE83631_0ed699a1f04894fca386c514f5961c73.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_0ed699a1f04894fca386c514f5961c73.jpg already downloaded
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F16%252F5716f4ede79c384380a068dff62764cc%252Fpa%252FPE83631_06264cf591353245ec7516868b8d1f4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_06264cf591353245ec7516868b8d1f4e.jpg already downloaded
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F16%252F5716f4ede79c384380a068dff62764cc%252Fpa%252FPE83631_9f2665db03a8bc0fd24da13ff94f8267.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_9f2665db03a8bc0fd24da13ff94f8267.jpg already downloaded
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F16%252F5716f4ede79c384380a068dff62764cc%252Fpa%252FPE83631_2f2c41e18f05e1eddeeab5231e697ab8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_2f2c41e18f05e1eddeeab5231e697ab8.jpg already downloaded
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F16%252F5716f4ede79c384380a068dff62764cc%252Fpa%252FPE83631_d90abe993168f64b3825d210702b09f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_d90abe993168f64b3825d210702b09f7.jpg already downloaded
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F16%252F5716f4ede79c384380a068dff62764cc%252Fpa%252FPE83631_823974cbfb161db3e24c1cf84f6815fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_823974cbfb161db3e24c1cf84f6815fc.jpg already downloaded
2026-03-30 08:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9a27bdb5-9067-59e3-bb12-2dcee26bb422, identifier: PE83631
2026-03-30 08:01:50 [auto1.es] INFO: Found listing with ID: UX02026
2026-03-30 08:01:50 [auto1.es] INFO: Found listing with ID: AU64639
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU64639%27 HTTP/1.1" 200 None
2026-03-30 08:01:50 [auto1.es] INFO: Scrape type for AU64639: 1
2026-03-30 08:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9a27bdb5-9067-59e3-bb12-2dcee26bb422 with identifier: PE83631
2026-03-30 08:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9a27bdb5-9067-59e3-bb12-2dcee26bb422 with identifier: PE83631
2026-03-30 08:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9a27bdb5-9067-59e3-bb12-2dcee26bb422 with identifier: PE83631 to the API
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PE83631>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:59:12Z',
 'fuel_type': 'diesel',
 'id': '9a27bdb5-9067-59e3-bb12-2dcee26bb422',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE83631',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 142492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_0ed699a1f04894fca386c514f5961c73.jpg',
                'https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_06264cf591353245ec7516868b8d1f4e.jpg',
                'https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_9f2665db03a8bc0fd24da13ff94f8267.jpg',
                'https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_2f2c41e18f05e1eddeeab5231e697ab8.jpg',
                'https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_d90abe993168f64b3825d210702b09f7.jpg',
                'https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_823974cbfb161db3e24c1cf84f6815fc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27bdb5-9067-59e3-bb12-2dcee26bb422/9a27bdb5-9067-59e3-bb12-2dcee26bb422_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_0ed699a1f04894fca386c514f5961c73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27bdb5-9067-59e3-bb12-2dcee26bb422/9a27bdb5-9067-59e3-bb12-2dcee26bb422_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_06264cf591353245ec7516868b8d1f4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27bdb5-9067-59e3-bb12-2dcee26bb422/9a27bdb5-9067-59e3-bb12-2dcee26bb422_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_9f2665db03a8bc0fd24da13ff94f8267.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27bdb5-9067-59e3-bb12-2dcee26bb422/9a27bdb5-9067-59e3-bb12-2dcee26bb422_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_2f2c41e18f05e1eddeeab5231e697ab8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27bdb5-9067-59e3-bb12-2dcee26bb422/9a27bdb5-9067-59e3-bb12-2dcee26bb422_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_d90abe993168f64b3825d210702b09f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27bdb5-9067-59e3-bb12-2dcee26bb422/9a27bdb5-9067-59e3-bb12-2dcee26bb422_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/16/5716f4ede79c384380a068dff62764cc/pa/PE83631_823974cbfb161db3e24c1cf84f6815fc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira 1.9 CDTI Cosmo',
 'transmission': 'automatic',
 'trim': 'Cosmo',
 'year': 2008}
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE83631%27 HTTP/1.1" 200 None
2026-03-30 08:01:50 [auto1.es] INFO: Saving data for PE83631: {'created_time': 1774857710.957526, 'last_price_update_time': 1774857710.957537, 'auction_closing_time': 1774972752.0}
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PE83631') HTTP/1.1" 204 0
2026-03-30 08:01:50 [auto1.es] INFO: Found listing with ID: XN99288
2026-03-30 08:01:50 [auto1.es] INFO: Found listing with ID: YC05678
2026-03-30 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC05678%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for YC05678: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: TG79405
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: VV17373
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV17373%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for VV17373: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: FD45689
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD45689%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for FD45689: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: CJ82848
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ82848%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for CJ82848: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: GG14242
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG14242%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for GG14242: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: RY07165
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: ST22726
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: KH66285
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH66285%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for KH66285: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: JG48293
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: TE76337
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: NV56765
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: EB04007
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB04007%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for EB04007: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: MN37580
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN37580%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for MN37580: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: SZ88467
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ88467%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for SZ88467: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: VE30170
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE30170%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for VE30170: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: YK84517
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK84517%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for YK84517: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: RC23930
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: FE10852
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE10852%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for FE10852: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: US42967
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: BE81339
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: LY48125
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY48125%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for LY48125: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: WB05226
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: UB14006
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB14006%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for UB14006: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: GU63395
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: BJ99702
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: EB56604
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: DH28057
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: GD98283
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: TC80522
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC80522%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for TC80522: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: LZ88302
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ88302%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for LZ88302: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: DY37922
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY37922%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for DY37922: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: EN63751
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: HU51946
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU51946%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for HU51946: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: MY21675
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY21675%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for MY21675: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: DM30321
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM30321%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for DM30321: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: MF88912
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: VD62527
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: KT14312
2026-03-30 08:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e0627d0>
2026-03-30 08:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_03d6cd579d2486b55d1b9882a0f768ee.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_03d6cd579d2486b55d1b9882a0f768ee.jpg saved to cache
2026-03-30 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47
2026-03-30 08:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ebdf290>
2026-03-30 08:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_07f0f547b63b378c14b9bd90f6d57644.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_07f0f547b63b378c14b9bd90f6d57644.jpg saved to cache
2026-03-30 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47
2026-03-30 08:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_bd8377e181515e02318f0275704d4226.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_c4b853c7581035005834804eb2cfe24d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: ZV35449
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV35449%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for ZV35449: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: KS53937
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: VW16333
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW16333%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for VW16333: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: CV42273
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV42273%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for CV42273: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: NZ35550
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: XA46112
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: SP63286
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: NN81936
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: HY05176
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: YZ74298
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: AZ69629
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ69629%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for AZ69629: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: VJ45850
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ45850%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for VJ45850: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: WZ01367
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: PU93239
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU93239%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for PU93239: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: PL32115
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: PN79224
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: WY32728
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: BZ61067
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ61067%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for BZ61067: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: WG12182
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG12182%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for WG12182: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: CY99272
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY99272%27 HTTP/1.1" 200 None
2026-03-30 08:01:51 [auto1.es] INFO: Scrape type for CY99272: 0
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: MD02288
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: FF03006
2026-03-30 08:01:51 [auto1.es] INFO: Found listing with ID: YK64988
2026-03-30 08:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_f112fb5b91ddd71d5816afb3e40f9969.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 08:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00&'
2026-03-30 08:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88ecf35d0>
2026-03-30 08:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F81%252Fae81ad00e769fdf607fed6cb869c0c1a%252Fpa%252FNC38071_bd8377e181515e02318f0275704d4226.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_bd8377e181515e02318f0275704d4226.jpg saved to cache
2026-03-30 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aecbada5-4c50-59e4-987a-8331446772b8
2026-03-30 08:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aecbada5-4c50-59e4-987a-8331446772b8, skipping ID generation
2026-03-30 08:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aecbada5-4c50-59e4-987a-8331446772b8 with scrape type 1
2026-03-30 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aecbada5-4c50-59e4-987a-8331446772b8 sending to next pipeline
2026-03-30 08:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aecbada5-4c50-59e4-987a-8331446772b8, identifier: NC38071
2026-03-30 08:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc896536b90>
2026-03-30 08:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_c4b853c7581035005834804eb2cfe24d.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_c4b853c7581035005834804eb2cfe24d.jpg saved to cache
2026-03-30 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47
2026-03-30 08:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aecbada5-4c50-59e4-987a-8331446772b8 with identifier: NC38071
2026-03-30 08:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aecbada5-4c50-59e4-987a-8331446772b8 with identifier: NC38071
2026-03-30 08:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aecbada5-4c50-59e4-987a-8331446772b8 with identifier: NC38071 to the API
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_bd8377e181515e02318f0275704d4226.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:06:44Z',
 'fuel_type': 'diesel',
 'id': 'aecbada5-4c50-59e4-987a-8331446772b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC38071',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 42166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 31,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3058588,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_bd8377e181515e02318f0275704d4226.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_fab945f8ead77185e64860b8451d8544.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_7fc0eabe685df69e55bafa4d905ffb31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_b23e5eec2653311504b6d4ea53f06e28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_04696a67c8d0bc14abe64ff5fa4a45f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_59bc8c6e73d128a995603a8e110925ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_3d239ef2867e3e1128354bbab726992d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_f34b87be26ac883467b827e86201b429.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_4cc45dd3b86488785e3c2454077f7512.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecbada5-4c50-59e4-987a-8331446772b8/aecbada5-4c50-59e4-987a-8331446772b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/81/ae81ad00e769fdf607fed6cb869c0c1a/pa/NC38071_fd350611619a1352847b423bdc9a86ee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2019}
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC38071%27 HTTP/1.1" 200 None
2026-03-30 08:01:52 [auto1.es] INFO: Saving data for NC38071: {'created_time': 1774857712.518155, 'last_price_update_time': 1774857712.518167, 'auction_closing_time': 1774969604.0}
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NC38071') HTTP/1.1" 204 0
2026-03-30 08:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_97ca4b1af01cddbccd6e79802695a635.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH31692> (referer: https://www.auto1.com/v1/car-details-view/ZH31692/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK96984/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK92895/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e057c90>
2026-03-30 08:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_f112fb5b91ddd71d5816afb3e40f9969.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_f112fb5b91ddd71d5816afb3e40f9969.jpg saved to cache
2026-03-30 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47
2026-03-30 08:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc88e04e5d0>
2026-03-30 08:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fef%252F79ef5cac47d8bddffa01d7c31d178c1e%252Fpa%252FNM85037_97ca4b1af01cddbccd6e79802695a635.jpg') HTTP/1.1" 204 0
2026-03-30 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_97ca4b1af01cddbccd6e79802695a635.jpg saved to cache
2026-03-30 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47
2026-03-30 08:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 912ea90b-f0a1-50f3-847e-4bf5fa174e47, skipping ID generation
2026-03-30 08:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47 with scrape type 1
2026-03-30 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 912ea90b-f0a1-50f3-847e-4bf5fa174e47 sending to next pipeline
2026-03-30 08:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 912ea90b-f0a1-50f3-847e-4bf5fa174e47, identifier: NM85037
2026-03-30 08:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 912ea90b-f0a1-50f3-847e-4bf5fa174e47 with identifier: NM85037
2026-03-30 08:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 912ea90b-f0a1-50f3-847e-4bf5fa174e47 with identifier: NM85037
2026-03-30 08:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 912ea90b-f0a1-50f3-847e-4bf5fa174e47 with identifier: NM85037 to the API
2026-03-30 08:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_97ca4b1af01cddbccd6e79802695a635.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:27:59Z',
 'fuel_type': 'diesel',
 'id': '912ea90b-f0a1-50f3-847e-4bf5fa174e47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM85037',
 'listing': 'auction',
 'location': 'ES, Leganés',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 85863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_d3395f36faa10fd7cb5192ec04bbafd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_265df1ac6de227f0505264f470221ecc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_44180d6fd33c78fd7e95c82473a3f691.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_30062f0fd19fb3a3c4439e52a54d5e14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_c72a00e664a346d296f2edbc034bad15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_07f0f547b63b378c14b9bd90f6d57644.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_03d6cd579d2486b55d1b9882a0f768ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_c4b853c7581035005834804eb2cfe24d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_f112fb5b91ddd71d5816afb3e40f9969.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_912ea90b-f0a1-50f3-847e-4bf5fa174e47/912ea90b-f0a1-50f3-847e-4bf5fa174e47_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ef/79ef5cac47d8bddffa01d7c31d178c1e/pa/NM85037_97ca4b1af01cddbccd6e79802695a635.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM85037%27 HTTP/1.1" 200 None
2026-03-30 08:01:53 [auto1.es] INFO: Saving data for NM85037: {'created_time': 1774857713.336634, 'last_price_update_time': 1774857713.336646, 'auction_closing_time': 1774970879.0}
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NM85037') HTTP/1.1" 204 0
2026-03-30 08:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3 with identifier: ZH31692
2026-03-30 08:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3 with scrape type 1
2026-03-30 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc6%252F26c642086482fa88ea965427b57d8fcd%252Fpa%252FZH31692_81c0b081b7b1b4a43c4ac87af8f918cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_81c0b081b7b1b4a43c4ac87af8f918cf.jpg already downloaded
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc6%252F26c642086482fa88ea965427b57d8fcd%252Fpa%252FZH31692_4bfa3b94b0674d4d4219d7caf71d2625.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_4bfa3b94b0674d4d4219d7caf71d2625.jpg already downloaded
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc6%252F26c642086482fa88ea965427b57d8fcd%252Fpa%252FZH31692_398c57b90106d9e1ddc2400e8bd7f0e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_398c57b90106d9e1ddc2400e8bd7f0e0.jpg already downloaded
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc6%252F26c642086482fa88ea965427b57d8fcd%252Fpa%252FZH31692_1ab437eb19cf9cba1f18ed9791fbb7bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_1ab437eb19cf9cba1f18ed9791fbb7bb.jpg already downloaded
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc6%252F26c642086482fa88ea965427b57d8fcd%252Fpa%252FZH31692_629b37ab247095bd350fa70dc6bdc2b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_629b37ab247095bd350fa70dc6bdc2b7.jpg already downloaded
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc6%252F26c642086482fa88ea965427b57d8fcd%252Fpa%252FZH31692_13ae7debd65f85d7b323ca7abb75df03.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_13ae7debd65f85d7b323ca7abb75df03.jpg already downloaded
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc6%252F26c642086482fa88ea965427b57d8fcd%252Fpa%252FZH31692_c56471c4abc2967e54d8e974f89ea4de.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_c56471c4abc2967e54d8e974f89ea4de.jpg already downloaded
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc6%252F26c642086482fa88ea965427b57d8fcd%252Fpa%252FZH31692_f3939c6bb506b0c7dcf35c7c37b3606b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_f3939c6bb506b0c7dcf35c7c37b3606b.jpg already downloaded
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc6%252F26c642086482fa88ea965427b57d8fcd%252Fpa%252FZH31692_5d30b29141e6621ed91940a913740867.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_5d30b29141e6621ed91940a913740867.jpg already downloaded
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc6%252F26c642086482fa88ea965427b57d8fcd%252Fpa%252FZH31692_eb65c54f562e14e0262733d4ad68fc52.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_eb65c54f562e14e0262733d4ad68fc52.jpg already downloaded
2026-03-30 08:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3, identifier: ZH31692
2026-03-30 08:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3 with identifier: ZH31692
2026-03-30 08:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3 with identifier: ZH31692
2026-03-30 08:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3 with identifier: ZH31692 to the API
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZH31692>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:48:57Z',
 'fuel_type': 'petrol',
 'id': 'bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH31692',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 19588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_81c0b081b7b1b4a43c4ac87af8f918cf.jpg',
                'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_4bfa3b94b0674d4d4219d7caf71d2625.jpg',
                'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_398c57b90106d9e1ddc2400e8bd7f0e0.jpg',
                'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_1ab437eb19cf9cba1f18ed9791fbb7bb.jpg',
                'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_629b37ab247095bd350fa70dc6bdc2b7.jpg',
                'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_13ae7debd65f85d7b323ca7abb75df03.jpg',
                'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_c56471c4abc2967e54d8e974f89ea4de.jpg',
                'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_f3939c6bb506b0c7dcf35c7c37b3606b.jpg',
                'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_5d30b29141e6621ed91940a913740867.jpg',
                'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_eb65c54f562e14e0262733d4ad68fc52.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3/bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_81c0b081b7b1b4a43c4ac87af8f918cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3/bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_4bfa3b94b0674d4d4219d7caf71d2625.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3/bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_398c57b90106d9e1ddc2400e8bd7f0e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3/bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_1ab437eb19cf9cba1f18ed9791fbb7bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3/bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_629b37ab247095bd350fa70dc6bdc2b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3/bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_13ae7debd65f85d7b323ca7abb75df03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3/bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_c56471c4abc2967e54d8e974f89ea4de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3/bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_f3939c6bb506b0c7dcf35c7c37b3606b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3/bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_5d30b29141e6621ed91940a913740867.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3/bbf56fec-db4a-5d15-8ae4-14bfc7cad3c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c6/26c642086482fa88ea965427b57d8fcd/pa/ZH31692_eb65c54f562e14e0262733d4ad68fc52.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 T-GDI Maxx 2WD',
 'transmission': 'manual',
 'trim': 'Maxx 2WD',
 'year': 2023}
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH31692%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Saving data for ZH31692: {'created_time': 1774857714.047256, 'last_price_update_time': 1774857714.047267, 'auction_closing_time': 1774972137.0}
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZH31692') HTTP/1.1" 204 0
2026-03-30 08:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU64639/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:54 [auto1.es] INFO: Channel: 24h | Page: 11 | totalHits: 2178 | hits on page: 40
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: XY66822
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY66822%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for XY66822: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: HX94185
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: BU39967
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: JR90206
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: ZV85818
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV85818%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for ZV85818: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: TU86062
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: UB19878
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: PM58195
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM58195%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for PM58195: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: AC51222
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: SH51429
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH51429%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for SH51429: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: YC02097
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: WL81576
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL81576%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for WL81576: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: GA87794
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA87794%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for GA87794: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: BK88638
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK88638%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for BK88638: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: ZG69122
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: SD38157
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD38157%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for SD38157: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: AA76120
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA76120%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for AA76120: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: TZ07439
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: KW46470
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW46470%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for KW46470: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: ZN44479
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN44479%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for ZN44479: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: NH78008
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: TD74034
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD74034%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for TD74034: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: PV00531
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: GC96055
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC96055%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for GC96055: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: ND56377
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND56377%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for ND56377: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: GZ15438
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ15438%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for GZ15438: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: LC47472
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: WA43088
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: VH20399
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH20399%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for VH20399: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: LA93651
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: VC14240
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: AT48913
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: DF05847
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF05847%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for DF05847: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: CG28095
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: LX79959
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX79959%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for LX79959: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: HP65934
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP65934%27 HTTP/1.1" 200 None
2026-03-30 08:01:54 [auto1.es] INFO: Scrape type for HP65934: 0
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: DZ57590
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: AH06396
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: AE39465
2026-03-30 08:01:54 [auto1.es] INFO: Found listing with ID: CS85139
2026-03-30 08:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK92895> (referer: https://www.auto1.com/v1/car-details-view/WK92895/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c with identifier: WK92895
2026-03-30 08:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c with scrape type 1
2026-03-30 08:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c
2026-03-30 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fa5%252F24a542ff26232aaa3bf1425ddbf6336c%252Fpa%252FWK92895_19ede79527157edb2850ee29b02c3b3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_19ede79527157edb2850ee29b02c3b3b.jpg already downloaded
2026-03-30 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fa5%252F24a542ff26232aaa3bf1425ddbf6336c%252Fpa%252FWK92895_bc9d53daca562c3c765b445ece7d85e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_bc9d53daca562c3c765b445ece7d85e9.jpg already downloaded
2026-03-30 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fa5%252F24a542ff26232aaa3bf1425ddbf6336c%252Fpa%252FWK92895_a006845a6c13616f7676a63462906345.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_a006845a6c13616f7676a63462906345.jpg already downloaded
2026-03-30 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fa5%252F24a542ff26232aaa3bf1425ddbf6336c%252Fpa%252FWK92895_4896875ef64393b71162291013d09d41.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_4896875ef64393b71162291013d09d41.jpg already downloaded
2026-03-30 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fa5%252F24a542ff26232aaa3bf1425ddbf6336c%252Fpa%252FWK92895_3b13c52fff91bd1cc63d621c38790fc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_3b13c52fff91bd1cc63d621c38790fc0.jpg already downloaded
2026-03-30 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fa5%252F24a542ff26232aaa3bf1425ddbf6336c%252Fpa%252FWK92895_d0e07988dc6ef22b6adbb6c887886c6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_d0e07988dc6ef22b6adbb6c887886c6e.jpg already downloaded
2026-03-30 08:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c, identifier: WK92895
2026-03-30 08:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c with identifier: WK92895
2026-03-30 08:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c with identifier: WK92895
2026-03-30 08:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c with identifier: WK92895 to the API
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WK92895>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:15:58Z',
 'fuel_type': 'petrol',
 'id': '67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK92895',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 104604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_19ede79527157edb2850ee29b02c3b3b.jpg',
                'https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_bc9d53daca562c3c765b445ece7d85e9.jpg',
                'https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_a006845a6c13616f7676a63462906345.jpg',
                'https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_4896875ef64393b71162291013d09d41.jpg',
                'https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_3b13c52fff91bd1cc63d621c38790fc0.jpg',
                'https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_d0e07988dc6ef22b6adbb6c887886c6e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c/67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_19ede79527157edb2850ee29b02c3b3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c/67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_bc9d53daca562c3c765b445ece7d85e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c/67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_a006845a6c13616f7676a63462906345.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c/67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_4896875ef64393b71162291013d09d41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c/67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_3b13c52fff91bd1cc63d621c38790fc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c/67e8233c-9f8b-55ce-b2b3-b7b15ee20e1c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/a5/24a542ff26232aaa3bf1425ddbf6336c/pa/WK92895_d0e07988dc6ef22b6adbb6c887886c6e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.0 VTi Tonic',
 'transmission': 'manual',
 'trim': 'Tonic',
 'year': 2015}
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK92895%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Saving data for WK92895: {'created_time': 1774857716.443681, 'last_price_update_time': 1774857716.443693, 'auction_closing_time': 1774970158.0}
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WK92895') HTTP/1.1" 204 0
2026-03-30 08:01:56 [auto1.es] INFO: Channel: 24h | Page: 12 | totalHits: 2178 | hits on page: 40
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: RK09278
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK09278%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for RK09278: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: FU02845
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU02845%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for FU02845: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: EV44292
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV44292%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for EV44292: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: RD73162
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD73162%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for RD73162: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: BE99512
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: BB81076
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: NA90839
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA90839%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for NA90839: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: WC01421
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC01421%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for WC01421: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: HU09823
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU09823%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for HU09823: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: WJ13616
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ13616%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for WJ13616: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: ET29682
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET29682%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for ET29682: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: KY66855
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY66855%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for KY66855: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: WU13655
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU13655%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for WU13655: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: XX88726
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: AL56115
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL56115%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for AL56115: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: EB91308
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB91308%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for EB91308: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: ZN38628
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: LD31555
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD31555%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for LD31555: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: VC21709
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: UB23509
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB23509%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for UB23509: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: PY68884
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY68884%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for PY68884: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: UZ31378
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: FM17704
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM17704%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for FM17704: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: EK01872
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: YK67948
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK67948%27 HTTP/1.1" 200 None
2026-03-30 08:01:56 [auto1.es] INFO: Scrape type for YK67948: 0
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: XS72165
2026-03-30 08:01:56 [auto1.es] INFO: Found listing with ID: AR38034
2026-03-30 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR38034%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [auto1.es] INFO: Scrape type for AR38034: 0
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: DE05142
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: DS85202
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS85202%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [auto1.es] INFO: Scrape type for DS85202: 0
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: CM29886
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM29886%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [auto1.es] INFO: Scrape type for CM29886: 0
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: LC59414
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC59414%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [auto1.es] INFO: Scrape type for LC59414: 0
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: ZR92434
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: XM72121
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: KH78289
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: HT97347
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT97347%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [auto1.es] INFO: Scrape type for HT97347: 0
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: NK89716
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK89716%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [auto1.es] INFO: Scrape type for NK89716: 0
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: TG59620
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG59620%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [auto1.es] INFO: Scrape type for TG59620: 0
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: XP83718
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP83718%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [auto1.es] INFO: Scrape type for XP83718: 0
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: VR19230
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR19230%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [auto1.es] INFO: Scrape type for VR19230: 0
2026-03-30 08:01:57 [auto1.es] INFO: Found listing with ID: YN09707
2026-03-30 08:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK96984> (referer: https://www.auto1.com/v1/car-details-view/NK96984/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 879c2fb0-850c-5568-b63f-348a7e381593 with identifier: NK96984
2026-03-30 08:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 879c2fb0-850c-5568-b63f-348a7e381593 with scrape type 1
2026-03-30 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 879c2fb0-850c-5568-b63f-348a7e381593
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Faf%252F50affe7c2f912acf0b2ba87fbc38b8ad%252Fpa%252FNK96984_643cfbda836d69ebaf490583f0471808.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_643cfbda836d69ebaf490583f0471808.jpg already downloaded
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Faf%252F50affe7c2f912acf0b2ba87fbc38b8ad%252Fpa%252FNK96984_7cba3e37729aabc3f8914d2217cc4188.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_7cba3e37729aabc3f8914d2217cc4188.jpg already downloaded
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Faf%252F50affe7c2f912acf0b2ba87fbc38b8ad%252Fpa%252FNK96984_4ecb3513ad7214b449cba8b4a317d57e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_4ecb3513ad7214b449cba8b4a317d57e.jpg already downloaded
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Faf%252F50affe7c2f912acf0b2ba87fbc38b8ad%252Fpa%252FNK96984_739c34d6e5b4d687ae1ed29f488fb748.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_739c34d6e5b4d687ae1ed29f488fb748.jpg already downloaded
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Faf%252F50affe7c2f912acf0b2ba87fbc38b8ad%252Fpa%252FNK96984_3614ee3ead3c589a826b94a808c5b74d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_3614ee3ead3c589a826b94a808c5b74d.jpg already downloaded
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Faf%252F50affe7c2f912acf0b2ba87fbc38b8ad%252Fpa%252FNK96984_913450c26d845f41d542be36d7f36e96.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_913450c26d845f41d542be36d7f36e96.jpg already downloaded
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Faf%252F50affe7c2f912acf0b2ba87fbc38b8ad%252Fpa%252FNK96984_746e90bb6116f4c722764586a7144d31.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_746e90bb6116f4c722764586a7144d31.jpg already downloaded
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Faf%252F50affe7c2f912acf0b2ba87fbc38b8ad%252Fpa%252FNK96984_d9a66ef54fa3f134675bcca8176ed849.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_d9a66ef54fa3f134675bcca8176ed849.jpg already downloaded
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Faf%252F50affe7c2f912acf0b2ba87fbc38b8ad%252Fpa%252FNK96984_5d529a66b5c1a124c966c0efc9a43fbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_5d529a66b5c1a124c966c0efc9a43fbb.jpg already downloaded
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Faf%252F50affe7c2f912acf0b2ba87fbc38b8ad%252Fpa%252FNK96984_e0f9a635ae5f198c9ae2fd98a25e5a3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_e0f9a635ae5f198c9ae2fd98a25e5a3e.jpg already downloaded
2026-03-30 08:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 879c2fb0-850c-5568-b63f-348a7e381593, identifier: NK96984
2026-03-30 08:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 879c2fb0-850c-5568-b63f-348a7e381593 with identifier: NK96984
2026-03-30 08:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 879c2fb0-850c-5568-b63f-348a7e381593 with identifier: NK96984
2026-03-30 08:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 879c2fb0-850c-5568-b63f-348a7e381593 with identifier: NK96984 to the API
2026-03-30 08:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NK96984>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.5L',
 'engine_horse_power': 310,
 'expiration_date': '2026-03-31T15:20:27Z',
 'fuel_type': 'petrol',
 'id': '879c2fb0-850c-5568-b63f-348a7e381593',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK96984',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Audi',
 'model': 'RS Q3',
 'odometer': 99248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_643cfbda836d69ebaf490583f0471808.jpg',
                'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_7cba3e37729aabc3f8914d2217cc4188.jpg',
                'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_4ecb3513ad7214b449cba8b4a317d57e.jpg',
                'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_739c34d6e5b4d687ae1ed29f488fb748.jpg',
                'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_3614ee3ead3c589a826b94a808c5b74d.jpg',
                'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_913450c26d845f41d542be36d7f36e96.jpg',
                'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_746e90bb6116f4c722764586a7144d31.jpg',
                'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_d9a66ef54fa3f134675bcca8176ed849.jpg',
                'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_5d529a66b5c1a124c966c0efc9a43fbb.jpg',
                'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_e0f9a635ae5f198c9ae2fd98a25e5a3e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879c2fb0-850c-5568-b63f-348a7e381593/879c2fb0-850c-5568-b63f-348a7e381593_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_643cfbda836d69ebaf490583f0471808.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879c2fb0-850c-5568-b63f-348a7e381593/879c2fb0-850c-5568-b63f-348a7e381593_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_7cba3e37729aabc3f8914d2217cc4188.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879c2fb0-850c-5568-b63f-348a7e381593/879c2fb0-850c-5568-b63f-348a7e381593_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_4ecb3513ad7214b449cba8b4a317d57e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879c2fb0-850c-5568-b63f-348a7e381593/879c2fb0-850c-5568-b63f-348a7e381593_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_739c34d6e5b4d687ae1ed29f488fb748.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879c2fb0-850c-5568-b63f-348a7e381593/879c2fb0-850c-5568-b63f-348a7e381593_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_3614ee3ead3c589a826b94a808c5b74d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879c2fb0-850c-5568-b63f-348a7e381593/879c2fb0-850c-5568-b63f-348a7e381593_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_913450c26d845f41d542be36d7f36e96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879c2fb0-850c-5568-b63f-348a7e381593/879c2fb0-850c-5568-b63f-348a7e381593_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_746e90bb6116f4c722764586a7144d31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879c2fb0-850c-5568-b63f-348a7e381593/879c2fb0-850c-5568-b63f-348a7e381593_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_d9a66ef54fa3f134675bcca8176ed849.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879c2fb0-850c-5568-b63f-348a7e381593/879c2fb0-850c-5568-b63f-348a7e381593_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_5d529a66b5c1a124c966c0efc9a43fbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_879c2fb0-850c-5568-b63f-348a7e381593/879c2fb0-850c-5568-b63f-348a7e381593_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/af/50affe7c2f912acf0b2ba87fbc38b8ad/pa/NK96984_e0f9a635ae5f198c9ae2fd98a25e5a3e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi RS Q3 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK96984%27 HTTP/1.1" 200 None
2026-03-30 08:01:58 [auto1.es] INFO: Saving data for NK96984: {'created_time': 1774857718.174968, 'last_price_update_time': 1774857718.174984, 'auction_closing_time': 1774970427.0}
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NK96984') HTTP/1.1" 204 0
2026-03-30 08:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU64639> (referer: https://www.auto1.com/v1/car-details-view/AU64639/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72d0f9bd-8441-5dab-acc1-d568a9d4362e with identifier: AU64639
2026-03-30 08:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72d0f9bd-8441-5dab-acc1-d568a9d4362e with scrape type 1
2026-03-30 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72d0f9bd-8441-5dab-acc1-d568a9d4362e
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F14%252Ffb14f14c128fa350f1ef607b3a707af2%252Fpa%252FAU64639_5bb79ba0f5dc8953e2c3aeeb9b726877.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_5bb79ba0f5dc8953e2c3aeeb9b726877.jpg already downloaded
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F14%252Ffb14f14c128fa350f1ef607b3a707af2%252Fpa%252FAU64639_3547f8c6fca4d49153efa424c417b1a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_3547f8c6fca4d49153efa424c417b1a5.jpg already downloaded
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F14%252Ffb14f14c128fa350f1ef607b3a707af2%252Fpa%252FAU64639_c7b12fdde87d523a7a706a2d3efcae94.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_c7b12fdde87d523a7a706a2d3efcae94.jpg already downloaded
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F14%252Ffb14f14c128fa350f1ef607b3a707af2%252Fpa%252FAU64639_e80fc7c1eb09198fabc228981fbfd315.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_e80fc7c1eb09198fabc228981fbfd315.jpg already downloaded
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F14%252Ffb14f14c128fa350f1ef607b3a707af2%252Fpa%252FAU64639_fd214cbf21c4269184636bcc984725ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_fd214cbf21c4269184636bcc984725ce.jpg already downloaded
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F14%252Ffb14f14c128fa350f1ef607b3a707af2%252Fpa%252FAU64639_3d444f1ecc80e116458a888b8afda539.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_3d444f1ecc80e116458a888b8afda539.jpg already downloaded
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F14%252Ffb14f14c128fa350f1ef607b3a707af2%252Fpa%252FAU64639_3c87906f9b43e2a5113635b305f274b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_3c87906f9b43e2a5113635b305f274b6.jpg already downloaded
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F14%252Ffb14f14c128fa350f1ef607b3a707af2%252Fpa%252FAU64639_d6f624e9568ff21bdab9ebb95dad3d93.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_d6f624e9568ff21bdab9ebb95dad3d93.jpg already downloaded
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F14%252Ffb14f14c128fa350f1ef607b3a707af2%252Fpa%252FAU64639_079001ff0758dec34fc2995244dbe881.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_079001ff0758dec34fc2995244dbe881.jpg already downloaded
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F14%252Ffb14f14c128fa350f1ef607b3a707af2%252Fpa%252FAU64639_97c3d2054f70e440b9220a8c5d108ea4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_97c3d2054f70e440b9220a8c5d108ea4.jpg already downloaded
2026-03-30 08:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 72d0f9bd-8441-5dab-acc1-d568a9d4362e, identifier: AU64639
2026-03-30 08:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 72d0f9bd-8441-5dab-acc1-d568a9d4362e with identifier: AU64639
2026-03-30 08:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 72d0f9bd-8441-5dab-acc1-d568a9d4362e with identifier: AU64639
2026-03-30 08:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 72d0f9bd-8441-5dab-acc1-d568a9d4362e with identifier: AU64639 to the API
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AU64639>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 141,
 'expiration_date': '2026-03-31T15:33:07Z',
 'fuel_type': 'hybrid',
 'id': '72d0f9bd-8441-5dab-acc1-d568a9d4362e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU64639',
 'listing': 'auction',
 'location': 'ES, A Cañiza Pontevedra',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 186096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_5bb79ba0f5dc8953e2c3aeeb9b726877.jpg',
                'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_3547f8c6fca4d49153efa424c417b1a5.jpg',
                'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_c7b12fdde87d523a7a706a2d3efcae94.jpg',
                'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_e80fc7c1eb09198fabc228981fbfd315.jpg',
                'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_fd214cbf21c4269184636bcc984725ce.jpg',
                'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_3d444f1ecc80e116458a888b8afda539.jpg',
                'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_3c87906f9b43e2a5113635b305f274b6.jpg',
                'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_d6f624e9568ff21bdab9ebb95dad3d93.jpg',
                'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_079001ff0758dec34fc2995244dbe881.jpg',
                'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_97c3d2054f70e440b9220a8c5d108ea4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d0f9bd-8441-5dab-acc1-d568a9d4362e/72d0f9bd-8441-5dab-acc1-d568a9d4362e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_5bb79ba0f5dc8953e2c3aeeb9b726877.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d0f9bd-8441-5dab-acc1-d568a9d4362e/72d0f9bd-8441-5dab-acc1-d568a9d4362e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_3547f8c6fca4d49153efa424c417b1a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d0f9bd-8441-5dab-acc1-d568a9d4362e/72d0f9bd-8441-5dab-acc1-d568a9d4362e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_c7b12fdde87d523a7a706a2d3efcae94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d0f9bd-8441-5dab-acc1-d568a9d4362e/72d0f9bd-8441-5dab-acc1-d568a9d4362e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_e80fc7c1eb09198fabc228981fbfd315.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d0f9bd-8441-5dab-acc1-d568a9d4362e/72d0f9bd-8441-5dab-acc1-d568a9d4362e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_fd214cbf21c4269184636bcc984725ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d0f9bd-8441-5dab-acc1-d568a9d4362e/72d0f9bd-8441-5dab-acc1-d568a9d4362e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_3d444f1ecc80e116458a888b8afda539.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d0f9bd-8441-5dab-acc1-d568a9d4362e/72d0f9bd-8441-5dab-acc1-d568a9d4362e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_3c87906f9b43e2a5113635b305f274b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d0f9bd-8441-5dab-acc1-d568a9d4362e/72d0f9bd-8441-5dab-acc1-d568a9d4362e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_d6f624e9568ff21bdab9ebb95dad3d93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d0f9bd-8441-5dab-acc1-d568a9d4362e/72d0f9bd-8441-5dab-acc1-d568a9d4362e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_079001ff0758dec34fc2995244dbe881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d0f9bd-8441-5dab-acc1-d568a9d4362e/72d0f9bd-8441-5dab-acc1-d568a9d4362e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/14/fb14f14c128fa350f1ef607b3a707af2/pa/AU64639_97c3d2054f70e440b9220a8c5d108ea4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Drive',
 'transmission': 'automatic',
 'trim': 'Drive',
 'year': 2019}
2026-03-30 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU64639%27 HTTP/1.1" 200 None
2026-03-30 08:01:59 [auto1.es] INFO: Saving data for AU64639: {'created_time': 1774857719.080696, 'last_price_update_time': 1774857719.080708, 'auction_closing_time': 1774971187.0}
2026-03-30 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AU64639') HTTP/1.1" 204 0
2026-03-30 08:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:01:59 [auto1.es] INFO: Channel: 24h | Page: 13 | totalHits: 2178 | hits on page: 40
2026-03-30 08:01:59 [auto1.es] INFO: Found listing with ID: EM25182
2026-03-30 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM25182%27 HTTP/1.1" 200 None
2026-03-30 08:01:59 [auto1.es] INFO: Scrape type for EM25182: 0
2026-03-30 08:01:59 [auto1.es] INFO: Found listing with ID: UX56252
2026-03-30 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX56252%27 HTTP/1.1" 200 None
2026-03-30 08:01:59 [auto1.es] INFO: Scrape type for UX56252: 0
2026-03-30 08:01:59 [auto1.es] INFO: Found listing with ID: NF01026
2026-03-30 08:01:59 [auto1.es] INFO: Found listing with ID: CP47935
2026-03-30 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP47935%27 HTTP/1.1" 200 None
2026-03-30 08:01:59 [auto1.es] INFO: Scrape type for CP47935: 0
2026-03-30 08:01:59 [auto1.es] INFO: Found listing with ID: AJ17622
2026-03-30 08:01:59 [auto1.es] INFO: Found listing with ID: ZW84948
2026-03-30 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW84948%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for ZW84948: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: WP34960
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP34960%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for WP34960: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: YE69993
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: ZU63673
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: UX61881
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX61881%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for UX61881: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: PK27651
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: PD89077
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: LF16630
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: XG19134
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: RZ25182
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ25182%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for RZ25182: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: PP58388
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP58388%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for PP58388: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: YF58100
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF58100%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for YF58100: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: EY27652
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY27652%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for EY27652: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: LV66931
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV66931%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for LV66931: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: GN42445
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: SE46424
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE46424%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for SE46424: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: TY04306
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: ZP90682
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: RA15604
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: WA04361
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: MP20353
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: WZ80502
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ80502%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for WZ80502: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: DT92878
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: GU07092
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: EN30281
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN30281%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for EN30281: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: LD85215
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: DF95857
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: AR99640
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR99640%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for AR99640: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: FW12550
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW12550%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for FW12550: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: YC26234
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: WU95928
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU95928%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for WU95928: 0
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: EZ00387
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: PA70803
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: ZL27489
2026-03-30 08:02:00 [auto1.es] INFO: Found listing with ID: CL01909
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL01909%27 HTTP/1.1" 200 None
2026-03-30 08:02:00 [auto1.es] INFO: Scrape type for CL01909: 0
2026-03-30 08:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:01 [auto1.es] INFO: Channel: 24h | Page: 14 | totalHits: 2178 | hits on page: 40
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: RM87129
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM87129%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for RM87129: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: JF80642
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: AN61719
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN61719%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for AN61719: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: RW86694
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW86694%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for RW86694: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: YH76219
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH76219%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for YH76219: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: ET49532
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET49532%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for ET49532: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: PH24007
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: BA72384
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA72384%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for BA72384: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: XL49074
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL49074%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for XL49074: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: NV97141
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: RC69280
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC69280%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for RC69280: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: JP06939
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: KC55308
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: RU72076
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: HS23075
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: LS24467
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS24467%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for LS24467: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: SL05666
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL05666%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for SL05666: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: UJ75834
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ75834%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for UJ75834: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: NL18277
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL18277%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for NL18277: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: WC31685
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC31685%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for WC31685: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: YJ31594
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: AL95022
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL95022%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for AL95022: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: YH50380
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH50380%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for YH50380: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: DR80408
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR80408%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for DR80408: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: KN20480
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN20480%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for KN20480: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: AZ32576
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ32576%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for AZ32576: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: EL87448
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL87448%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for EL87448: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: RM32032
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: NW70780
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW70780%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for NW70780: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: AE38479
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: RX75701
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX75701%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for RX75701: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: AM40954
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM40954%27 HTTP/1.1" 200 None
2026-03-30 08:02:01 [auto1.es] INFO: Scrape type for AM40954: 0
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: NY63856
2026-03-30 08:02:01 [auto1.es] INFO: Found listing with ID: FE95499
2026-03-30 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE95499%27 HTTP/1.1" 200 None
2026-03-30 08:02:02 [auto1.es] INFO: Scrape type for FE95499: 0
2026-03-30 08:02:02 [auto1.es] INFO: Found listing with ID: NZ75467
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ75467%27 HTTP/1.1" 200 None
2026-03-30 08:02:02 [auto1.es] INFO: Scrape type for NZ75467: 0
2026-03-30 08:02:02 [auto1.es] INFO: Found listing with ID: UA78056
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA78056%27 HTTP/1.1" 200 None
2026-03-30 08:02:02 [auto1.es] INFO: Scrape type for UA78056: 0
2026-03-30 08:02:02 [auto1.es] INFO: Found listing with ID: AS89718
2026-03-30 08:02:02 [auto1.es] INFO: Found listing with ID: ZJ91904
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ91904%27 HTTP/1.1" 200 None
2026-03-30 08:02:02 [auto1.es] INFO: Scrape type for ZJ91904: 0
2026-03-30 08:02:02 [auto1.es] INFO: Found listing with ID: NX10542
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX10542%27 HTTP/1.1" 200 None
2026-03-30 08:02:02 [auto1.es] INFO: Scrape type for NX10542: 2
2026-03-30 08:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af3aeffe-baf6-5276-8c6d-74de8c48019d with identifier: NX10542
2026-03-30 08:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af3aeffe-baf6-5276-8c6d-74de8c48019d with scrape type 2
2026-03-30 08:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af3aeffe-baf6-5276-8c6d-74de8c48019d with scrape type 2
2026-03-30 08:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af3aeffe-baf6-5276-8c6d-74de8c48019d, identifier: NX10542
2026-03-30 08:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af3aeffe-baf6-5276-8c6d-74de8c48019d with identifier: NX10542
2026-03-30 08:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af3aeffe-baf6-5276-8c6d-74de8c48019d with identifier: NX10542
2026-03-30 08:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af3aeffe-baf6-5276-8c6d-74de8c48019d with identifier: NX10542 to the API
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:03:04Z',
 'fuel_type': 'diesel',
 'id': 'af3aeffe-baf6-5276-8c6d-74de8c48019d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX10542',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 205578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-25',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 300 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2010}
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX10542%27 HTTP/1.1" 200 None
2026-03-30 08:02:02 [auto1.es] INFO: Saving data for NX10542: {'auction_closing_time': 1774882984.0, 'created_time': 1774771233.840503, 'last_price_update_time': 1774857722.623796}
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NX10542') HTTP/1.1" 204 0
2026-03-30 08:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:02 [auto1.es] INFO: Found listing with ID: LP19075
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP19075%27 HTTP/1.1" 200 None
2026-03-30 08:02:02 [auto1.es] INFO: Scrape type for LP19075: 2
2026-03-30 08:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b18b18a7-eeb0-5892-b9f1-047683666ac1 with identifier: LP19075
2026-03-30 08:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b18b18a7-eeb0-5892-b9f1-047683666ac1 with scrape type 2
2026-03-30 08:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b18b18a7-eeb0-5892-b9f1-047683666ac1 with scrape type 2
2026-03-30 08:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b18b18a7-eeb0-5892-b9f1-047683666ac1, identifier: LP19075
2026-03-30 08:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b18b18a7-eeb0-5892-b9f1-047683666ac1 with identifier: LP19075
2026-03-30 08:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b18b18a7-eeb0-5892-b9f1-047683666ac1 with identifier: LP19075
2026-03-30 08:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b18b18a7-eeb0-5892-b9f1-047683666ac1 with identifier: LP19075 to the API
2026-03-30 08:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:52:55Z',
 'fuel_type': 'petrol',
 'id': 'b18b18a7-eeb0-5892-b9f1-047683666ac1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP19075',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-24',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Futura',
 'transmission': 'manual',
 'trim': 'Futura',
 'year': 2008}
2026-03-30 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP19075%27 HTTP/1.1" 200 None
2026-03-30 08:02:03 [auto1.es] INFO: Saving data for LP19075: {'auction_closing_time': 1774885975.0, 'created_time': 1773432204.05141, 'last_price_update_time': 1774857723.145792}
2026-03-30 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LP19075') HTTP/1.1" 204 0
2026-03-30 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:04 [auto1.es] INFO: Channel: 24h | Page: 15 | totalHits: 2178 | hits on page: 40
2026-03-30 08:02:04 [auto1.es] INFO: Found listing with ID: UJ63738
2026-03-30 08:02:04 [auto1.es] INFO: Found listing with ID: MR44374
2026-03-30 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR44374%27 HTTP/1.1" 200 None
2026-03-30 08:02:04 [auto1.es] INFO: Scrape type for MR44374: 2
2026-03-30 08:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 832b8e62-6f39-52e2-940c-4eebc4c73fb1 with identifier: MR44374
2026-03-30 08:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 832b8e62-6f39-52e2-940c-4eebc4c73fb1 with scrape type 2
2026-03-30 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 832b8e62-6f39-52e2-940c-4eebc4c73fb1 with scrape type 2
2026-03-30 08:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 832b8e62-6f39-52e2-940c-4eebc4c73fb1, identifier: MR44374
2026-03-30 08:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 832b8e62-6f39-52e2-940c-4eebc4c73fb1 with identifier: MR44374
2026-03-30 08:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 832b8e62-6f39-52e2-940c-4eebc4c73fb1 with identifier: MR44374
2026-03-30 08:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 832b8e62-6f39-52e2-940c-4eebc4c73fb1 with identifier: MR44374 to the API
2026-03-30 08:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:59:41Z',
 'fuel_type': 'diesel',
 'id': '832b8e62-6f39-52e2-940c-4eebc4c73fb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR44374',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 97397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-23',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Klass 2WD',
 'transmission': 'manual',
 'trim': 'Klass 2WD',
 'year': 2019}
2026-03-30 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR44374%27 HTTP/1.1" 200 None
2026-03-30 08:02:04 [auto1.es] INFO: Saving data for MR44374: {'auction_closing_time': 1774886381.0, 'created_time': 1774771230.556291, 'last_price_update_time': 1774857724.635067}
2026-03-30 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MR44374') HTTP/1.1" 204 0
2026-03-30 08:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:04 [auto1.es] INFO: Found listing with ID: TF01145
2026-03-30 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF01145%27 HTTP/1.1" 200 None
2026-03-30 08:02:04 [auto1.es] INFO: Scrape type for TF01145: 2
2026-03-30 08:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30794862-d765-591c-a1fc-099388b16b0f with identifier: TF01145
2026-03-30 08:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30794862-d765-591c-a1fc-099388b16b0f with scrape type 2
2026-03-30 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30794862-d765-591c-a1fc-099388b16b0f with scrape type 2
2026-03-30 08:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 30794862-d765-591c-a1fc-099388b16b0f, identifier: TF01145
2026-03-30 08:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 30794862-d765-591c-a1fc-099388b16b0f with identifier: TF01145
2026-03-30 08:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 30794862-d765-591c-a1fc-099388b16b0f with identifier: TF01145
2026-03-30 08:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 30794862-d765-591c-a1fc-099388b16b0f with identifier: TF01145 to the API
2026-03-30 08:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:41:29Z',
 'fuel_type': 'diesel',
 'id': '30794862-d765-591c-a1fc-099388b16b0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF01145',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 87988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-16',
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2020}
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF01145%27 HTTP/1.1" 200 None
2026-03-30 08:02:05 [auto1.es] INFO: Saving data for TF01145: {'auction_closing_time': 1774885289.0, 'created_time': 1773950734.131005, 'last_price_update_time': 1774857725.051832}
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TF01145') HTTP/1.1" 204 0
2026-03-30 08:02:05 [auto1.es] INFO: Found listing with ID: FD92504
2026-03-30 08:02:05 [auto1.es] INFO: Found listing with ID: VK23822
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK23822%27 HTTP/1.1" 200 None
2026-03-30 08:02:05 [auto1.es] INFO: Scrape type for VK23822: 2
2026-03-30 08:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850 with identifier: VK23822
2026-03-30 08:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850 with scrape type 2
2026-03-30 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850 with scrape type 2
2026-03-30 08:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850, identifier: VK23822
2026-03-30 08:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850 with identifier: VK23822
2026-03-30 08:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850 with identifier: VK23822
2026-03-30 08:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850 with identifier: VK23822 to the API
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:16:19Z',
 'fuel_type': 'petrol',
 'id': 'be2b8246-7e9c-52f8-ac7e-3c0c2a5b4850',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK23822',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 181615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1994-04-28',
 'seller_name': None,
 'title': 'Nissan Micra 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 1994}
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK23822%27 HTTP/1.1" 200 None
2026-03-30 08:02:05 [auto1.es] INFO: Saving data for VK23822: {'auction_closing_time': 1774883779.0, 'created_time': 1772645520.594872, 'last_price_update_time': 1774857725.449357}
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VK23822') HTTP/1.1" 204 0
2026-03-30 08:02:05 [auto1.es] INFO: Found listing with ID: TW05387
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW05387%27 HTTP/1.1" 200 None
2026-03-30 08:02:05 [auto1.es] INFO: Scrape type for TW05387: 2
2026-03-30 08:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85da7219-4996-541d-bbd9-727edaa19e2b with identifier: TW05387
2026-03-30 08:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85da7219-4996-541d-bbd9-727edaa19e2b with scrape type 2
2026-03-30 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85da7219-4996-541d-bbd9-727edaa19e2b with scrape type 2
2026-03-30 08:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 85da7219-4996-541d-bbd9-727edaa19e2b, identifier: TW05387
2026-03-30 08:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 85da7219-4996-541d-bbd9-727edaa19e2b with identifier: TW05387
2026-03-30 08:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 85da7219-4996-541d-bbd9-727edaa19e2b with identifier: TW05387
2026-03-30 08:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 85da7219-4996-541d-bbd9-727edaa19e2b with identifier: TW05387 to the API
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:47:20Z',
 'fuel_type': 'petrol',
 'id': '85da7219-4996-541d-bbd9-727edaa19e2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW05387',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 85956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-12-31',
 'seller_name': None,
 'title': 'Peugeot 206 1.6 XT',
 'transmission': 'manual',
 'trim': 'XT',
 'year': 1999}
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW05387%27 HTTP/1.1" 200 None
2026-03-30 08:02:05 [auto1.es] INFO: Saving data for TW05387: {'auction_closing_time': 1774885640.0, 'created_time': 1773132563.530289, 'last_price_update_time': 1774857725.9025}
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TW05387') HTTP/1.1" 204 0
2026-03-30 08:02:05 [auto1.es] INFO: Found listing with ID: KY97566
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY97566%27 HTTP/1.1" 200 None
2026-03-30 08:02:05 [auto1.es] INFO: Scrape type for KY97566: 2
2026-03-30 08:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 with identifier: KY97566
2026-03-30 08:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 with scrape type 2
2026-03-30 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 with scrape type 2
2026-03-30 08:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 837b8bf0-e6a0-55c5-bf3b-778dc78cd503, identifier: KY97566
2026-03-30 08:02:06 [scrapy.extensions.logstats] INFO: Crawled 59 pages (at 34 pages/min), scraped 148 items (at 82 items/min)
2026-03-30 08:02:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 08:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 with identifier: KY97566
2026-03-30 08:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 with identifier: KY97566
2026-03-30 08:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 with identifier: KY97566 to the API
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:05Z',
 'fuel_type': 'diesel',
 'id': '837b8bf0-e6a0-55c5-bf3b-778dc78cd503',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY97566',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 159402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-23',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Xcellence Travel Edition',
 'transmission': 'automatic',
 'trim': 'Xcellence Travel Edition',
 'year': 2019}
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY97566%27 HTTP/1.1" 200 None
2026-03-30 08:02:06 [auto1.es] INFO: Saving data for KY97566: {'auction_closing_time': 1774885025.0, 'created_time': 1774771236.550395, 'last_price_update_time': 1774857726.340769}
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KY97566') HTTP/1.1" 204 0
2026-03-30 08:02:06 [auto1.es] INFO: Found listing with ID: SW56668
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW56668%27 HTTP/1.1" 200 None
2026-03-30 08:02:06 [auto1.es] INFO: Scrape type for SW56668: 2
2026-03-30 08:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d423d3aa-89cc-5ab3-b884-a2c71de5086d with identifier: SW56668
2026-03-30 08:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d423d3aa-89cc-5ab3-b884-a2c71de5086d with scrape type 2
2026-03-30 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d423d3aa-89cc-5ab3-b884-a2c71de5086d with scrape type 2
2026-03-30 08:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d423d3aa-89cc-5ab3-b884-a2c71de5086d, identifier: SW56668
2026-03-30 08:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d423d3aa-89cc-5ab3-b884-a2c71de5086d with identifier: SW56668
2026-03-30 08:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d423d3aa-89cc-5ab3-b884-a2c71de5086d with identifier: SW56668
2026-03-30 08:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d423d3aa-89cc-5ab3-b884-a2c71de5086d with identifier: SW56668 to the API
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:58Z',
 'fuel_type': 'diesel',
 'id': 'd423d3aa-89cc-5ab3-b884-a2c71de5086d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW56668',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 35505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-31',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW56668%27 HTTP/1.1" 200 None
2026-03-30 08:02:06 [auto1.es] INFO: Saving data for SW56668: {'auction_closing_time': 1774883278.0, 'created_time': 1774771235.597995, 'last_price_update_time': 1774857726.757289}
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SW56668') HTTP/1.1" 204 0
2026-03-30 08:02:06 [auto1.es] INFO: Found listing with ID: SA01398
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA01398%27 HTTP/1.1" 200 None
2026-03-30 08:02:06 [auto1.es] INFO: Scrape type for SA01398: 2
2026-03-30 08:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 519f062f-7f34-58b9-8964-02cfe26a09a3 with identifier: SA01398
2026-03-30 08:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 519f062f-7f34-58b9-8964-02cfe26a09a3 with scrape type 2
2026-03-30 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 519f062f-7f34-58b9-8964-02cfe26a09a3 with scrape type 2
2026-03-30 08:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 519f062f-7f34-58b9-8964-02cfe26a09a3, identifier: SA01398
2026-03-30 08:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 519f062f-7f34-58b9-8964-02cfe26a09a3 with identifier: SA01398
2026-03-30 08:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 519f062f-7f34-58b9-8964-02cfe26a09a3 with identifier: SA01398
2026-03-30 08:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 519f062f-7f34-58b9-8964-02cfe26a09a3 with identifier: SA01398 to the API
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:37:46Z',
 'fuel_type': 'diesel',
 'id': '519f062f-7f34-58b9-8964-02cfe26a09a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA01398',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 104506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-25',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 CRDi X-Tech 17",
 'transmission': 'manual',
 'trim': 'X-Tech 17',
 'year': 2017}
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA01398%27 HTTP/1.1" 200 None
2026-03-30 08:02:07 [auto1.es] INFO: Saving data for SA01398: {'auction_closing_time': 1774885066.0, 'created_time': 1774771235.958813, 'last_price_update_time': 1774857727.244101}
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SA01398') HTTP/1.1" 204 0
2026-03-30 08:02:07 [auto1.es] INFO: Found listing with ID: WE89333
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE89333%27 HTTP/1.1" 200 None
2026-03-30 08:02:07 [auto1.es] INFO: Scrape type for WE89333: 2
2026-03-30 08:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a7efbee-12aa-5a77-891d-5750d149b128 with identifier: WE89333
2026-03-30 08:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a7efbee-12aa-5a77-891d-5750d149b128 with scrape type 2
2026-03-30 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a7efbee-12aa-5a77-891d-5750d149b128 with scrape type 2
2026-03-30 08:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1a7efbee-12aa-5a77-891d-5750d149b128, identifier: WE89333
2026-03-30 08:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1a7efbee-12aa-5a77-891d-5750d149b128 with identifier: WE89333
2026-03-30 08:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1a7efbee-12aa-5a77-891d-5750d149b128 with identifier: WE89333
2026-03-30 08:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1a7efbee-12aa-5a77-891d-5750d149b128 with identifier: WE89333 to the API
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:02:27Z',
 'fuel_type': 'diesel',
 'id': '1a7efbee-12aa-5a77-891d-5750d149b128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE89333',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 116494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-26',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE89333%27 HTTP/1.1" 200 None
2026-03-30 08:02:07 [auto1.es] INFO: Saving data for WE89333: {'auction_closing_time': 1774882947.0, 'created_time': 1774771229.402075, 'last_price_update_time': 1774857727.669184}
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WE89333') HTTP/1.1" 204 0
2026-03-30 08:02:07 [auto1.es] INFO: Found listing with ID: VG19877
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG19877%27 HTTP/1.1" 200 None
2026-03-30 08:02:07 [auto1.es] INFO: Scrape type for VG19877: 2
2026-03-30 08:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b2d4363-8a0d-5353-b71e-498bf8f02d7a with identifier: VG19877
2026-03-30 08:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b2d4363-8a0d-5353-b71e-498bf8f02d7a with scrape type 2
2026-03-30 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b2d4363-8a0d-5353-b71e-498bf8f02d7a with scrape type 2
2026-03-30 08:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b2d4363-8a0d-5353-b71e-498bf8f02d7a, identifier: VG19877
2026-03-30 08:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b2d4363-8a0d-5353-b71e-498bf8f02d7a with identifier: VG19877
2026-03-30 08:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b2d4363-8a0d-5353-b71e-498bf8f02d7a with identifier: VG19877
2026-03-30 08:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b2d4363-8a0d-5353-b71e-498bf8f02d7a with identifier: VG19877 to the API
2026-03-30 08:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:44:31Z',
 'fuel_type': 'diesel',
 'id': '4b2d4363-8a0d-5353-b71e-498bf8f02d7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG19877',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 110554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-10',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG19877%27 HTTP/1.1" 200 None
2026-03-30 08:02:08 [auto1.es] INFO: Saving data for VG19877: {'auction_closing_time': 1774885471.0, 'created_time': 1774771237.749677, 'last_price_update_time': 1774857728.165576}
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VG19877') HTTP/1.1" 204 0
2026-03-30 08:02:08 [auto1.es] INFO: Found listing with ID: HD33844
2026-03-30 08:02:08 [auto1.es] INFO: Found listing with ID: SS93372
2026-03-30 08:02:08 [auto1.es] INFO: Found listing with ID: UX63556
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX63556%27 HTTP/1.1" 200 None
2026-03-30 08:02:08 [auto1.es] INFO: Scrape type for UX63556: 2
2026-03-30 08:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05bdcd9c-c8da-5786-b811-9fe4093dbf13 with identifier: UX63556
2026-03-30 08:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05bdcd9c-c8da-5786-b811-9fe4093dbf13 with scrape type 2
2026-03-30 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05bdcd9c-c8da-5786-b811-9fe4093dbf13 with scrape type 2
2026-03-30 08:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 05bdcd9c-c8da-5786-b811-9fe4093dbf13, identifier: UX63556
2026-03-30 08:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 05bdcd9c-c8da-5786-b811-9fe4093dbf13 with identifier: UX63556
2026-03-30 08:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 05bdcd9c-c8da-5786-b811-9fe4093dbf13 with identifier: UX63556
2026-03-30 08:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 05bdcd9c-c8da-5786-b811-9fe4093dbf13 with identifier: UX63556 to the API
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:00:26Z',
 'fuel_type': 'hybrid',
 'id': '05bdcd9c-c8da-5786-b811-9fe4093dbf13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX63556',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 72919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
 'transmission': 'automatic',
 'trim': '4 300 GT',
 'year': 2022}
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX63556%27 HTTP/1.1" 200 None
2026-03-30 08:02:08 [auto1.es] INFO: Saving data for UX63556: {'auction_closing_time': 1774882826.0, 'created_time': 1774771250.348139, 'last_price_update_time': 1774857728.845568}
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UX63556') HTTP/1.1" 204 0
2026-03-30 08:02:08 [auto1.es] INFO: Found listing with ID: FV55100
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV55100%27 HTTP/1.1" 200 None
2026-03-30 08:02:08 [auto1.es] INFO: Scrape type for FV55100: 2
2026-03-30 08:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6611a149-560d-528c-bece-8f9970127f71 with identifier: FV55100
2026-03-30 08:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6611a149-560d-528c-bece-8f9970127f71 with scrape type 2
2026-03-30 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6611a149-560d-528c-bece-8f9970127f71 with scrape type 2
2026-03-30 08:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6611a149-560d-528c-bece-8f9970127f71, identifier: FV55100
2026-03-30 08:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6611a149-560d-528c-bece-8f9970127f71 with identifier: FV55100
2026-03-30 08:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6611a149-560d-528c-bece-8f9970127f71 with identifier: FV55100
2026-03-30 08:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6611a149-560d-528c-bece-8f9970127f71 with identifier: FV55100 to the API
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:59Z',
 'fuel_type': 'diesel',
 'id': '6611a149-560d-528c-bece-8f9970127f71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV55100',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 133004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-31',
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2018}
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV55100%27 HTTP/1.1" 200 None
2026-03-30 08:02:09 [auto1.es] INFO: Saving data for FV55100: {'auction_closing_time': 1774885799.0, 'created_time': 1773900264.169114, 'last_price_update_time': 1774857729.413874}
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FV55100') HTTP/1.1" 204 0
2026-03-30 08:02:09 [auto1.es] INFO: Found listing with ID: HN69450
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN69450%27 HTTP/1.1" 200 None
2026-03-30 08:02:09 [auto1.es] INFO: Scrape type for HN69450: 2
2026-03-30 08:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2e0ba9-fde3-567f-bb05-23909da62a3f with identifier: HN69450
2026-03-30 08:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2e0ba9-fde3-567f-bb05-23909da62a3f with scrape type 2
2026-03-30 08:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2e0ba9-fde3-567f-bb05-23909da62a3f with scrape type 2
2026-03-30 08:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3d2e0ba9-fde3-567f-bb05-23909da62a3f, identifier: HN69450
2026-03-30 08:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ63101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3d2e0ba9-fde3-567f-bb05-23909da62a3f with identifier: HN69450
2026-03-30 08:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3d2e0ba9-fde3-567f-bb05-23909da62a3f with identifier: HN69450
2026-03-30 08:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3d2e0ba9-fde3-567f-bb05-23909da62a3f with identifier: HN69450 to the API
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:23:21Z',
 'fuel_type': 'diesel',
 'id': '3d2e0ba9-fde3-567f-bb05-23909da62a3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN69450',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 91096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Fiat Talento 1.6 TwinTurbo Diesel Ecojet L2H1 1,2t Basis',
 'transmission': 'manual',
 'trim': 'L2H1 1,2t Basis',
 'year': 2017}
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN69450%27 HTTP/1.1" 200 None
2026-03-30 08:02:09 [auto1.es] INFO: Saving data for HN69450: {'auction_closing_time': 1774884201.0, 'created_time': 1774771240.140386, 'last_price_update_time': 1774857729.823153}
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HN69450') HTTP/1.1" 204 0
2026-03-30 08:02:09 [auto1.es] INFO: Found listing with ID: VZ14573
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ14573%27 HTTP/1.1" 200 None
2026-03-30 08:02:09 [auto1.es] INFO: Scrape type for VZ14573: 2
2026-03-30 08:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 882ee77a-aae0-5757-a78c-ce657def6374 with identifier: VZ14573
2026-03-30 08:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 882ee77a-aae0-5757-a78c-ce657def6374 with scrape type 2
2026-03-30 08:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 882ee77a-aae0-5757-a78c-ce657def6374 with scrape type 2
2026-03-30 08:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 882ee77a-aae0-5757-a78c-ce657def6374, identifier: VZ14573
2026-03-30 08:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 882ee77a-aae0-5757-a78c-ce657def6374 with identifier: VZ14573
2026-03-30 08:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 882ee77a-aae0-5757-a78c-ce657def6374 with identifier: VZ14573
2026-03-30 08:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 882ee77a-aae0-5757-a78c-ce657def6374 with identifier: VZ14573 to the API
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:12:04Z',
 'fuel_type': 'petrol',
 'id': '882ee77a-aae0-5757-a78c-ce657def6374',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ14573',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 150017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-08-27',
 'seller_name': None,
 'title': 'BMW 3er 318ti',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ14573%27 HTTP/1.1" 200 None
2026-03-30 08:02:10 [auto1.es] INFO: Saving data for VZ14573: {'auction_closing_time': 1774883524.0, 'created_time': 1774641839.144494, 'last_price_update_time': 1774857730.245577}
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VZ14573') HTTP/1.1" 204 0
2026-03-30 08:02:10 [auto1.es] INFO: Found listing with ID: WD91964
2026-03-30 08:02:10 [auto1.es] INFO: Found listing with ID: DZ68037
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ68037%27 HTTP/1.1" 200 None
2026-03-30 08:02:10 [auto1.es] INFO: Scrape type for DZ68037: 2
2026-03-30 08:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75a69935-ce36-5cfe-a2fb-838eb5b63233 with identifier: DZ68037
2026-03-30 08:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75a69935-ce36-5cfe-a2fb-838eb5b63233 with scrape type 2
2026-03-30 08:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75a69935-ce36-5cfe-a2fb-838eb5b63233 with scrape type 2
2026-03-30 08:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75a69935-ce36-5cfe-a2fb-838eb5b63233, identifier: DZ68037
2026-03-30 08:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75a69935-ce36-5cfe-a2fb-838eb5b63233 with identifier: DZ68037
2026-03-30 08:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75a69935-ce36-5cfe-a2fb-838eb5b63233 with identifier: DZ68037
2026-03-30 08:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 75a69935-ce36-5cfe-a2fb-838eb5b63233 with identifier: DZ68037 to the API
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-30T15:47:58Z',
 'fuel_type': 'petrol',
 'id': '75a69935-ce36-5cfe-a2fb-838eb5b63233',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ68037',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 26467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-05',
 'seller_name': None,
 'title': 'Nissan Juke 1.0 DIG-T N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2024}
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ68037%27 HTTP/1.1" 200 None
2026-03-30 08:02:10 [auto1.es] INFO: Saving data for DZ68037: {'auction_closing_time': 1774885678.0, 'created_time': 1773900380.228238, 'last_price_update_time': 1774857730.665948}
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DZ68037') HTTP/1.1" 204 0
2026-03-30 08:02:10 [auto1.es] INFO: Found listing with ID: HU91100
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU91100%27 HTTP/1.1" 200 None
2026-03-30 08:02:10 [auto1.es] INFO: Scrape type for HU91100: 2
2026-03-30 08:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c145c97-5ab8-587d-9cba-d09f2d78334b with identifier: HU91100
2026-03-30 08:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c145c97-5ab8-587d-9cba-d09f2d78334b with scrape type 2
2026-03-30 08:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c145c97-5ab8-587d-9cba-d09f2d78334b with scrape type 2
2026-03-30 08:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c145c97-5ab8-587d-9cba-d09f2d78334b, identifier: HU91100
2026-03-30 08:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c145c97-5ab8-587d-9cba-d09f2d78334b with identifier: HU91100
2026-03-30 08:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c145c97-5ab8-587d-9cba-d09f2d78334b with identifier: HU91100
2026-03-30 08:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3c145c97-5ab8-587d-9cba-d09f2d78334b with identifier: HU91100 to the API
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:57:49Z',
 'fuel_type': 'petrol',
 'id': '3c145c97-5ab8-587d-9cba-d09f2d78334b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU91100',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 193411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-28',
 'seller_name': None,
 'title': 'Opel Insignia 2.8 V6 Turbo OPC 4x4',
 'transmission': 'manual',
 'trim': 'OPC 4x4',
 'year': 2011}
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU91100%27 HTTP/1.1" 200 None
2026-03-30 08:02:11 [auto1.es] INFO: Saving data for HU91100: {'auction_closing_time': 1774886269.0, 'created_time': 1773950535.739235, 'last_price_update_time': 1774857731.105363}
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HU91100') HTTP/1.1" 204 0
2026-03-30 08:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:11 [auto1.es] INFO: Found listing with ID: GK24659
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK24659%27 HTTP/1.1" 200 None
2026-03-30 08:02:11 [auto1.es] INFO: Scrape type for GK24659: 2
2026-03-30 08:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e8baee5-db76-5d05-b874-5407a2a46a2f with identifier: GK24659
2026-03-30 08:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e8baee5-db76-5d05-b874-5407a2a46a2f with scrape type 2
2026-03-30 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e8baee5-db76-5d05-b874-5407a2a46a2f with scrape type 2
2026-03-30 08:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5e8baee5-db76-5d05-b874-5407a2a46a2f, identifier: GK24659
2026-03-30 08:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5e8baee5-db76-5d05-b874-5407a2a46a2f with identifier: GK24659
2026-03-30 08:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5e8baee5-db76-5d05-b874-5407a2a46a2f with identifier: GK24659
2026-03-30 08:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5e8baee5-db76-5d05-b874-5407a2a46a2f with identifier: GK24659 to the API
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:44:03Z',
 'fuel_type': 'diesel',
 'id': '5e8baee5-db76-5d05-b874-5407a2a46a2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK24659',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Rexton',
 'odometer': 111508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-01',
 'seller_name': None,
 'title': 'Ssangyong Rexton 2.2 TD Premium 2WD',
 'transmission': 'manual',
 'trim': 'Premium 2WD',
 'year': 2016}
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK24659%27 HTTP/1.1" 200 None
2026-03-30 08:02:11 [auto1.es] INFO: Saving data for GK24659: {'auction_closing_time': 1774885443.0, 'created_time': 1774771251.146385, 'last_price_update_time': 1774857731.547489}
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GK24659') HTTP/1.1" 204 0
2026-03-30 08:02:11 [auto1.es] INFO: Found listing with ID: RV68054
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV68054%27 HTTP/1.1" 200 None
2026-03-30 08:02:11 [auto1.es] INFO: Scrape type for RV68054: 2
2026-03-30 08:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67bb1ebc-fb79-5310-bdb4-8bf97614f1f7 with identifier: RV68054
2026-03-30 08:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67bb1ebc-fb79-5310-bdb4-8bf97614f1f7 with scrape type 2
2026-03-30 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67bb1ebc-fb79-5310-bdb4-8bf97614f1f7 with scrape type 2
2026-03-30 08:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 67bb1ebc-fb79-5310-bdb4-8bf97614f1f7, identifier: RV68054
2026-03-30 08:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 67bb1ebc-fb79-5310-bdb4-8bf97614f1f7 with identifier: RV68054
2026-03-30 08:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 67bb1ebc-fb79-5310-bdb4-8bf97614f1f7 with identifier: RV68054
2026-03-30 08:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 67bb1ebc-fb79-5310-bdb4-8bf97614f1f7 with identifier: RV68054 to the API
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:51:14Z',
 'fuel_type': 'diesel',
 'id': '67bb1ebc-fb79-5310-bdb4-8bf97614f1f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV68054',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Rodius',
 'odometer': 124972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Ssangyong Rodius 2.2 TD XDi Premium',
 'transmission': 'manual',
 'trim': 'XDi Premium',
 'year': 2018}
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV68054%27 HTTP/1.1" 200 None
2026-03-30 08:02:12 [auto1.es] INFO: Saving data for RV68054: {'auction_closing_time': 1774885874.0, 'created_time': 1773950724.169823, 'last_price_update_time': 1774857732.099497}
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RV68054') HTTP/1.1" 204 0
2026-03-30 08:02:12 [auto1.es] INFO: Found listing with ID: EZ62755
2026-03-30 08:02:12 [auto1.es] INFO: Found listing with ID: PS51318
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS51318%27 HTTP/1.1" 200 None
2026-03-30 08:02:12 [auto1.es] INFO: Scrape type for PS51318: 2
2026-03-30 08:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e456769-c439-5c56-89a0-06f5b5e6a534 with identifier: PS51318
2026-03-30 08:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e456769-c439-5c56-89a0-06f5b5e6a534 with scrape type 2
2026-03-30 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e456769-c439-5c56-89a0-06f5b5e6a534 with scrape type 2
2026-03-30 08:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e456769-c439-5c56-89a0-06f5b5e6a534, identifier: PS51318
2026-03-30 08:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e456769-c439-5c56-89a0-06f5b5e6a534 with identifier: PS51318
2026-03-30 08:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e456769-c439-5c56-89a0-06f5b5e6a534 with identifier: PS51318
2026-03-30 08:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8e456769-c439-5c56-89a0-06f5b5e6a534 with identifier: PS51318 to the API
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 209,
 'expiration_date': '2026-03-30T15:38:30Z',
 'fuel_type': 'diesel',
 'id': '8e456769-c439-5c56-89a0-06f5b5e6a534',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS51318',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 85928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-31',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Veloce Q4',
 'transmission': 'automatic',
 'trim': 'Veloce Q4',
 'year': 2022}
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS51318%27 HTTP/1.1" 200 None
2026-03-30 08:02:12 [auto1.es] INFO: Saving data for PS51318: {'auction_closing_time': 1774885110.0, 'created_time': 1774771241.697508, 'last_price_update_time': 1774857732.511984}
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PS51318') HTTP/1.1" 204 0
2026-03-30 08:02:12 [auto1.es] INFO: Found listing with ID: RA40828
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA40828%27 HTTP/1.1" 200 None
2026-03-30 08:02:12 [auto1.es] INFO: Scrape type for RA40828: 2
2026-03-30 08:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24d655cf-2125-59a7-b6e1-6e7bdfaaa59c with identifier: RA40828
2026-03-30 08:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24d655cf-2125-59a7-b6e1-6e7bdfaaa59c with scrape type 2
2026-03-30 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24d655cf-2125-59a7-b6e1-6e7bdfaaa59c with scrape type 2
2026-03-30 08:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 24d655cf-2125-59a7-b6e1-6e7bdfaaa59c, identifier: RA40828
2026-03-30 08:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 24d655cf-2125-59a7-b6e1-6e7bdfaaa59c with identifier: RA40828
2026-03-30 08:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 24d655cf-2125-59a7-b6e1-6e7bdfaaa59c with identifier: RA40828
2026-03-30 08:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 24d655cf-2125-59a7-b6e1-6e7bdfaaa59c with identifier: RA40828 to the API
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:27:19Z',
 'fuel_type': 'diesel',
 'id': '24d655cf-2125-59a7-b6e1-6e7bdfaaa59c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA40828',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS5',
 'odometer': 135686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': 'Citroen DS5 1.6 e-HDi Desire',
 'transmission': 'automatic',
 'trim': 'Desire',
 'year': 2015}
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA40828%27 HTTP/1.1" 200 None
2026-03-30 08:02:12 [auto1.es] INFO: Saving data for RA40828: {'auction_closing_time': 1774884439.0, 'created_time': 1774771242.057856, 'last_price_update_time': 1774857732.90472}
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RA40828') HTTP/1.1" 204 0
2026-03-30 08:02:12 [auto1.es] INFO: Found listing with ID: MX89388
2026-03-30 08:02:12 [auto1.es] INFO: Found listing with ID: DG60223
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG60223%27 HTTP/1.1" 200 None
2026-03-30 08:02:12 [auto1.es] INFO: Scrape type for DG60223: 2
2026-03-30 08:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3757d210-d2ff-5323-99c1-ee964aba4068 with identifier: DG60223
2026-03-30 08:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3757d210-d2ff-5323-99c1-ee964aba4068 with scrape type 2
2026-03-30 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3757d210-d2ff-5323-99c1-ee964aba4068 with scrape type 2
2026-03-30 08:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3757d210-d2ff-5323-99c1-ee964aba4068, identifier: DG60223
2026-03-30 08:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3757d210-d2ff-5323-99c1-ee964aba4068 with identifier: DG60223
2026-03-30 08:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3757d210-d2ff-5323-99c1-ee964aba4068 with identifier: DG60223
2026-03-30 08:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3757d210-d2ff-5323-99c1-ee964aba4068 with identifier: DG60223 to the API
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:02:52Z',
 'fuel_type': 'diesel',
 'id': '3757d210-d2ff-5323-99c1-ee964aba4068',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG60223',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 93009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-20',
 'seller_name': None,
 'title': 'BMW 3er 320d Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2019}
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG60223%27 HTTP/1.1" 200 None
2026-03-30 08:02:13 [auto1.es] INFO: Saving data for DG60223: {'auction_closing_time': 1774882972.0, 'created_time': 1774771243.282887, 'last_price_update_time': 1774857733.320977}
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DG60223') HTTP/1.1" 204 0
2026-03-30 08:02:13 [auto1.es] INFO: Found listing with ID: KV08902
2026-03-30 08:02:13 [auto1.es] INFO: Found listing with ID: UN46915
2026-03-30 08:02:13 [auto1.es] INFO: Found listing with ID: ZJ66849
2026-03-30 08:02:13 [auto1.es] INFO: Found listing with ID: ZP40388
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP40388%27 HTTP/1.1" 200 None
2026-03-30 08:02:13 [auto1.es] INFO: Scrape type for ZP40388: 2
2026-03-30 08:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 894729a1-71aa-56bc-94cf-18804d46055d with identifier: ZP40388
2026-03-30 08:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 894729a1-71aa-56bc-94cf-18804d46055d with scrape type 2
2026-03-30 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 894729a1-71aa-56bc-94cf-18804d46055d with scrape type 2
2026-03-30 08:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 894729a1-71aa-56bc-94cf-18804d46055d, identifier: ZP40388
2026-03-30 08:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 894729a1-71aa-56bc-94cf-18804d46055d with identifier: ZP40388
2026-03-30 08:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 894729a1-71aa-56bc-94cf-18804d46055d with identifier: ZP40388
2026-03-30 08:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 894729a1-71aa-56bc-94cf-18804d46055d with identifier: ZP40388 to the API
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:34:16Z',
 'fuel_type': 'petrol',
 'id': '894729a1-71aa-56bc-94cf-18804d46055d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP40388',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 175016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-31',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2003}
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP40388%27 HTTP/1.1" 200 None
2026-03-30 08:02:13 [auto1.es] INFO: Saving data for ZP40388: {'auction_closing_time': 1774884856.0, 'created_time': 1774555460.421012, 'last_price_update_time': 1774857733.741695}
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZP40388') HTTP/1.1" 204 0
2026-03-30 08:02:13 [auto1.es] INFO: Found listing with ID: BY62424
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY62424%27 HTTP/1.1" 200 None
2026-03-30 08:02:13 [auto1.es] INFO: Scrape type for BY62424: 2
2026-03-30 08:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3f404a8-c897-53f1-afcc-fd74ac05daf0 with identifier: BY62424
2026-03-30 08:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f404a8-c897-53f1-afcc-fd74ac05daf0 with scrape type 2
2026-03-30 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3f404a8-c897-53f1-afcc-fd74ac05daf0 with scrape type 2
2026-03-30 08:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a3f404a8-c897-53f1-afcc-fd74ac05daf0, identifier: BY62424
2026-03-30 08:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a3f404a8-c897-53f1-afcc-fd74ac05daf0 with identifier: BY62424
2026-03-30 08:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a3f404a8-c897-53f1-afcc-fd74ac05daf0 with identifier: BY62424
2026-03-30 08:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a3f404a8-c897-53f1-afcc-fd74ac05daf0 with identifier: BY62424 to the API
2026-03-30 08:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:40:31Z',
 'fuel_type': 'diesel',
 'id': 'a3f404a8-c897-53f1-afcc-fd74ac05daf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY62424',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 150982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-20',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2019}
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY62424%27 HTTP/1.1" 200 None
2026-03-30 08:02:14 [auto1.es] INFO: Saving data for BY62424: {'auction_closing_time': 1774885231.0, 'created_time': 1774771247.360023, 'last_price_update_time': 1774857734.153428}
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BY62424') HTTP/1.1" 204 0
2026-03-30 08:02:14 [auto1.es] INFO: Found listing with ID: UU12950
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU12950%27 HTTP/1.1" 200 None
2026-03-30 08:02:14 [auto1.es] INFO: Scrape type for UU12950: 2
2026-03-30 08:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fab3e10a-9f6e-58f8-8e0b-dbf6505d59d9 with identifier: UU12950
2026-03-30 08:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fab3e10a-9f6e-58f8-8e0b-dbf6505d59d9 with scrape type 2
2026-03-30 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fab3e10a-9f6e-58f8-8e0b-dbf6505d59d9 with scrape type 2
2026-03-30 08:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fab3e10a-9f6e-58f8-8e0b-dbf6505d59d9, identifier: UU12950
2026-03-30 08:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fab3e10a-9f6e-58f8-8e0b-dbf6505d59d9 with identifier: UU12950
2026-03-30 08:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fab3e10a-9f6e-58f8-8e0b-dbf6505d59d9 with identifier: UU12950
2026-03-30 08:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fab3e10a-9f6e-58f8-8e0b-dbf6505d59d9 with identifier: UU12950 to the API
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:04:01Z',
 'fuel_type': 'petrol',
 'id': 'fab3e10a-9f6e-58f8-8e0b-dbf6505d59d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU12950',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 151038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-19',
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Cross',
 'transmission': 'automatic',
 'trim': 'Cross',
 'year': 2016}
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU12950%27 HTTP/1.1" 200 None
2026-03-30 08:02:14 [auto1.es] INFO: Saving data for UU12950: {'auction_closing_time': 1774883041.0, 'created_time': 1774771246.46539, 'last_price_update_time': 1774857734.654031}
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UU12950') HTTP/1.1" 204 0
2026-03-30 08:02:14 [auto1.es] INFO: Found listing with ID: JC57024
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC57024%27 HTTP/1.1" 200 None
2026-03-30 08:02:14 [auto1.es] INFO: Scrape type for JC57024: 2
2026-03-30 08:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 117ed6d3-0e34-5fb1-81da-bd7d060c23b8 with identifier: JC57024
2026-03-30 08:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 117ed6d3-0e34-5fb1-81da-bd7d060c23b8 with scrape type 2
2026-03-30 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 117ed6d3-0e34-5fb1-81da-bd7d060c23b8 with scrape type 2
2026-03-30 08:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 117ed6d3-0e34-5fb1-81da-bd7d060c23b8, identifier: JC57024
2026-03-30 08:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 117ed6d3-0e34-5fb1-81da-bd7d060c23b8 with identifier: JC57024
2026-03-30 08:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 117ed6d3-0e34-5fb1-81da-bd7d060c23b8 with identifier: JC57024
2026-03-30 08:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 117ed6d3-0e34-5fb1-81da-bd7d060c23b8 with identifier: JC57024 to the API
2026-03-30 08:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:57:27Z',
 'fuel_type': 'diesel',
 'id': '117ed6d3-0e34-5fb1-81da-bd7d060c23b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC57024',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 56678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-30',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2022}
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC57024%27 HTTP/1.1" 200 None
2026-03-30 08:02:15 [auto1.es] INFO: Saving data for JC57024: {'auction_closing_time': 1774886247.0, 'created_time': 1774771246.929286, 'last_price_update_time': 1774857735.257208}
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JC57024') HTTP/1.1" 204 0
2026-03-30 08:02:15 [auto1.es] INFO: Found listing with ID: NK53544
2026-03-30 08:02:15 [auto1.es] INFO: Found listing with ID: MS50562
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS50562%27 HTTP/1.1" 200 None
2026-03-30 08:02:15 [auto1.es] INFO: Scrape type for MS50562: 2
2026-03-30 08:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5a50634-bba8-5fbd-a430-8bddfc53014f with identifier: MS50562
2026-03-30 08:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5a50634-bba8-5fbd-a430-8bddfc53014f with scrape type 2
2026-03-30 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5a50634-bba8-5fbd-a430-8bddfc53014f with scrape type 2
2026-03-30 08:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d5a50634-bba8-5fbd-a430-8bddfc53014f, identifier: MS50562
2026-03-30 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d5a50634-bba8-5fbd-a430-8bddfc53014f with identifier: MS50562
2026-03-30 08:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d5a50634-bba8-5fbd-a430-8bddfc53014f with identifier: MS50562
2026-03-30 08:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d5a50634-bba8-5fbd-a430-8bddfc53014f with identifier: MS50562 to the API
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:25:15Z',
 'fuel_type': 'diesel',
 'id': 'd5a50634-bba8-5fbd-a430-8bddfc53014f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS50562',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 98985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS50562%27 HTTP/1.1" 200 None
2026-03-30 08:02:15 [auto1.es] INFO: Saving data for MS50562: {'auction_closing_time': 1774884315.0, 'created_time': 1774771252.284026, 'last_price_update_time': 1774857735.669327}
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MS50562') HTTP/1.1" 204 0
2026-03-30 08:02:15 [auto1.es] INFO: Found listing with ID: TP39679
2026-03-30 08:02:15 [auto1.es] INFO: Found listing with ID: FL58713
2026-03-30 08:02:15 [auto1.es] INFO: Found listing with ID: FE45976
2026-03-30 08:02:15 [auto1.es] INFO: Found listing with ID: FD06451
2026-03-30 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ63101> (referer: https://www.auto1.com/v1/car-details-view/MZ63101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:15 [auto1.es] INFO: Channel: 24h | Page: 16 | totalHits: 2178 | hits on page: 40
2026-03-30 08:02:15 [auto1.es] INFO: Found listing with ID: SY03135
2026-03-30 08:02:15 [auto1.es] INFO: Found listing with ID: BZ30426
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ30426%27 HTTP/1.1" 200 None
2026-03-30 08:02:15 [auto1.es] INFO: Scrape type for BZ30426: 2
2026-03-30 08:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d4fdf9d-6d24-58dc-b39e-a4dfe75b57ac with identifier: BZ30426
2026-03-30 08:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d4fdf9d-6d24-58dc-b39e-a4dfe75b57ac with scrape type 2
2026-03-30 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d4fdf9d-6d24-58dc-b39e-a4dfe75b57ac with scrape type 2
2026-03-30 08:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d4fdf9d-6d24-58dc-b39e-a4dfe75b57ac, identifier: BZ30426
2026-03-30 08:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d4fdf9d-6d24-58dc-b39e-a4dfe75b57ac with identifier: BZ30426
2026-03-30 08:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d4fdf9d-6d24-58dc-b39e-a4dfe75b57ac with identifier: BZ30426
2026-03-30 08:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d4fdf9d-6d24-58dc-b39e-a4dfe75b57ac with identifier: BZ30426 to the API
2026-03-30 08:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:49:19Z',
 'fuel_type': 'petrol',
 'id': '0d4fdf9d-6d24-58dc-b39e-a4dfe75b57ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ30426',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 18199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-27',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Mild-Hybrid Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2023}
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ30426%27 HTTP/1.1" 200 None
2026-03-30 08:02:16 [auto1.es] INFO: Saving data for BZ30426: {'auction_closing_time': 1774885759.0, 'created_time': 1774771252.802545, 'last_price_update_time': 1774857736.354396}
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BZ30426') HTTP/1.1" 204 0
2026-03-30 08:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:16 [auto1.es] INFO: Found listing with ID: VG29597
2026-03-30 08:02:16 [auto1.es] INFO: Found listing with ID: JM67207
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM67207%27 HTTP/1.1" 200 None
2026-03-30 08:02:16 [auto1.es] INFO: Scrape type for JM67207: 2
2026-03-30 08:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fa064e6-e177-5952-b9ad-b93329c97ed4 with identifier: JM67207
2026-03-30 08:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa064e6-e177-5952-b9ad-b93329c97ed4 with scrape type 2
2026-03-30 08:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fa064e6-e177-5952-b9ad-b93329c97ed4 with scrape type 2
2026-03-30 08:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8fa064e6-e177-5952-b9ad-b93329c97ed4, identifier: JM67207
2026-03-30 08:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8fa064e6-e177-5952-b9ad-b93329c97ed4 with identifier: JM67207
2026-03-30 08:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8fa064e6-e177-5952-b9ad-b93329c97ed4 with identifier: JM67207
2026-03-30 08:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8fa064e6-e177-5952-b9ad-b93329c97ed4 with identifier: JM67207 to the API
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:12:06Z',
 'fuel_type': 'petrol',
 'id': '8fa064e6-e177-5952-b9ad-b93329c97ed4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM67207',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 170885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-20',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TFSI quattro Ambition',
 'transmission': 'automatic',
 'trim': 'quattro Ambition',
 'year': 2011}
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM67207%27 HTTP/1.1" 200 None
2026-03-30 08:02:16 [auto1.es] INFO: Saving data for JM67207: {'auction_closing_time': 1774883526.0, 'created_time': 1774771260.597656, 'last_price_update_time': 1774857736.830834}
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JM67207') HTTP/1.1" 204 0
2026-03-30 08:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cc98cc2-b327-5fc1-b412-c309cc5feb81 with identifier: MZ63101
2026-03-30 08:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cc98cc2-b327-5fc1-b412-c309cc5feb81 with scrape type 1
2026-03-30 08:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7cc98cc2-b327-5fc1-b412-c309cc5feb81
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fe0%252Fa4e029c818eb176c617a99434029f844%252Fpa%252FMZ63101_5d066c80c4487ab538edfc1c3a8abe99.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_5d066c80c4487ab538edfc1c3a8abe99.jpg already downloaded
2026-03-30 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fe0%252Fa4e029c818eb176c617a99434029f844%252Fpa%252FMZ63101_eeccbe9eb2bff28f3c0e8d7a8d9fa393.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_eeccbe9eb2bff28f3c0e8d7a8d9fa393.jpg already downloaded
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fe0%252Fa4e029c818eb176c617a99434029f844%252Fpa%252FMZ63101_bfd2eae196d2b0ae946b2438dccf2fd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_bfd2eae196d2b0ae946b2438dccf2fd0.jpg already downloaded
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fe0%252Fa4e029c818eb176c617a99434029f844%252Fpa%252FMZ63101_99fb90d1d32fddf4cff134d80082c7b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_99fb90d1d32fddf4cff134d80082c7b0.jpg already downloaded
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fe0%252Fa4e029c818eb176c617a99434029f844%252Fpa%252FMZ63101_f895adf0b762021b5824bef7c2bc2caf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_f895adf0b762021b5824bef7c2bc2caf.jpg already downloaded
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fe0%252Fa4e029c818eb176c617a99434029f844%252Fpa%252FMZ63101_05b4bb4ce036b2c119f78cd87e927ee1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_05b4bb4ce036b2c119f78cd87e927ee1.jpg already downloaded
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fe0%252Fa4e029c818eb176c617a99434029f844%252Fpa%252FMZ63101_403ce706092f9b6a3449b67578e44996.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_403ce706092f9b6a3449b67578e44996.jpg already downloaded
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fe0%252Fa4e029c818eb176c617a99434029f844%252Fpa%252FMZ63101_c83e929a542cf4d4b7c19c70e04ba22d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_c83e929a542cf4d4b7c19c70e04ba22d.jpg already downloaded
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fe0%252Fa4e029c818eb176c617a99434029f844%252Fpa%252FMZ63101_c8357f9622ff8195f75145a980829590.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_c8357f9622ff8195f75145a980829590.jpg already downloaded
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fe0%252Fa4e029c818eb176c617a99434029f844%252Fpa%252FMZ63101_0d61f459f2ed9147f69877b23d9f7287.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_0d61f459f2ed9147f69877b23d9f7287.jpg already downloaded
2026-03-30 08:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7cc98cc2-b327-5fc1-b412-c309cc5feb81, identifier: MZ63101
2026-03-30 08:02:17 [auto1.es] INFO: Found listing with ID: JG31489
2026-03-30 08:02:17 [auto1.es] INFO: Found listing with ID: LL39817
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL39817%27 HTTP/1.1" 200 None
2026-03-30 08:02:17 [auto1.es] INFO: Scrape type for LL39817: 2
2026-03-30 08:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8756585-c95c-54ff-acad-c694e9f5f76b with identifier: LL39817
2026-03-30 08:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8756585-c95c-54ff-acad-c694e9f5f76b with scrape type 2
2026-03-30 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8756585-c95c-54ff-acad-c694e9f5f76b with scrape type 2
2026-03-30 08:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a8756585-c95c-54ff-acad-c694e9f5f76b, identifier: LL39817
2026-03-30 08:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7cc98cc2-b327-5fc1-b412-c309cc5feb81 with identifier: MZ63101
2026-03-30 08:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7cc98cc2-b327-5fc1-b412-c309cc5feb81 with identifier: MZ63101
2026-03-30 08:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7cc98cc2-b327-5fc1-b412-c309cc5feb81 with identifier: MZ63101 to the API
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MZ63101>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:12:42Z',
 'fuel_type': 'hybrid',
 'id': '7cc98cc2-b327-5fc1-b412-c309cc5feb81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ63101',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 144720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_5d066c80c4487ab538edfc1c3a8abe99.jpg',
                'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_eeccbe9eb2bff28f3c0e8d7a8d9fa393.jpg',
                'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_bfd2eae196d2b0ae946b2438dccf2fd0.jpg',
                'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_99fb90d1d32fddf4cff134d80082c7b0.jpg',
                'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_f895adf0b762021b5824bef7c2bc2caf.jpg',
                'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_05b4bb4ce036b2c119f78cd87e927ee1.jpg',
                'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_403ce706092f9b6a3449b67578e44996.jpg',
                'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_c83e929a542cf4d4b7c19c70e04ba22d.jpg',
                'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_c8357f9622ff8195f75145a980829590.jpg',
                'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_0d61f459f2ed9147f69877b23d9f7287.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cc98cc2-b327-5fc1-b412-c309cc5feb81/7cc98cc2-b327-5fc1-b412-c309cc5feb81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_5d066c80c4487ab538edfc1c3a8abe99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cc98cc2-b327-5fc1-b412-c309cc5feb81/7cc98cc2-b327-5fc1-b412-c309cc5feb81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_eeccbe9eb2bff28f3c0e8d7a8d9fa393.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cc98cc2-b327-5fc1-b412-c309cc5feb81/7cc98cc2-b327-5fc1-b412-c309cc5feb81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_bfd2eae196d2b0ae946b2438dccf2fd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cc98cc2-b327-5fc1-b412-c309cc5feb81/7cc98cc2-b327-5fc1-b412-c309cc5feb81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_99fb90d1d32fddf4cff134d80082c7b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cc98cc2-b327-5fc1-b412-c309cc5feb81/7cc98cc2-b327-5fc1-b412-c309cc5feb81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_f895adf0b762021b5824bef7c2bc2caf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cc98cc2-b327-5fc1-b412-c309cc5feb81/7cc98cc2-b327-5fc1-b412-c309cc5feb81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_05b4bb4ce036b2c119f78cd87e927ee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cc98cc2-b327-5fc1-b412-c309cc5feb81/7cc98cc2-b327-5fc1-b412-c309cc5feb81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_403ce706092f9b6a3449b67578e44996.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cc98cc2-b327-5fc1-b412-c309cc5feb81/7cc98cc2-b327-5fc1-b412-c309cc5feb81_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_c83e929a542cf4d4b7c19c70e04ba22d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cc98cc2-b327-5fc1-b412-c309cc5feb81/7cc98cc2-b327-5fc1-b412-c309cc5feb81_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_c8357f9622ff8195f75145a980829590.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cc98cc2-b327-5fc1-b412-c309cc5feb81/7cc98cc2-b327-5fc1-b412-c309cc5feb81_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/e0/a4e029c818eb176c617a99434029f844/pa/MZ63101_0d61f459f2ed9147f69877b23d9f7287.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2016}
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ63101%27 HTTP/1.1" 200 None
2026-03-30 08:02:17 [auto1.es] INFO: Saving data for MZ63101: {'created_time': 1774857737.757489, 'last_price_update_time': 1774857737.757508, 'auction_closing_time': 1774969962.0}
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MZ63101') HTTP/1.1" 204 0
2026-03-30 08:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a8756585-c95c-54ff-acad-c694e9f5f76b with identifier: LL39817
2026-03-30 08:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a8756585-c95c-54ff-acad-c694e9f5f76b with identifier: LL39817
2026-03-30 08:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a8756585-c95c-54ff-acad-c694e9f5f76b with identifier: LL39817 to the API
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:37:34Z',
 'fuel_type': 'petrol',
 'id': 'a8756585-c95c-54ff-acad-c694e9f5f76b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL39817',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 153914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-02-09',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2003}
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL39817%27 HTTP/1.1" 200 None
2026-03-30 08:02:18 [auto1.es] INFO: Saving data for LL39817: {'auction_closing_time': 1774885054.0, 'created_time': 1773900644.575946, 'last_price_update_time': 1774857738.053618}
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LL39817') HTTP/1.1" 204 0
2026-03-30 08:02:18 [auto1.es] INFO: Found listing with ID: BG65437
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG65437%27 HTTP/1.1" 200 None
2026-03-30 08:02:18 [auto1.es] INFO: Scrape type for BG65437: 2
2026-03-30 08:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f012b42b-c2e6-53ce-94f7-b180d7230ff0 with identifier: BG65437
2026-03-30 08:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f012b42b-c2e6-53ce-94f7-b180d7230ff0 with scrape type 2
2026-03-30 08:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f012b42b-c2e6-53ce-94f7-b180d7230ff0 with scrape type 2
2026-03-30 08:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f012b42b-c2e6-53ce-94f7-b180d7230ff0, identifier: BG65437
2026-03-30 08:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f012b42b-c2e6-53ce-94f7-b180d7230ff0 with identifier: BG65437
2026-03-30 08:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f012b42b-c2e6-53ce-94f7-b180d7230ff0 with identifier: BG65437
2026-03-30 08:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f012b42b-c2e6-53ce-94f7-b180d7230ff0 with identifier: BG65437 to the API
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:05:35Z',
 'fuel_type': 'diesel',
 'id': 'f012b42b-c2e6-53ce-94f7-b180d7230ff0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG65437',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 97144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG65437%27 HTTP/1.1" 200 None
2026-03-30 08:02:18 [auto1.es] INFO: Saving data for BG65437: {'auction_closing_time': 1774883135.0, 'created_time': 1774037080.714648, 'last_price_update_time': 1774857738.652702}
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BG65437') HTTP/1.1" 204 0
2026-03-30 08:02:18 [auto1.es] INFO: Found listing with ID: PC57749
2026-03-30 08:02:18 [auto1.es] INFO: Found listing with ID: SW39850
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW39850%27 HTTP/1.1" 200 None
2026-03-30 08:02:18 [auto1.es] INFO: Scrape type for SW39850: 2
2026-03-30 08:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c90c67c-10f3-5dbe-b926-f02cf2aa040e with identifier: SW39850
2026-03-30 08:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c90c67c-10f3-5dbe-b926-f02cf2aa040e with scrape type 2
2026-03-30 08:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c90c67c-10f3-5dbe-b926-f02cf2aa040e with scrape type 2
2026-03-30 08:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c90c67c-10f3-5dbe-b926-f02cf2aa040e, identifier: SW39850
2026-03-30 08:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c90c67c-10f3-5dbe-b926-f02cf2aa040e with identifier: SW39850
2026-03-30 08:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c90c67c-10f3-5dbe-b926-f02cf2aa040e with identifier: SW39850
2026-03-30 08:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4c90c67c-10f3-5dbe-b926-f02cf2aa040e with identifier: SW39850 to the API
2026-03-30 08:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:42:19Z',
 'fuel_type': 'petrol',
 'id': '4c90c67c-10f3-5dbe-b926-f02cf2aa040e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW39850',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera',
 'odometer': 215554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-06-10',
 'seller_name': None,
 'title': 'Nissan Almera 1.4 LX',
 'transmission': 'manual',
 'trim': 'LX',
 'year': 1998}
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW39850%27 HTTP/1.1" 200 None
2026-03-30 08:02:19 [auto1.es] INFO: Saving data for SW39850: {'auction_closing_time': 1774885339.0, 'created_time': 1774382784.530914, 'last_price_update_time': 1774857739.133356}
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SW39850') HTTP/1.1" 204 0
2026-03-30 08:02:19 [auto1.es] INFO: Found listing with ID: UT42800
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT42800%27 HTTP/1.1" 200 None
2026-03-30 08:02:19 [auto1.es] INFO: Scrape type for UT42800: 2
2026-03-30 08:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a353692-9f17-5558-b439-f4d044004b12 with identifier: UT42800
2026-03-30 08:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a353692-9f17-5558-b439-f4d044004b12 with scrape type 2
2026-03-30 08:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a353692-9f17-5558-b439-f4d044004b12 with scrape type 2
2026-03-30 08:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2a353692-9f17-5558-b439-f4d044004b12, identifier: UT42800
2026-03-30 08:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2a353692-9f17-5558-b439-f4d044004b12 with identifier: UT42800
2026-03-30 08:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2a353692-9f17-5558-b439-f4d044004b12 with identifier: UT42800
2026-03-30 08:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2a353692-9f17-5558-b439-f4d044004b12 with identifier: UT42800 to the API
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:37:27Z',
 'fuel_type': 'hybrid',
 'id': '2a353692-9f17-5558-b439-f4d044004b12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT42800',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 147580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-15',
 'seller_name': None,
 'title': 'BMW 3er 330e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT42800%27 HTTP/1.1" 200 None
2026-03-30 08:02:19 [auto1.es] INFO: Saving data for UT42800: {'auction_closing_time': 1774885047.0, 'created_time': 1774771260.259741, 'last_price_update_time': 1774857739.580085}
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UT42800') HTTP/1.1" 204 0
2026-03-30 08:02:19 [auto1.es] INFO: Found listing with ID: XT05924
2026-03-30 08:02:19 [auto1.es] INFO: Found listing with ID: UF24863
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF24863%27 HTTP/1.1" 200 None
2026-03-30 08:02:19 [auto1.es] INFO: Scrape type for UF24863: 2
2026-03-30 08:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f78959c-73e4-5c94-bb65-5cf3f11aef21 with identifier: UF24863
2026-03-30 08:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f78959c-73e4-5c94-bb65-5cf3f11aef21 with scrape type 2
2026-03-30 08:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f78959c-73e4-5c94-bb65-5cf3f11aef21 with scrape type 2
2026-03-30 08:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5f78959c-73e4-5c94-bb65-5cf3f11aef21, identifier: UF24863
2026-03-30 08:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5f78959c-73e4-5c94-bb65-5cf3f11aef21 with identifier: UF24863
2026-03-30 08:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5f78959c-73e4-5c94-bb65-5cf3f11aef21 with identifier: UF24863
2026-03-30 08:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5f78959c-73e4-5c94-bb65-5cf3f11aef21 with identifier: UF24863 to the API
2026-03-30 08:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:57:03Z',
 'fuel_type': 'diesel',
 'id': '5f78959c-73e4-5c94-bb65-5cf3f11aef21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF24863',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Magentis',
 'odometer': 426645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-31',
 'seller_name': None,
 'title': 'Kia Magentis 2.0 CRDi EX I',
 'transmission': 'manual',
 'trim': 'EX I',
 'year': 2006}
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF24863%27 HTTP/1.1" 200 None
2026-03-30 08:02:20 [auto1.es] INFO: Saving data for UF24863: {'auction_closing_time': 1774886223.0, 'created_time': 1773950500.899061, 'last_price_update_time': 1774857740.461381}
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UF24863') HTTP/1.1" 204 0
2026-03-30 08:02:20 [auto1.es] INFO: Found listing with ID: TR37642
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR37642%27 HTTP/1.1" 200 None
2026-03-30 08:02:20 [auto1.es] INFO: Scrape type for TR37642: 2
2026-03-30 08:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d8f1c1e-3984-5ac8-ad05-725b064824b6 with identifier: TR37642
2026-03-30 08:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d8f1c1e-3984-5ac8-ad05-725b064824b6 with scrape type 2
2026-03-30 08:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d8f1c1e-3984-5ac8-ad05-725b064824b6 with scrape type 2
2026-03-30 08:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7d8f1c1e-3984-5ac8-ad05-725b064824b6, identifier: TR37642
2026-03-30 08:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7d8f1c1e-3984-5ac8-ad05-725b064824b6 with identifier: TR37642
2026-03-30 08:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7d8f1c1e-3984-5ac8-ad05-725b064824b6 with identifier: TR37642
2026-03-30 08:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7d8f1c1e-3984-5ac8-ad05-725b064824b6 with identifier: TR37642 to the API
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:10:49Z',
 'fuel_type': 'diesel',
 'id': '7d8f1c1e-3984-5ac8-ad05-725b064824b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR37642',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 368211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-28',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 350 d BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2014}
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR37642%27 HTTP/1.1" 200 None
2026-03-30 08:02:20 [auto1.es] INFO: Saving data for TR37642: {'auction_closing_time': 1774883449.0, 'created_time': 1774771257.300189, 'last_price_update_time': 1774857740.882261}
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TR37642') HTTP/1.1" 204 0
2026-03-30 08:02:20 [auto1.es] INFO: Found listing with ID: ZP69611
2026-03-30 08:02:20 [auto1.es] INFO: Found listing with ID: PY01338
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY01338%27 HTTP/1.1" 200 None
2026-03-30 08:02:20 [auto1.es] INFO: Scrape type for PY01338: 2
2026-03-30 08:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 051e94c1-4c68-5ffe-a921-ca723dbb6718 with identifier: PY01338
2026-03-30 08:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 051e94c1-4c68-5ffe-a921-ca723dbb6718 with scrape type 2
2026-03-30 08:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 051e94c1-4c68-5ffe-a921-ca723dbb6718 with scrape type 2
2026-03-30 08:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 051e94c1-4c68-5ffe-a921-ca723dbb6718, identifier: PY01338
2026-03-30 08:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 051e94c1-4c68-5ffe-a921-ca723dbb6718 with identifier: PY01338
2026-03-30 08:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 051e94c1-4c68-5ffe-a921-ca723dbb6718 with identifier: PY01338
2026-03-30 08:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 051e94c1-4c68-5ffe-a921-ca723dbb6718 with identifier: PY01338 to the API
2026-03-30 08:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:57Z',
 'fuel_type': 'diesel',
 'id': '051e94c1-4c68-5ffe-a921-ca723dbb6718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY01338',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 204915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-16',
 'seller_name': None,
 'title': 'Renault Espace 2.2 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2004}
2026-03-30 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY01338%27 HTTP/1.1" 200 None
2026-03-30 08:02:21 [auto1.es] INFO: Saving data for PY01338: {'auction_closing_time': 1774884057.0, 'created_time': 1774555454.523093, 'last_price_update_time': 1774857741.330542}
2026-03-30 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PY01338') HTTP/1.1" 204 0
2026-03-30 08:02:21 [auto1.es] INFO: Found listing with ID: FZ59891
2026-03-30 08:02:21 [auto1.es] INFO: Found listing with ID: GM36563
2026-03-30 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM36563%27 HTTP/1.1" 200 None
2026-03-30 08:02:21 [auto1.es] INFO: Scrape type for GM36563: 2
2026-03-30 08:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 372d5168-1e06-5ded-8186-c560498ffebb with identifier: GM36563
2026-03-30 08:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 372d5168-1e06-5ded-8186-c560498ffebb with scrape type 2
2026-03-30 08:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 372d5168-1e06-5ded-8186-c560498ffebb with scrape type 2
2026-03-30 08:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 372d5168-1e06-5ded-8186-c560498ffebb, identifier: GM36563
2026-03-30 08:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 372d5168-1e06-5ded-8186-c560498ffebb with identifier: GM36563
2026-03-30 08:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 372d5168-1e06-5ded-8186-c560498ffebb with identifier: GM36563
2026-03-30 08:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 372d5168-1e06-5ded-8186-c560498ffebb with identifier: GM36563 to the API
2026-03-30 08:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 50,
 'expiration_date': '2026-03-30T15:35:24Z',
 'fuel_type': 'petrol',
 'id': '372d5168-1e06-5ded-8186-c560498ffebb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM36563',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arosa',
 'odometer': 188628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-05-16',
 'seller_name': None,
 'title': 'Seat Arosa 1.0 Stella',
 'transmission': 'manual',
 'trim': 'Stella',
 'year': 2001}
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM36563%27 HTTP/1.1" 200 None
2026-03-30 08:02:22 [auto1.es] INFO: Saving data for GM36563: {'auction_closing_time': 1774884924.0, 'created_time': 1772626621.103579, 'last_price_update_time': 1774857742.010214}
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GM36563') HTTP/1.1" 204 0
2026-03-30 08:02:22 [auto1.es] INFO: Found listing with ID: ET47712
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET47712%27 HTTP/1.1" 200 None
2026-03-30 08:02:22 [auto1.es] INFO: Scrape type for ET47712: 2
2026-03-30 08:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b56a5e7-2ad4-5402-b406-1f728183ca14 with identifier: ET47712
2026-03-30 08:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b56a5e7-2ad4-5402-b406-1f728183ca14 with scrape type 2
2026-03-30 08:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b56a5e7-2ad4-5402-b406-1f728183ca14 with scrape type 2
2026-03-30 08:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b56a5e7-2ad4-5402-b406-1f728183ca14, identifier: ET47712
2026-03-30 08:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b56a5e7-2ad4-5402-b406-1f728183ca14 with identifier: ET47712
2026-03-30 08:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b56a5e7-2ad4-5402-b406-1f728183ca14 with identifier: ET47712
2026-03-30 08:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b56a5e7-2ad4-5402-b406-1f728183ca14 with identifier: ET47712 to the API
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:20:09Z',
 'fuel_type': 'hybrid',
 'id': '6b56a5e7-2ad4-5402-b406-1f728183ca14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET47712',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 74032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-08',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
 'transmission': 'automatic',
 'trim': '4 300 GT',
 'year': 2022}
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET47712%27 HTTP/1.1" 200 None
2026-03-30 08:02:22 [auto1.es] INFO: Saving data for ET47712: {'auction_closing_time': 1774884009.0, 'created_time': 1774771264.606262, 'last_price_update_time': 1774857742.540238}
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ET47712') HTTP/1.1" 204 0
2026-03-30 08:02:22 [auto1.es] INFO: Channel: 24h | Page: 17 | totalHits: 2178 | hits on page: 40
2026-03-30 08:02:22 [auto1.es] INFO: Found listing with ID: CM69790
2026-03-30 08:02:22 [auto1.es] INFO: Found listing with ID: NH22970
2026-03-30 08:02:22 [auto1.es] INFO: Found listing with ID: CR05055
2026-03-30 08:02:22 [auto1.es] INFO: Found listing with ID: DD59936
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD59936%27 HTTP/1.1" 200 None
2026-03-30 08:02:22 [auto1.es] INFO: Scrape type for DD59936: 2
2026-03-30 08:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3731275-a867-54fb-93e7-05851aa4a9b7 with identifier: DD59936
2026-03-30 08:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3731275-a867-54fb-93e7-05851aa4a9b7 with scrape type 2
2026-03-30 08:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3731275-a867-54fb-93e7-05851aa4a9b7 with scrape type 2
2026-03-30 08:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c3731275-a867-54fb-93e7-05851aa4a9b7, identifier: DD59936
2026-03-30 08:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c3731275-a867-54fb-93e7-05851aa4a9b7 with identifier: DD59936
2026-03-30 08:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c3731275-a867-54fb-93e7-05851aa4a9b7 with identifier: DD59936
2026-03-30 08:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c3731275-a867-54fb-93e7-05851aa4a9b7 with identifier: DD59936 to the API
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:22Z',
 'fuel_type': 'petrol',
 'id': 'c3731275-a867-54fb-93e7-05851aa4a9b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD59936',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 41183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-11',
 'seller_name': None,
 'title': 'Seat Arona 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2024}
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD59936%27 HTTP/1.1" 200 None
2026-03-30 08:02:23 [auto1.es] INFO: Saving data for DD59936: {'auction_closing_time': 1774884202.0, 'created_time': 1774771264.010196, 'last_price_update_time': 1774857743.166971}
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DD59936') HTTP/1.1" 204 0
2026-03-30 08:02:23 [auto1.es] INFO: Found listing with ID: CF79242
2026-03-30 08:02:23 [auto1.es] INFO: Found listing with ID: ZZ15598
2026-03-30 08:02:23 [auto1.es] INFO: Found listing with ID: XL90476
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL90476%27 HTTP/1.1" 200 None
2026-03-30 08:02:23 [auto1.es] INFO: Scrape type for XL90476: 2
2026-03-30 08:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 610a84be-d09f-552f-a7bc-254e62db915a with identifier: XL90476
2026-03-30 08:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 610a84be-d09f-552f-a7bc-254e62db915a with scrape type 2
2026-03-30 08:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 610a84be-d09f-552f-a7bc-254e62db915a with scrape type 2
2026-03-30 08:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 610a84be-d09f-552f-a7bc-254e62db915a, identifier: XL90476
2026-03-30 08:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:23 [auto1.es] INFO: Found listing with ID: EC26628
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EC26628%27 HTTP/1.1" 200 None
2026-03-30 08:02:23 [auto1.es] INFO: Scrape type for EC26628: 2
2026-03-30 08:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 880edd21-b529-52fe-b2ec-ae6209a9591a with identifier: EC26628
2026-03-30 08:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 880edd21-b529-52fe-b2ec-ae6209a9591a with scrape type 2
2026-03-30 08:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 880edd21-b529-52fe-b2ec-ae6209a9591a with scrape type 2
2026-03-30 08:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 880edd21-b529-52fe-b2ec-ae6209a9591a, identifier: EC26628
2026-03-30 08:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 610a84be-d09f-552f-a7bc-254e62db915a with identifier: XL90476
2026-03-30 08:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 610a84be-d09f-552f-a7bc-254e62db915a with identifier: XL90476
2026-03-30 08:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 610a84be-d09f-552f-a7bc-254e62db915a with identifier: XL90476 to the API
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:58:44Z',
 'fuel_type': 'diesel',
 'id': '610a84be-d09f-552f-a7bc-254e62db915a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL90476',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 96924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-22',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2012}
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL90476%27 HTTP/1.1" 200 None
2026-03-30 08:02:23 [auto1.es] INFO: Saving data for XL90476: {'auction_closing_time': 1774886324.0, 'created_time': 1774771268.956275, 'last_price_update_time': 1774857743.728664}
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XL90476') HTTP/1.1" 204 0
2026-03-30 08:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 880edd21-b529-52fe-b2ec-ae6209a9591a with identifier: EC26628
2026-03-30 08:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 880edd21-b529-52fe-b2ec-ae6209a9591a with identifier: EC26628
2026-03-30 08:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 880edd21-b529-52fe-b2ec-ae6209a9591a with identifier: EC26628 to the API
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-30T15:57:02Z',
 'fuel_type': 'hybrid',
 'id': '880edd21-b529-52fe-b2ec-ae6209a9591a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC26628',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 211984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-19',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EC26628%27 HTTP/1.1" 200 None
2026-03-30 08:02:24 [auto1.es] INFO: Saving data for EC26628: {'auction_closing_time': 1774886222.0, 'created_time': 1773918257.330302, 'last_price_update_time': 1774857744.104424}
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EC26628') HTTP/1.1" 204 0
2026-03-30 08:02:24 [auto1.es] INFO: Found listing with ID: TF16142
2026-03-30 08:02:24 [auto1.es] INFO: Found listing with ID: CW38943
2026-03-30 08:02:24 [auto1.es] INFO: Found listing with ID: CY26712
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY26712%27 HTTP/1.1" 200 None
2026-03-30 08:02:24 [auto1.es] INFO: Scrape type for CY26712: 2
2026-03-30 08:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8479357f-282d-54cd-aa08-8a22e72666bd with identifier: CY26712
2026-03-30 08:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8479357f-282d-54cd-aa08-8a22e72666bd with scrape type 2
2026-03-30 08:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8479357f-282d-54cd-aa08-8a22e72666bd with scrape type 2
2026-03-30 08:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8479357f-282d-54cd-aa08-8a22e72666bd, identifier: CY26712
2026-03-30 08:02:24 [auto1.es] INFO: Found listing with ID: UF51281
2026-03-30 08:02:24 [auto1.es] INFO: Found listing with ID: DD26500
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD26500%27 HTTP/1.1" 200 None
2026-03-30 08:02:24 [auto1.es] INFO: Scrape type for DD26500: 2
2026-03-30 08:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f375d868-d5dd-58e6-9ac3-02bc0bb1cf86 with identifier: DD26500
2026-03-30 08:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f375d868-d5dd-58e6-9ac3-02bc0bb1cf86 with scrape type 2
2026-03-30 08:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f375d868-d5dd-58e6-9ac3-02bc0bb1cf86 with scrape type 2
2026-03-30 08:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f375d868-d5dd-58e6-9ac3-02bc0bb1cf86, identifier: DD26500
2026-03-30 08:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8479357f-282d-54cd-aa08-8a22e72666bd with identifier: CY26712
2026-03-30 08:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8479357f-282d-54cd-aa08-8a22e72666bd with identifier: CY26712
2026-03-30 08:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8479357f-282d-54cd-aa08-8a22e72666bd with identifier: CY26712 to the API
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:51:43Z',
 'fuel_type': 'petrol',
 'id': '8479357f-282d-54cd-aa08-8a22e72666bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY26712',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Bora',
 'odometer': 211547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-03-22',
 'seller_name': None,
 'title': 'Volkswagen Bora 2.0 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2000}
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY26712%27 HTTP/1.1" 200 None
2026-03-30 08:02:24 [auto1.es] INFO: Saving data for CY26712: {'auction_closing_time': 1774885903.0, 'created_time': 1774641828.143776, 'last_price_update_time': 1774857744.914937}
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CY26712') HTTP/1.1" 204 0
2026-03-30 08:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f375d868-d5dd-58e6-9ac3-02bc0bb1cf86 with identifier: DD26500
2026-03-30 08:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f375d868-d5dd-58e6-9ac3-02bc0bb1cf86 with identifier: DD26500
2026-03-30 08:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f375d868-d5dd-58e6-9ac3-02bc0bb1cf86 with identifier: DD26500 to the API
2026-03-30 08:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:59:15Z',
 'fuel_type': 'petrol',
 'id': 'f375d868-d5dd-58e6-9ac3-02bc0bb1cf86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD26500',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '306',
 'odometer': 192712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-02-22',
 'seller_name': None,
 'title': 'Peugeot 306 1.6 XS',
 'transmission': 'manual',
 'trim': 'XS',
 'year': 2000}
2026-03-30 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD26500%27 HTTP/1.1" 200 None
2026-03-30 08:02:25 [auto1.es] INFO: Saving data for DD26500: {'auction_closing_time': 1774886355.0, 'created_time': 1772690648.27782, 'last_price_update_time': 1774857745.262161}
2026-03-30 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DD26500') HTTP/1.1" 204 0
2026-03-30 08:02:25 [auto1.es] INFO: Found listing with ID: MT83895
2026-03-30 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT83895%27 HTTP/1.1" 200 None
2026-03-30 08:02:25 [auto1.es] INFO: Scrape type for MT83895: 2
2026-03-30 08:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 207f7261-56ce-5cf2-ad87-6a2f383c9324 with identifier: MT83895
2026-03-30 08:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 207f7261-56ce-5cf2-ad87-6a2f383c9324 with scrape type 2
2026-03-30 08:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 207f7261-56ce-5cf2-ad87-6a2f383c9324 with scrape type 2
2026-03-30 08:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 207f7261-56ce-5cf2-ad87-6a2f383c9324, identifier: MT83895
2026-03-30 08:02:26 [auto1.es] INFO: Found listing with ID: DB30998
2026-03-30 08:02:26 [auto1.es] INFO: Found listing with ID: BF77799
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF77799%27 HTTP/1.1" 200 None
2026-03-30 08:02:26 [auto1.es] INFO: Scrape type for BF77799: 2
2026-03-30 08:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bad7a467-70ab-565f-adaf-e3e6eabeac17 with identifier: BF77799
2026-03-30 08:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bad7a467-70ab-565f-adaf-e3e6eabeac17 with scrape type 2
2026-03-30 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bad7a467-70ab-565f-adaf-e3e6eabeac17 with scrape type 2
2026-03-30 08:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bad7a467-70ab-565f-adaf-e3e6eabeac17, identifier: BF77799
2026-03-30 08:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 207f7261-56ce-5cf2-ad87-6a2f383c9324 with identifier: MT83895
2026-03-30 08:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 207f7261-56ce-5cf2-ad87-6a2f383c9324 with identifier: MT83895
2026-03-30 08:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 207f7261-56ce-5cf2-ad87-6a2f383c9324 with identifier: MT83895 to the API
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:56:39Z',
 'fuel_type': 'petrol',
 'id': '207f7261-56ce-5cf2-ad87-6a2f383c9324',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT83895',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara',
 'odometer': 67210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-11-30',
 'seller_name': None,
 'title': 'Citroen Xsara 1.6 Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 1999}
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT83895%27 HTTP/1.1" 200 None
2026-03-30 08:02:26 [auto1.es] INFO: Saving data for MT83895: {'auction_closing_time': 1774886199.0, 'created_time': 1774555440.067076, 'last_price_update_time': 1774857746.445049}
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MT83895') HTTP/1.1" 204 0
2026-03-30 08:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bad7a467-70ab-565f-adaf-e3e6eabeac17 with identifier: BF77799
2026-03-30 08:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bad7a467-70ab-565f-adaf-e3e6eabeac17 with identifier: BF77799
2026-03-30 08:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bad7a467-70ab-565f-adaf-e3e6eabeac17 with identifier: BF77799 to the API
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:42:04Z',
 'fuel_type': 'petrol',
 'id': 'bad7a467-70ab-565f-adaf-e3e6eabeac17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF77799',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Tivoli',
 'odometer': 22904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-21',
 'seller_name': None,
 'title': 'Ssangyong Tivoli 1.2 GDI Comfort 4x2',
 'transmission': 'manual',
 'trim': 'Comfort 4x2',
 'year': 2022}
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF77799%27 HTTP/1.1" 200 None
2026-03-30 08:02:26 [auto1.es] INFO: Saving data for BF77799: {'auction_closing_time': 1774885324.0, 'created_time': 1774771266.6204, 'last_price_update_time': 1774857746.794475}
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BF77799') HTTP/1.1" 204 0
2026-03-30 08:02:26 [auto1.es] INFO: Found listing with ID: EA09271
2026-03-30 08:02:26 [auto1.es] INFO: Found listing with ID: EW06270
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW06270%27 HTTP/1.1" 200 None
2026-03-30 08:02:26 [auto1.es] INFO: Scrape type for EW06270: 2
2026-03-30 08:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b8f1b18-4898-53d7-8abf-1b74c9ecbdc5 with identifier: EW06270
2026-03-30 08:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b8f1b18-4898-53d7-8abf-1b74c9ecbdc5 with scrape type 2
2026-03-30 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b8f1b18-4898-53d7-8abf-1b74c9ecbdc5 with scrape type 2
2026-03-30 08:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0b8f1b18-4898-53d7-8abf-1b74c9ecbdc5, identifier: EW06270
2026-03-30 08:02:26 [auto1.es] INFO: Found listing with ID: FY93718
2026-03-30 08:02:26 [auto1.es] INFO: Found listing with ID: DW27115
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW27115%27 HTTP/1.1" 200 None
2026-03-30 08:02:26 [auto1.es] INFO: Scrape type for DW27115: 2
2026-03-30 08:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28a9b2f4-04ca-5786-987c-a532507748e1 with identifier: DW27115
2026-03-30 08:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a9b2f4-04ca-5786-987c-a532507748e1 with scrape type 2
2026-03-30 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28a9b2f4-04ca-5786-987c-a532507748e1 with scrape type 2
2026-03-30 08:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 28a9b2f4-04ca-5786-987c-a532507748e1, identifier: DW27115
2026-03-30 08:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0b8f1b18-4898-53d7-8abf-1b74c9ecbdc5 with identifier: EW06270
2026-03-30 08:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0b8f1b18-4898-53d7-8abf-1b74c9ecbdc5 with identifier: EW06270
2026-03-30 08:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0b8f1b18-4898-53d7-8abf-1b74c9ecbdc5 with identifier: EW06270 to the API
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:15:21Z',
 'fuel_type': 'diesel',
 'id': '0b8f1b18-4898-53d7-8abf-1b74c9ecbdc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW06270',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 150021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-30',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi Bi-Turbo Titanium 4x4',
 'transmission': 'automatic',
 'trim': 'Titanium 4x4',
 'year': 2016}
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW06270%27 HTTP/1.1" 200 None
2026-03-30 08:02:27 [auto1.es] INFO: Saving data for EW06270: {'auction_closing_time': 1774883721.0, 'created_time': 1774771271.359296, 'last_price_update_time': 1774857747.388488}
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EW06270') HTTP/1.1" 204 0
2026-03-30 08:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 28a9b2f4-04ca-5786-987c-a532507748e1 with identifier: DW27115
2026-03-30 08:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 28a9b2f4-04ca-5786-987c-a532507748e1 with identifier: DW27115
2026-03-30 08:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 28a9b2f4-04ca-5786-987c-a532507748e1 with identifier: DW27115 to the API
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:54:52Z',
 'fuel_type': 'petrol',
 'id': '28a9b2f4-04ca-5786-987c-a532507748e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW27115',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 172133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-19',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Klass BlueDrive',
 'transmission': 'manual',
 'trim': 'Klass BlueDrive',
 'year': 2015}
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW27115%27 HTTP/1.1" 200 None
2026-03-30 08:02:27 [auto1.es] INFO: Saving data for DW27115: {'auction_closing_time': 1774886092.0, 'created_time': 1773345760.133656, 'last_price_update_time': 1774857747.861602}
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DW27115') HTTP/1.1" 204 0
2026-03-30 08:02:27 [auto1.es] INFO: Found listing with ID: TW27527
2026-03-30 08:02:27 [auto1.es] INFO: Found listing with ID: GU79254
2026-03-30 08:02:27 [auto1.es] INFO: Found listing with ID: EY19176
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY19176%27 HTTP/1.1" 200 None
2026-03-30 08:02:27 [auto1.es] INFO: Scrape type for EY19176: 2
2026-03-30 08:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b721bef5-27cc-5a8c-aa6a-c5ab7a283a73 with identifier: EY19176
2026-03-30 08:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b721bef5-27cc-5a8c-aa6a-c5ab7a283a73 with scrape type 2
2026-03-30 08:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b721bef5-27cc-5a8c-aa6a-c5ab7a283a73 with scrape type 2
2026-03-30 08:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b721bef5-27cc-5a8c-aa6a-c5ab7a283a73, identifier: EY19176
2026-03-30 08:02:27 [auto1.es] INFO: Found listing with ID: ED81509
2026-03-30 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED81509%27 HTTP/1.1" 200 None
2026-03-30 08:02:28 [auto1.es] INFO: Scrape type for ED81509: 2
2026-03-30 08:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bd7d240-5238-56bd-b7b0-feed6b0c94f1 with identifier: ED81509
2026-03-30 08:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bd7d240-5238-56bd-b7b0-feed6b0c94f1 with scrape type 2
2026-03-30 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bd7d240-5238-56bd-b7b0-feed6b0c94f1 with scrape type 2
2026-03-30 08:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6bd7d240-5238-56bd-b7b0-feed6b0c94f1, identifier: ED81509
2026-03-30 08:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b721bef5-27cc-5a8c-aa6a-c5ab7a283a73 with identifier: EY19176
2026-03-30 08:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b721bef5-27cc-5a8c-aa6a-c5ab7a283a73 with identifier: EY19176
2026-03-30 08:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b721bef5-27cc-5a8c-aa6a-c5ab7a283a73 with identifier: EY19176 to the API
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:33Z',
 'fuel_type': 'diesel',
 'id': 'b721bef5-27cc-5a8c-aa6a-c5ab7a283a73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY19176',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 139645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-29',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY19176%27 HTTP/1.1" 200 None
2026-03-30 08:02:28 [auto1.es] INFO: Saving data for EY19176: {'auction_closing_time': 1774882953.0, 'created_time': 1774771275.898248, 'last_price_update_time': 1774857748.386637}
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EY19176') HTTP/1.1" 204 0
2026-03-30 08:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6bd7d240-5238-56bd-b7b0-feed6b0c94f1 with identifier: ED81509
2026-03-30 08:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6bd7d240-5238-56bd-b7b0-feed6b0c94f1 with identifier: ED81509
2026-03-30 08:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6bd7d240-5238-56bd-b7b0-feed6b0c94f1 with identifier: ED81509 to the API
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:36:58Z',
 'fuel_type': 'diesel',
 'id': '6bd7d240-5238-56bd-b7b0-feed6b0c94f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED81509',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 119383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-10',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
 'transmission': 'automatic',
 'trim': 'Super',
 'year': 2017}
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED81509%27 HTTP/1.1" 200 None
2026-03-30 08:02:28 [auto1.es] INFO: Saving data for ED81509: {'auction_closing_time': 1774885018.0, 'created_time': 1774771269.689143, 'last_price_update_time': 1774857748.689418}
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ED81509') HTTP/1.1" 204 0
2026-03-30 08:02:28 [auto1.es] INFO: Found listing with ID: FV38056
2026-03-30 08:02:28 [auto1.es] INFO: Found listing with ID: DA52344
2026-03-30 08:02:28 [auto1.es] INFO: Found listing with ID: DG19356
2026-03-30 08:02:28 [auto1.es] INFO: Found listing with ID: WA77291
2026-03-30 08:02:28 [auto1.es] INFO: Found listing with ID: HP73598
2026-03-30 08:02:28 [auto1.es] INFO: Found listing with ID: TY10266
2026-03-30 08:02:28 [auto1.es] INFO: Found listing with ID: FX89085
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX89085%27 HTTP/1.1" 200 None
2026-03-30 08:02:28 [auto1.es] INFO: Scrape type for FX89085: 2
2026-03-30 08:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 810c100b-2629-54a5-80ba-34846c0a8b01 with identifier: FX89085
2026-03-30 08:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 810c100b-2629-54a5-80ba-34846c0a8b01 with scrape type 2
2026-03-30 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 810c100b-2629-54a5-80ba-34846c0a8b01 with scrape type 2
2026-03-30 08:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 810c100b-2629-54a5-80ba-34846c0a8b01, identifier: FX89085
2026-03-30 08:02:28 [auto1.es] INFO: Found listing with ID: RZ43075
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ43075%27 HTTP/1.1" 200 None
2026-03-30 08:02:28 [auto1.es] INFO: Scrape type for RZ43075: 2
2026-03-30 08:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffce3e9d-723a-5c42-9a58-dbe98b31b5a7 with identifier: RZ43075
2026-03-30 08:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffce3e9d-723a-5c42-9a58-dbe98b31b5a7 with scrape type 2
2026-03-30 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffce3e9d-723a-5c42-9a58-dbe98b31b5a7 with scrape type 2
2026-03-30 08:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ffce3e9d-723a-5c42-9a58-dbe98b31b5a7, identifier: RZ43075
2026-03-30 08:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 810c100b-2629-54a5-80ba-34846c0a8b01 with identifier: FX89085
2026-03-30 08:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 810c100b-2629-54a5-80ba-34846c0a8b01 with identifier: FX89085
2026-03-30 08:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 810c100b-2629-54a5-80ba-34846c0a8b01 with identifier: FX89085 to the API
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:14:15Z',
 'fuel_type': 'diesel',
 'id': '810c100b-2629-54a5-80ba-34846c0a8b01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX89085',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 133064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-22',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Drive 4x2',
 'transmission': 'manual',
 'trim': 'Drive 4x2',
 'year': 2014}
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX89085%27 HTTP/1.1" 200 None
2026-03-30 08:02:29 [auto1.es] INFO: Saving data for FX89085: {'auction_closing_time': 1774883655.0, 'created_time': 1773777732.893472, 'last_price_update_time': 1774857749.278441}
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FX89085') HTTP/1.1" 204 0
2026-03-30 08:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ffce3e9d-723a-5c42-9a58-dbe98b31b5a7 with identifier: RZ43075
2026-03-30 08:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ffce3e9d-723a-5c42-9a58-dbe98b31b5a7 with identifier: RZ43075
2026-03-30 08:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ffce3e9d-723a-5c42-9a58-dbe98b31b5a7 with identifier: RZ43075 to the API
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:51:14Z',
 'fuel_type': 'diesel',
 'id': 'ffce3e9d-723a-5c42-9a58-dbe98b31b5a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ43075',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 90678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2021}
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ43075%27 HTTP/1.1" 200 None
2026-03-30 08:02:29 [auto1.es] INFO: Saving data for RZ43075: {'auction_closing_time': 1774885874.0, 'created_time': 1774771274.190946, 'last_price_update_time': 1774857749.678113}
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RZ43075') HTTP/1.1" 204 0
2026-03-30 08:02:29 [auto1.es] INFO: Found listing with ID: SE47115
2026-03-30 08:02:29 [auto1.es] INFO: Found listing with ID: DR86630
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR86630%27 HTTP/1.1" 200 None
2026-03-30 08:02:29 [auto1.es] INFO: Scrape type for DR86630: 2
2026-03-30 08:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 195e33b3-7d85-502f-a86f-4d03683d9578 with identifier: DR86630
2026-03-30 08:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 195e33b3-7d85-502f-a86f-4d03683d9578 with scrape type 2
2026-03-30 08:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 195e33b3-7d85-502f-a86f-4d03683d9578 with scrape type 2
2026-03-30 08:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 195e33b3-7d85-502f-a86f-4d03683d9578, identifier: DR86630
2026-03-30 08:02:29 [auto1.es] INFO: Found listing with ID: RK31949
2026-03-30 08:02:29 [auto1.es] INFO: Found listing with ID: JJ21664
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ21664%27 HTTP/1.1" 200 None
2026-03-30 08:02:29 [auto1.es] INFO: Scrape type for JJ21664: 2
2026-03-30 08:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7744156b-9984-5700-952e-bc85d85ff2b2 with identifier: JJ21664
2026-03-30 08:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7744156b-9984-5700-952e-bc85d85ff2b2 with scrape type 2
2026-03-30 08:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7744156b-9984-5700-952e-bc85d85ff2b2 with scrape type 2
2026-03-30 08:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7744156b-9984-5700-952e-bc85d85ff2b2, identifier: JJ21664
2026-03-30 08:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 195e33b3-7d85-502f-a86f-4d03683d9578 with identifier: DR86630
2026-03-30 08:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 195e33b3-7d85-502f-a86f-4d03683d9578 with identifier: DR86630
2026-03-30 08:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 195e33b3-7d85-502f-a86f-4d03683d9578 with identifier: DR86630 to the API
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:00Z',
 'fuel_type': 'diesel',
 'id': '195e33b3-7d85-502f-a86f-4d03683d9578',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR86630',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Korando',
 'odometer': 117225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-23',
 'seller_name': None,
 'title': 'Ssangyong Korando 2.0 TD C 4x2',
 'transmission': 'manual',
 'trim': 'C 4x2',
 'year': 2014}
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR86630%27 HTTP/1.1" 200 None
2026-03-30 08:02:30 [auto1.es] INFO: Saving data for DR86630: {'auction_closing_time': 1774885620.0, 'created_time': 1774771274.913669, 'last_price_update_time': 1774857750.231434}
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DR86630') HTTP/1.1" 204 0
2026-03-30 08:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7744156b-9984-5700-952e-bc85d85ff2b2 with identifier: JJ21664
2026-03-30 08:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7744156b-9984-5700-952e-bc85d85ff2b2 with identifier: JJ21664
2026-03-30 08:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7744156b-9984-5700-952e-bc85d85ff2b2 with identifier: JJ21664 to the API
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:26:53Z',
 'fuel_type': 'diesel',
 'id': '7744156b-9984-5700-952e-bc85d85ff2b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ21664',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 88421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-05',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 CRDi Mild-Hybrid Motion',
 'transmission': 'manual',
 'trim': 'Motion',
 'year': 2021}
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ21664%27 HTTP/1.1" 200 None
2026-03-30 08:02:30 [auto1.es] INFO: Saving data for JJ21664: {'auction_closing_time': 1774884413.0, 'created_time': 1774771276.276564, 'last_price_update_time': 1774857750.513789}
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JJ21664') HTTP/1.1" 204 0
2026-03-30 08:02:30 [auto1.es] INFO: Found listing with ID: ZR58264
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR58264%27 HTTP/1.1" 200 None
2026-03-30 08:02:30 [auto1.es] INFO: Scrape type for ZR58264: 2
2026-03-30 08:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ed744c-e5ed-5244-a243-e965a24ef828 with identifier: ZR58264
2026-03-30 08:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ed744c-e5ed-5244-a243-e965a24ef828 with scrape type 2
2026-03-30 08:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7ed744c-e5ed-5244-a243-e965a24ef828 with scrape type 2
2026-03-30 08:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7ed744c-e5ed-5244-a243-e965a24ef828, identifier: ZR58264
2026-03-30 08:02:30 [auto1.es] INFO: Found listing with ID: DA42101
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA42101%27 HTTP/1.1" 200 None
2026-03-30 08:02:30 [auto1.es] INFO: Scrape type for DA42101: 2
2026-03-30 08:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90aa4266-536a-56e7-8e79-dea6d4305fc7 with identifier: DA42101
2026-03-30 08:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90aa4266-536a-56e7-8e79-dea6d4305fc7 with scrape type 2
2026-03-30 08:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90aa4266-536a-56e7-8e79-dea6d4305fc7 with scrape type 2
2026-03-30 08:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 90aa4266-536a-56e7-8e79-dea6d4305fc7, identifier: DA42101
2026-03-30 08:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7ed744c-e5ed-5244-a243-e965a24ef828 with identifier: ZR58264
2026-03-30 08:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7ed744c-e5ed-5244-a243-e965a24ef828 with identifier: ZR58264
2026-03-30 08:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e7ed744c-e5ed-5244-a243-e965a24ef828 with identifier: ZR58264 to the API
2026-03-30 08:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:40Z',
 'fuel_type': 'petrol',
 'id': 'e7ed744c-e5ed-5244-a243-e965a24ef828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR58264',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 59686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seller_name': None,
 'title': 'Seat Leon 1.5 eTSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2020}
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR58264%27 HTTP/1.1" 200 None
2026-03-30 08:02:31 [auto1.es] INFO: Saving data for ZR58264: {'auction_closing_time': 1774886260.0, 'created_time': 1772627895.412677, 'last_price_update_time': 1774857751.454085}
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZR58264') HTTP/1.1" 204 0
2026-03-30 08:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 90aa4266-536a-56e7-8e79-dea6d4305fc7 with identifier: DA42101
2026-03-30 08:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 90aa4266-536a-56e7-8e79-dea6d4305fc7 with identifier: DA42101
2026-03-30 08:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 90aa4266-536a-56e7-8e79-dea6d4305fc7 with identifier: DA42101 to the API
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:38:27Z',
 'fuel_type': 'petrol',
 'id': '90aa4266-536a-56e7-8e79-dea6d4305fc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA42101',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 97857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2016}
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA42101%27 HTTP/1.1" 200 None
2026-03-30 08:02:31 [auto1.es] INFO: Saving data for DA42101: {'auction_closing_time': 1774885107.0, 'created_time': 1774771270.852246, 'last_price_update_time': 1774857751.886624}
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DA42101') HTTP/1.1" 204 0
2026-03-30 08:02:31 [auto1.es] INFO: Found listing with ID: CU50273
2026-03-30 08:02:31 [auto1.es] INFO: Found listing with ID: YG41867
2026-03-30 08:02:31 [auto1.es] INFO: Found listing with ID: JN05964
2026-03-30 08:02:31 [auto1.es] INFO: Found listing with ID: FM76074
2026-03-30 08:02:31 [auto1.es] INFO: Found listing with ID: ZN83644
2026-03-30 08:02:31 [auto1.es] INFO: Found listing with ID: RR71682
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR71682%27 HTTP/1.1" 200 None
2026-03-30 08:02:31 [auto1.es] INFO: Scrape type for RR71682: 2
2026-03-30 08:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86319cfe-9ec4-5004-8b5e-2194b84cf69b with identifier: RR71682
2026-03-30 08:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86319cfe-9ec4-5004-8b5e-2194b84cf69b with scrape type 2
2026-03-30 08:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86319cfe-9ec4-5004-8b5e-2194b84cf69b with scrape type 2
2026-03-30 08:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 86319cfe-9ec4-5004-8b5e-2194b84cf69b, identifier: RR71682
2026-03-30 08:02:32 [auto1.es] INFO: Found listing with ID: BA69170
2026-03-30 08:02:32 [auto1.es] INFO: Found listing with ID: MV61216
2026-03-30 08:02:32 [auto1.es] INFO: Found listing with ID: GK85431
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK85431%27 HTTP/1.1" 200 None
2026-03-30 08:02:32 [auto1.es] INFO: Scrape type for GK85431: 2
2026-03-30 08:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31843a4e-25ce-57ca-8a7a-5bba77ebb3f3 with identifier: GK85431
2026-03-30 08:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31843a4e-25ce-57ca-8a7a-5bba77ebb3f3 with scrape type 2
2026-03-30 08:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31843a4e-25ce-57ca-8a7a-5bba77ebb3f3 with scrape type 2
2026-03-30 08:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 31843a4e-25ce-57ca-8a7a-5bba77ebb3f3, identifier: GK85431
2026-03-30 08:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 86319cfe-9ec4-5004-8b5e-2194b84cf69b with identifier: RR71682
2026-03-30 08:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 86319cfe-9ec4-5004-8b5e-2194b84cf69b with identifier: RR71682
2026-03-30 08:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 86319cfe-9ec4-5004-8b5e-2194b84cf69b with identifier: RR71682 to the API
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:32Z',
 'fuel_type': 'diesel',
 'id': '86319cfe-9ec4-5004-8b5e-2194b84cf69b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR71682',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 203366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-15',
 'seller_name': None,
 'title': 'BMW 4er 418d Gran Coupé',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR71682%27 HTTP/1.1" 200 None
2026-03-30 08:02:32 [auto1.es] INFO: Saving data for RR71682: {'auction_closing_time': 1774885412.0, 'created_time': 1773127123.208704, 'last_price_update_time': 1774857752.449112}
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RR71682') HTTP/1.1" 204 0
2026-03-30 08:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 31843a4e-25ce-57ca-8a7a-5bba77ebb3f3 with identifier: GK85431
2026-03-30 08:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 31843a4e-25ce-57ca-8a7a-5bba77ebb3f3 with identifier: GK85431
2026-03-30 08:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 31843a4e-25ce-57ca-8a7a-5bba77ebb3f3 with identifier: GK85431 to the API
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:39:44Z',
 'fuel_type': 'hybrid',
 'id': '31843a4e-25ce-57ca-8a7a-5bba77ebb3f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK85431',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 74501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
 'transmission': 'automatic',
 'trim': '4 300 GT',
 'year': 2022}
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK85431%27 HTTP/1.1" 200 None
2026-03-30 08:02:32 [auto1.es] INFO: Saving data for GK85431: {'auction_closing_time': 1774885184.0, 'created_time': 1774771267.052882, 'last_price_update_time': 1774857752.904838}
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GK85431') HTTP/1.1" 204 0
2026-03-30 08:02:32 [auto1.es] INFO: Found listing with ID: KT37897
2026-03-30 08:02:32 [auto1.es] INFO: Found listing with ID: UH51284
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH51284%27 HTTP/1.1" 200 None
2026-03-30 08:02:32 [auto1.es] INFO: Scrape type for UH51284: 2
2026-03-30 08:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8022da0d-7214-5740-8de4-8ae992753773 with identifier: UH51284
2026-03-30 08:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8022da0d-7214-5740-8de4-8ae992753773 with scrape type 2
2026-03-30 08:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8022da0d-7214-5740-8de4-8ae992753773 with scrape type 2
2026-03-30 08:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8022da0d-7214-5740-8de4-8ae992753773, identifier: UH51284
2026-03-30 08:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:33 [auto1.es] INFO: Found listing with ID: EX41974
2026-03-30 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX41974%27 HTTP/1.1" 200 None
2026-03-30 08:02:33 [auto1.es] INFO: Scrape type for EX41974: 2
2026-03-30 08:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d31de814-b8f0-5d34-91e8-9911e1c8c7c6 with identifier: EX41974
2026-03-30 08:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d31de814-b8f0-5d34-91e8-9911e1c8c7c6 with scrape type 2
2026-03-30 08:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d31de814-b8f0-5d34-91e8-9911e1c8c7c6 with scrape type 2
2026-03-30 08:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d31de814-b8f0-5d34-91e8-9911e1c8c7c6, identifier: EX41974
2026-03-30 08:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8022da0d-7214-5740-8de4-8ae992753773 with identifier: UH51284
2026-03-30 08:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8022da0d-7214-5740-8de4-8ae992753773 with identifier: UH51284
2026-03-30 08:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8022da0d-7214-5740-8de4-8ae992753773 with identifier: UH51284 to the API
2026-03-30 08:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:09:18Z',
 'fuel_type': 'diesel',
 'id': '8022da0d-7214-5740-8de4-8ae992753773',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH51284',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 158177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2018}
2026-03-30 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH51284%27 HTTP/1.1" 200 None
2026-03-30 08:02:33 [auto1.es] INFO: Saving data for UH51284: {'auction_closing_time': 1774883358.0, 'created_time': 1774015576.680278, 'last_price_update_time': 1774857753.446615}
2026-03-30 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UH51284') HTTP/1.1" 204 0
2026-03-30 08:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d31de814-b8f0-5d34-91e8-9911e1c8c7c6 with identifier: EX41974
2026-03-30 08:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d31de814-b8f0-5d34-91e8-9911e1c8c7c6 with identifier: EX41974
2026-03-30 08:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d31de814-b8f0-5d34-91e8-9911e1c8c7c6 with identifier: EX41974 to the API
2026-03-30 08:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:53:34Z',
 'fuel_type': 'diesel',
 'id': 'd31de814-b8f0-5d34-91e8-9911e1c8c7c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX41974',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 129725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2021}
2026-03-30 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX41974%27 HTTP/1.1" 200 None
2026-03-30 08:02:34 [auto1.es] INFO: Saving data for EX41974: {'auction_closing_time': 1774886014.0, 'created_time': 1773986470.274896, 'last_price_update_time': 1774857754.281819}
2026-03-30 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EX41974') HTTP/1.1" 204 0
2026-03-30 08:02:34 [auto1.es] INFO: Found listing with ID: BR06094
2026-03-30 08:02:34 [auto1.es] INFO: Found listing with ID: XV67448
2026-03-30 08:02:34 [auto1.es] INFO: Found listing with ID: DM90018
2026-03-30 08:02:34 [auto1.es] INFO: Found listing with ID: JS89296
2026-03-30 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS89296%27 HTTP/1.1" 200 None
2026-03-30 08:02:34 [auto1.es] INFO: Scrape type for JS89296: 2
2026-03-30 08:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b31cdc96-2b46-58dc-bc70-4334e57c2bbb with identifier: JS89296
2026-03-30 08:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b31cdc96-2b46-58dc-bc70-4334e57c2bbb with scrape type 2
2026-03-30 08:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b31cdc96-2b46-58dc-bc70-4334e57c2bbb with scrape type 2
2026-03-30 08:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b31cdc96-2b46-58dc-bc70-4334e57c2bbb, identifier: JS89296
2026-03-30 08:02:34 [auto1.es] INFO: Found listing with ID: AV79521
2026-03-30 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV79521%27 HTTP/1.1" 200 None
2026-03-30 08:02:34 [auto1.es] INFO: Scrape type for AV79521: 2
2026-03-30 08:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff67f56c-674f-5f13-8ca3-43f3f2a1c295 with identifier: AV79521
2026-03-30 08:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff67f56c-674f-5f13-8ca3-43f3f2a1c295 with scrape type 2
2026-03-30 08:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff67f56c-674f-5f13-8ca3-43f3f2a1c295 with scrape type 2
2026-03-30 08:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ff67f56c-674f-5f13-8ca3-43f3f2a1c295, identifier: AV79521
2026-03-30 08:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b31cdc96-2b46-58dc-bc70-4334e57c2bbb with identifier: JS89296
2026-03-30 08:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b31cdc96-2b46-58dc-bc70-4334e57c2bbb with identifier: JS89296
2026-03-30 08:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b31cdc96-2b46-58dc-bc70-4334e57c2bbb with identifier: JS89296 to the API
2026-03-30 08:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:32:37Z',
 'fuel_type': 'diesel',
 'id': 'b31cdc96-2b46-58dc-bc70-4334e57c2bbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS89296',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 278741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-19',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS89296%27 HTTP/1.1" 200 None
2026-03-30 08:02:35 [auto1.es] INFO: Saving data for JS89296: {'auction_closing_time': 1774884757.0, 'created_time': 1773126747.902306, 'last_price_update_time': 1774857755.054321}
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JS89296') HTTP/1.1" 204 0
2026-03-30 08:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ff67f56c-674f-5f13-8ca3-43f3f2a1c295 with identifier: AV79521
2026-03-30 08:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ff67f56c-674f-5f13-8ca3-43f3f2a1c295 with identifier: AV79521
2026-03-30 08:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ff67f56c-674f-5f13-8ca3-43f3f2a1c295 with identifier: AV79521 to the API
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:50:44Z',
 'fuel_type': 'petrol',
 'id': 'ff67f56c-674f-5f13-8ca3-43f3f2a1c295',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV79521',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 10126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-27',
 'seller_name': None,
 'title': 'Fiat 500 1.2 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2018}
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV79521%27 HTTP/1.1" 200 None
2026-03-30 08:02:35 [auto1.es] INFO: Saving data for AV79521: {'auction_closing_time': 1774885844.0, 'created_time': 1774771273.363445, 'last_price_update_time': 1774857755.36555}
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AV79521') HTTP/1.1" 204 0
2026-03-30 08:02:35 [auto1.es] INFO: Found listing with ID: FK22292
2026-03-30 08:02:35 [auto1.es] INFO: Found listing with ID: XH26332
2026-03-30 08:02:35 [auto1.es] INFO: Found listing with ID: HG08189
2026-03-30 08:02:35 [auto1.es] INFO: Found listing with ID: BU83574
2026-03-30 08:02:35 [auto1.es] INFO: Found listing with ID: JH71842
2026-03-30 08:02:35 [auto1.es] INFO: Found listing with ID: WV17945
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV17945%27 HTTP/1.1" 200 None
2026-03-30 08:02:35 [auto1.es] INFO: Scrape type for WV17945: 2
2026-03-30 08:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b7dcc5e-b77a-59de-a5a9-4b2b8461e3f7 with identifier: WV17945
2026-03-30 08:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b7dcc5e-b77a-59de-a5a9-4b2b8461e3f7 with scrape type 2
2026-03-30 08:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b7dcc5e-b77a-59de-a5a9-4b2b8461e3f7 with scrape type 2
2026-03-30 08:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7b7dcc5e-b77a-59de-a5a9-4b2b8461e3f7, identifier: WV17945
2026-03-30 08:02:35 [auto1.es] INFO: Channel: 24h | Page: 18 | totalHits: 2178 | hits on page: 40
2026-03-30 08:02:35 [auto1.es] INFO: Found listing with ID: LR65108
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR65108%27 HTTP/1.1" 200 None
2026-03-30 08:02:35 [auto1.es] INFO: Scrape type for LR65108: 2
2026-03-30 08:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db66d988-ad13-52e0-841f-f6604ef104b9 with identifier: LR65108
2026-03-30 08:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db66d988-ad13-52e0-841f-f6604ef104b9 with scrape type 2
2026-03-30 08:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db66d988-ad13-52e0-841f-f6604ef104b9 with scrape type 2
2026-03-30 08:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: db66d988-ad13-52e0-841f-f6604ef104b9, identifier: LR65108
2026-03-30 08:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7b7dcc5e-b77a-59de-a5a9-4b2b8461e3f7 with identifier: WV17945
2026-03-30 08:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7b7dcc5e-b77a-59de-a5a9-4b2b8461e3f7 with identifier: WV17945
2026-03-30 08:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7b7dcc5e-b77a-59de-a5a9-4b2b8461e3f7 with identifier: WV17945 to the API
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:43:44Z',
 'fuel_type': 'petrol',
 'id': '7b7dcc5e-b77a-59de-a5a9-4b2b8461e3f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV17945',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 90325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-26',
 'seller_name': None,
 'title': 'Peugeot 307 1.6 SW',
 'transmission': 'manual',
 'trim': 'SW',
 'year': 2005}
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV17945%27 HTTP/1.1" 200 None
2026-03-30 08:02:35 [auto1.es] INFO: Saving data for WV17945: {'auction_closing_time': 1774885424.0, 'created_time': 1773128463.688433, 'last_price_update_time': 1774857755.957063}
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WV17945') HTTP/1.1" 204 0
2026-03-30 08:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: db66d988-ad13-52e0-841f-f6604ef104b9 with identifier: LR65108
2026-03-30 08:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: db66d988-ad13-52e0-841f-f6604ef104b9 with identifier: LR65108
2026-03-30 08:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: db66d988-ad13-52e0-841f-f6604ef104b9 with identifier: LR65108 to the API
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:18:00Z',
 'fuel_type': 'diesel',
 'id': 'db66d988-ad13-52e0-841f-f6604ef104b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR65108',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce City Verso',
 'odometer': 189353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seller_name': None,
 'title': 'Toyota ProAce City Verso 1.5 D-4D L1 Combi',
 'transmission': 'manual',
 'trim': 'L1 Combi',
 'year': 2022}
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR65108%27 HTTP/1.1" 200 None
2026-03-30 08:02:36 [auto1.es] INFO: Saving data for LR65108: {'auction_closing_time': 1774883880.0, 'created_time': 1774771299.116186, 'last_price_update_time': 1774857756.348718}
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LR65108') HTTP/1.1" 204 0
2026-03-30 08:02:36 [auto1.es] INFO: Found listing with ID: DT10330
2026-03-30 08:02:36 [auto1.es] INFO: Found listing with ID: SH03418
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH03418%27 HTTP/1.1" 200 None
2026-03-30 08:02:36 [auto1.es] INFO: Scrape type for SH03418: 2
2026-03-30 08:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f1baa01-0f97-53dc-b808-762fb3ec4e01 with identifier: SH03418
2026-03-30 08:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01 with scrape type 2
2026-03-30 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01 with scrape type 2
2026-03-30 08:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f1baa01-0f97-53dc-b808-762fb3ec4e01, identifier: SH03418
2026-03-30 08:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f1baa01-0f97-53dc-b808-762fb3ec4e01 with identifier: SH03418
2026-03-30 08:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f1baa01-0f97-53dc-b808-762fb3ec4e01 with identifier: SH03418
2026-03-30 08:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f1baa01-0f97-53dc-b808-762fb3ec4e01 with identifier: SH03418 to the API
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:20:39Z',
 'fuel_type': 'hybrid',
 'id': '7f1baa01-0f97-53dc-b808-762fb3ec4e01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH03418',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 28300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-15',
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Active Tech',
 'transmission': 'automatic',
 'trim': '2WD Active Tech',
 'year': 2023}
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH03418%27 HTTP/1.1" 200 None
2026-03-30 08:02:36 [auto1.es] INFO: Saving data for SH03418: {'auction_closing_time': 1774884039.0, 'created_time': 1773129473.877584, 'last_price_update_time': 1774857756.859148}
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SH03418') HTTP/1.1" 204 0
2026-03-30 08:02:36 [auto1.es] INFO: Found listing with ID: BS83179
2026-03-30 08:02:36 [auto1.es] INFO: Found listing with ID: UP80890
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP80890%27 HTTP/1.1" 200 None
2026-03-30 08:02:36 [auto1.es] INFO: Scrape type for UP80890: 2
2026-03-30 08:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9140ebc1-972e-5362-9a67-f66e69258c0d with identifier: UP80890
2026-03-30 08:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9140ebc1-972e-5362-9a67-f66e69258c0d with scrape type 2
2026-03-30 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9140ebc1-972e-5362-9a67-f66e69258c0d with scrape type 2
2026-03-30 08:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9140ebc1-972e-5362-9a67-f66e69258c0d, identifier: UP80890
2026-03-30 08:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9140ebc1-972e-5362-9a67-f66e69258c0d with identifier: UP80890
2026-03-30 08:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9140ebc1-972e-5362-9a67-f66e69258c0d with identifier: UP80890
2026-03-30 08:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9140ebc1-972e-5362-9a67-f66e69258c0d with identifier: UP80890 to the API
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:44:58Z',
 'fuel_type': 'diesel',
 'id': '9140ebc1-972e-5362-9a67-f66e69258c0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP80890',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 284263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2020}
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP80890%27 HTTP/1.1" 200 None
2026-03-30 08:02:37 [auto1.es] INFO: Saving data for UP80890: {'auction_closing_time': 1774885498.0, 'created_time': 1773127258.071638, 'last_price_update_time': 1774857757.279676}
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UP80890') HTTP/1.1" 204 0
2026-03-30 08:02:37 [auto1.es] INFO: Found listing with ID: DG65204
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG65204%27 HTTP/1.1" 200 None
2026-03-30 08:02:37 [auto1.es] INFO: Scrape type for DG65204: 2
2026-03-30 08:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a34c01f2-4fd1-50b0-9293-123def9bb6f3 with identifier: DG65204
2026-03-30 08:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a34c01f2-4fd1-50b0-9293-123def9bb6f3 with scrape type 2
2026-03-30 08:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a34c01f2-4fd1-50b0-9293-123def9bb6f3 with scrape type 2
2026-03-30 08:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a34c01f2-4fd1-50b0-9293-123def9bb6f3, identifier: DG65204
2026-03-30 08:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a34c01f2-4fd1-50b0-9293-123def9bb6f3 with identifier: DG65204
2026-03-30 08:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a34c01f2-4fd1-50b0-9293-123def9bb6f3 with identifier: DG65204
2026-03-30 08:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a34c01f2-4fd1-50b0-9293-123def9bb6f3 with identifier: DG65204 to the API
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:07Z',
 'fuel_type': 'diesel',
 'id': 'a34c01f2-4fd1-50b0-9293-123def9bb6f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG65204',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 99640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG65204%27 HTTP/1.1" 200 None
2026-03-30 08:02:37 [auto1.es] INFO: Saving data for DG65204: {'auction_closing_time': 1774884847.0, 'created_time': 1773129001.865942, 'last_price_update_time': 1774857757.850442}
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DG65204') HTTP/1.1" 204 0
2026-03-30 08:02:37 [auto1.es] INFO: Found listing with ID: WN13849
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN13849%27 HTTP/1.1" 200 None
2026-03-30 08:02:37 [auto1.es] INFO: Scrape type for WN13849: 2
2026-03-30 08:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f84ffa3b-8282-526b-8431-496dd8a307cf with identifier: WN13849
2026-03-30 08:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f84ffa3b-8282-526b-8431-496dd8a307cf with scrape type 2
2026-03-30 08:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f84ffa3b-8282-526b-8431-496dd8a307cf with scrape type 2
2026-03-30 08:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f84ffa3b-8282-526b-8431-496dd8a307cf, identifier: WN13849
2026-03-30 08:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f84ffa3b-8282-526b-8431-496dd8a307cf with identifier: WN13849
2026-03-30 08:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f84ffa3b-8282-526b-8431-496dd8a307cf with identifier: WN13849
2026-03-30 08:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f84ffa3b-8282-526b-8431-496dd8a307cf with identifier: WN13849 to the API
2026-03-30 08:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:01:37Z',
 'fuel_type': 'diesel',
 'id': 'f84ffa3b-8282-526b-8431-496dd8a307cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN13849',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 91061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-02',
 'seller_name': None,
 'title': 'Mazda 5 1.6 CD Diesel Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2012}
2026-03-30 08:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN13849%27 HTTP/1.1" 200 None
2026-03-30 08:02:38 [auto1.es] INFO: Saving data for WN13849: {'auction_closing_time': 1774882897.0, 'created_time': 1774771278.293967, 'last_price_update_time': 1774857758.558323}
2026-03-30 08:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WN13849') HTTP/1.1" 204 0
2026-03-30 08:02:38 [auto1.es] INFO: Found listing with ID: GD28297
2026-03-30 08:02:38 [auto1.es] INFO: Found listing with ID: PK59036
2026-03-30 08:02:38 [auto1.es] INFO: Found listing with ID: SL79064
2026-03-30 08:02:38 [auto1.es] INFO: Found listing with ID: UB76587
2026-03-30 08:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB76587%27 HTTP/1.1" 200 None
2026-03-30 08:02:38 [auto1.es] INFO: Scrape type for UB76587: 2
2026-03-30 08:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc149fb9-cd17-5131-93f7-8aa5b63bdc2e with identifier: UB76587
2026-03-30 08:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc149fb9-cd17-5131-93f7-8aa5b63bdc2e with scrape type 2
2026-03-30 08:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc149fb9-cd17-5131-93f7-8aa5b63bdc2e with scrape type 2
2026-03-30 08:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc149fb9-cd17-5131-93f7-8aa5b63bdc2e, identifier: UB76587
2026-03-30 08:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc149fb9-cd17-5131-93f7-8aa5b63bdc2e with identifier: UB76587
2026-03-30 08:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc149fb9-cd17-5131-93f7-8aa5b63bdc2e with identifier: UB76587
2026-03-30 08:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc149fb9-cd17-5131-93f7-8aa5b63bdc2e with identifier: UB76587 to the API
2026-03-30 08:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:12:49Z',
 'fuel_type': 'diesel',
 'id': 'dc149fb9-cd17-5131-93f7-8aa5b63bdc2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB76587',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 160092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-22',
 'seller_name': None,
 'title': 'Porsche Cayenne Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB76587%27 HTTP/1.1" 200 None
2026-03-30 08:02:39 [auto1.es] INFO: Saving data for UB76587: {'auction_closing_time': 1774883569.0, 'created_time': 1773128931.951776, 'last_price_update_time': 1774857759.015074}
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UB76587') HTTP/1.1" 204 0
2026-03-30 08:02:39 [auto1.es] INFO: Found listing with ID: XD48344
2026-03-30 08:02:39 [auto1.es] INFO: Found listing with ID: UV16090
2026-03-30 08:02:39 [auto1.es] INFO: Found listing with ID: WL36526
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL36526%27 HTTP/1.1" 200 None
2026-03-30 08:02:39 [auto1.es] INFO: Scrape type for WL36526: 2
2026-03-30 08:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e1f5b29-5ef3-5be5-83a9-c77d34ceaea6 with identifier: WL36526
2026-03-30 08:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e1f5b29-5ef3-5be5-83a9-c77d34ceaea6 with scrape type 2
2026-03-30 08:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e1f5b29-5ef3-5be5-83a9-c77d34ceaea6 with scrape type 2
2026-03-30 08:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4e1f5b29-5ef3-5be5-83a9-c77d34ceaea6, identifier: WL36526
2026-03-30 08:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4e1f5b29-5ef3-5be5-83a9-c77d34ceaea6 with identifier: WL36526
2026-03-30 08:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4e1f5b29-5ef3-5be5-83a9-c77d34ceaea6 with identifier: WL36526
2026-03-30 08:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4e1f5b29-5ef3-5be5-83a9-c77d34ceaea6 with identifier: WL36526 to the API
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:53Z',
 'fuel_type': 'petrol',
 'id': '4e1f5b29-5ef3-5be5-83a9-c77d34ceaea6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL36526',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 68214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-25',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL36526%27 HTTP/1.1" 200 None
2026-03-30 08:02:39 [auto1.es] INFO: Saving data for WL36526: {'auction_closing_time': 1774884893.0, 'created_time': 1774771280.980312, 'last_price_update_time': 1774857759.518867}
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WL36526') HTTP/1.1" 204 0
2026-03-30 08:02:39 [auto1.es] INFO: Found listing with ID: AU46465
2026-03-30 08:02:39 [auto1.es] INFO: Found listing with ID: XK54532
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK54532%27 HTTP/1.1" 200 None
2026-03-30 08:02:39 [auto1.es] INFO: Scrape type for XK54532: 2
2026-03-30 08:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75f5cfa4-6d74-5ee9-83da-7a883574736b with identifier: XK54532
2026-03-30 08:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75f5cfa4-6d74-5ee9-83da-7a883574736b with scrape type 2
2026-03-30 08:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75f5cfa4-6d74-5ee9-83da-7a883574736b with scrape type 2
2026-03-30 08:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75f5cfa4-6d74-5ee9-83da-7a883574736b, identifier: XK54532
2026-03-30 08:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75f5cfa4-6d74-5ee9-83da-7a883574736b with identifier: XK54532
2026-03-30 08:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75f5cfa4-6d74-5ee9-83da-7a883574736b with identifier: XK54532
2026-03-30 08:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 75f5cfa4-6d74-5ee9-83da-7a883574736b with identifier: XK54532 to the API
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:58:52Z',
 'fuel_type': 'petrol',
 'id': '75f5cfa4-6d74-5ee9-83da-7a883574736b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK54532',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 139296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-17',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2013}
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK54532%27 HTTP/1.1" 200 None
2026-03-30 08:02:40 [auto1.es] INFO: Saving data for XK54532: {'auction_closing_time': 1774886332.0, 'created_time': 1773132255.697207, 'last_price_update_time': 1774857760.083189}
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XK54532') HTTP/1.1" 204 0
2026-03-30 08:02:40 [auto1.es] INFO: Found listing with ID: PZ76479
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ76479%27 HTTP/1.1" 200 None
2026-03-30 08:02:40 [auto1.es] INFO: Scrape type for PZ76479: 2
2026-03-30 08:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2313921a-65d6-52b9-941b-5f9deb8f0dc4 with identifier: PZ76479
2026-03-30 08:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2313921a-65d6-52b9-941b-5f9deb8f0dc4 with scrape type 2
2026-03-30 08:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2313921a-65d6-52b9-941b-5f9deb8f0dc4 with scrape type 2
2026-03-30 08:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2313921a-65d6-52b9-941b-5f9deb8f0dc4, identifier: PZ76479
2026-03-30 08:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2313921a-65d6-52b9-941b-5f9deb8f0dc4 with identifier: PZ76479
2026-03-30 08:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2313921a-65d6-52b9-941b-5f9deb8f0dc4 with identifier: PZ76479
2026-03-30 08:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2313921a-65d6-52b9-941b-5f9deb8f0dc4 with identifier: PZ76479 to the API
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:01:16Z',
 'fuel_type': 'diesel',
 'id': '2313921a-65d6-52b9-941b-5f9deb8f0dc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ76479',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 136092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-21',
 'seller_name': None,
 'title': 'Jeep Renegade 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2016}
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ76479%27 HTTP/1.1" 200 None
2026-03-30 08:02:40 [auto1.es] INFO: Saving data for PZ76479: {'auction_closing_time': 1774882876.0, 'created_time': 1774771278.659351, 'last_price_update_time': 1774857760.548907}
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PZ76479') HTTP/1.1" 204 0
2026-03-30 08:02:40 [auto1.es] INFO: Found listing with ID: LD13903
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD13903%27 HTTP/1.1" 200 None
2026-03-30 08:02:40 [auto1.es] INFO: Scrape type for LD13903: 2
2026-03-30 08:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5af75a71-c4ec-5e35-845f-964f3c9322a7 with identifier: LD13903
2026-03-30 08:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af75a71-c4ec-5e35-845f-964f3c9322a7 with scrape type 2
2026-03-30 08:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5af75a71-c4ec-5e35-845f-964f3c9322a7 with scrape type 2
2026-03-30 08:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5af75a71-c4ec-5e35-845f-964f3c9322a7, identifier: LD13903
2026-03-30 08:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5af75a71-c4ec-5e35-845f-964f3c9322a7 with identifier: LD13903
2026-03-30 08:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5af75a71-c4ec-5e35-845f-964f3c9322a7 with identifier: LD13903
2026-03-30 08:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5af75a71-c4ec-5e35-845f-964f3c9322a7 with identifier: LD13903 to the API
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:18:20Z',
 'fuel_type': 'petrol',
 'id': '5af75a71-c4ec-5e35-845f-964f3c9322a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD13903',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 28988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-26',
 'seller_name': None,
 'title': "Kia cee'd 1.5 TGDI Mild-Hybrid GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2023}
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD13903%27 HTTP/1.1" 200 None
2026-03-30 08:02:40 [auto1.es] INFO: Saving data for LD13903: {'auction_closing_time': 1774883900.0, 'created_time': 1773228031.949836, 'last_price_update_time': 1774857760.983162}
2026-03-30 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LD13903') HTTP/1.1" 204 0
2026-03-30 08:02:41 [auto1.es] INFO: Found listing with ID: HR86968
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR86968%27 HTTP/1.1" 200 None
2026-03-30 08:02:41 [auto1.es] INFO: Scrape type for HR86968: 2
2026-03-30 08:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce022a48-15c2-5ae6-9cf4-64f4e0293b9d with identifier: HR86968
2026-03-30 08:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce022a48-15c2-5ae6-9cf4-64f4e0293b9d with scrape type 2
2026-03-30 08:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce022a48-15c2-5ae6-9cf4-64f4e0293b9d with scrape type 2
2026-03-30 08:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce022a48-15c2-5ae6-9cf4-64f4e0293b9d, identifier: HR86968
2026-03-30 08:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce022a48-15c2-5ae6-9cf4-64f4e0293b9d with identifier: HR86968
2026-03-30 08:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce022a48-15c2-5ae6-9cf4-64f4e0293b9d with identifier: HR86968
2026-03-30 08:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce022a48-15c2-5ae6-9cf4-64f4e0293b9d with identifier: HR86968 to the API
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:15:46Z',
 'fuel_type': 'diesel',
 'id': 'ce022a48-15c2-5ae6-9cf4-64f4e0293b9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR86968',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 54958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-08',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 dCi Bose Personal Edition',
 'transmission': 'manual',
 'trim': 'Bose Personal Edition',
 'year': 2019}
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR86968%27 HTTP/1.1" 200 None
2026-03-30 08:02:41 [auto1.es] INFO: Saving data for HR86968: {'auction_closing_time': 1774883746.0, 'created_time': 1774641820.349467, 'last_price_update_time': 1774857761.446249}
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HR86968') HTTP/1.1" 204 0
2026-03-30 08:02:41 [auto1.es] INFO: Found listing with ID: FG99809
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG99809%27 HTTP/1.1" 200 None
2026-03-30 08:02:41 [auto1.es] INFO: Scrape type for FG99809: 2
2026-03-30 08:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00a8036b-01c5-54f4-bd43-671fc38ed342 with identifier: FG99809
2026-03-30 08:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00a8036b-01c5-54f4-bd43-671fc38ed342 with scrape type 2
2026-03-30 08:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00a8036b-01c5-54f4-bd43-671fc38ed342 with scrape type 2
2026-03-30 08:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 00a8036b-01c5-54f4-bd43-671fc38ed342, identifier: FG99809
2026-03-30 08:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 00a8036b-01c5-54f4-bd43-671fc38ed342 with identifier: FG99809
2026-03-30 08:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 00a8036b-01c5-54f4-bd43-671fc38ed342 with identifier: FG99809
2026-03-30 08:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 00a8036b-01c5-54f4-bd43-671fc38ed342 with identifier: FG99809 to the API
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:16:21Z',
 'fuel_type': 'petrol',
 'id': '00a8036b-01c5-54f4-bd43-671fc38ed342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG99809',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 129175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-28',
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Tech",
 'transmission': 'manual',
 'trim': 'Tech',
 'year': 2021}
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG99809%27 HTTP/1.1" 200 None
2026-03-30 08:02:41 [auto1.es] INFO: Saving data for FG99809: {'auction_closing_time': 1774883781.0, 'created_time': 1772627801.146683, 'last_price_update_time': 1774857761.96882}
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FG99809') HTTP/1.1" 204 0
2026-03-30 08:02:41 [auto1.es] INFO: Found listing with ID: VN33770
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN33770%27 HTTP/1.1" 200 None
2026-03-30 08:02:42 [auto1.es] INFO: Scrape type for VN33770: 2
2026-03-30 08:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8294ee77-d9b3-5141-971a-f5d9d78a2da1 with identifier: VN33770
2026-03-30 08:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8294ee77-d9b3-5141-971a-f5d9d78a2da1 with scrape type 2
2026-03-30 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8294ee77-d9b3-5141-971a-f5d9d78a2da1 with scrape type 2
2026-03-30 08:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8294ee77-d9b3-5141-971a-f5d9d78a2da1, identifier: VN33770
2026-03-30 08:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8294ee77-d9b3-5141-971a-f5d9d78a2da1 with identifier: VN33770
2026-03-30 08:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8294ee77-d9b3-5141-971a-f5d9d78a2da1 with identifier: VN33770
2026-03-30 08:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8294ee77-d9b3-5141-971a-f5d9d78a2da1 with identifier: VN33770 to the API
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:59:56Z',
 'fuel_type': 'diesel',
 'id': '8294ee77-d9b3-5141-971a-f5d9d78a2da1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN33770',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 263478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-12',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2019}
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN33770%27 HTTP/1.1" 200 None
2026-03-30 08:02:42 [auto1.es] INFO: Saving data for VN33770: {'auction_closing_time': 1774886396.0, 'created_time': 1773132506.961083, 'last_price_update_time': 1774857762.39526}
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VN33770') HTTP/1.1" 204 0
2026-03-30 08:02:42 [auto1.es] INFO: Found listing with ID: LC68552
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC68552%27 HTTP/1.1" 200 None
2026-03-30 08:02:42 [auto1.es] INFO: Scrape type for LC68552: 0
2026-03-30 08:02:42 [auto1.es] INFO: Found listing with ID: RG83636
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG83636%27 HTTP/1.1" 200 None
2026-03-30 08:02:42 [auto1.es] INFO: Scrape type for RG83636: 2
2026-03-30 08:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92ea0212-e38c-558e-953e-836c1b865298 with identifier: RG83636
2026-03-30 08:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92ea0212-e38c-558e-953e-836c1b865298 with scrape type 2
2026-03-30 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92ea0212-e38c-558e-953e-836c1b865298 with scrape type 2
2026-03-30 08:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92ea0212-e38c-558e-953e-836c1b865298, identifier: RG83636
2026-03-30 08:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92ea0212-e38c-558e-953e-836c1b865298 with identifier: RG83636
2026-03-30 08:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92ea0212-e38c-558e-953e-836c1b865298 with identifier: RG83636
2026-03-30 08:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92ea0212-e38c-558e-953e-836c1b865298 with identifier: RG83636 to the API
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:29:30Z',
 'fuel_type': 'diesel',
 'id': '92ea0212-e38c-558e-953e-836c1b865298',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG83636',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 172093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-10',
 'seller_name': None,
 'title': 'Audi Q7 4.2 V8 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG83636%27 HTTP/1.1" 200 None
2026-03-30 08:02:42 [auto1.es] INFO: Saving data for RG83636: {'auction_closing_time': 1774884570.0, 'created_time': 1773133590.832147, 'last_price_update_time': 1774857762.846029}
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RG83636') HTTP/1.1" 204 0
2026-03-30 08:02:42 [auto1.es] INFO: Channel: 24h | Page: 19 | totalHits: 2179 | hits on page: 40
2026-03-30 08:02:42 [auto1.es] INFO: Found listing with ID: XT97336
2026-03-30 08:02:42 [auto1.es] INFO: Found listing with ID: CM19424
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM19424%27 HTTP/1.1" 200 None
2026-03-30 08:02:42 [auto1.es] INFO: Scrape type for CM19424: 2
2026-03-30 08:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cd4f52e-3b46-5e72-a317-03f44121989b with identifier: CM19424
2026-03-30 08:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cd4f52e-3b46-5e72-a317-03f44121989b with scrape type 2
2026-03-30 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cd4f52e-3b46-5e72-a317-03f44121989b with scrape type 2
2026-03-30 08:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4cd4f52e-3b46-5e72-a317-03f44121989b, identifier: CM19424
2026-03-30 08:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4cd4f52e-3b46-5e72-a317-03f44121989b with identifier: CM19424
2026-03-30 08:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4cd4f52e-3b46-5e72-a317-03f44121989b with identifier: CM19424
2026-03-30 08:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4cd4f52e-3b46-5e72-a317-03f44121989b with identifier: CM19424 to the API
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:12:26Z',
 'fuel_type': 'diesel',
 'id': '4cd4f52e-3b46-5e72-a317-03f44121989b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM19424',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 119105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Control M',
 'transmission': 'manual',
 'trim': 'Control M',
 'year': 2019}
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM19424%27 HTTP/1.1" 200 None
2026-03-30 08:02:43 [auto1.es] INFO: Saving data for CM19424: {'auction_closing_time': 1774883546.0, 'created_time': 1774771280.611643, 'last_price_update_time': 1774857763.281297}
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CM19424') HTTP/1.1" 204 0
2026-03-30 08:02:43 [auto1.es] INFO: Found listing with ID: XS16270
2026-03-30 08:02:43 [auto1.es] INFO: Found listing with ID: NE82558
2026-03-30 08:02:43 [auto1.es] INFO: Found listing with ID: WA73273
2026-03-30 08:02:43 [auto1.es] INFO: Found listing with ID: TP06770
2026-03-30 08:02:43 [auto1.es] INFO: Found listing with ID: JG96257
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG96257%27 HTTP/1.1" 200 None
2026-03-30 08:02:43 [auto1.es] INFO: Scrape type for JG96257: 2
2026-03-30 08:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5161effa-00d4-5380-bd9c-2f1e4b548b50 with identifier: JG96257
2026-03-30 08:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5161effa-00d4-5380-bd9c-2f1e4b548b50 with scrape type 2
2026-03-30 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5161effa-00d4-5380-bd9c-2f1e4b548b50 with scrape type 2
2026-03-30 08:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5161effa-00d4-5380-bd9c-2f1e4b548b50, identifier: JG96257
2026-03-30 08:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:43 [auto1.es] INFO: Found listing with ID: CP78264
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP78264%27 HTTP/1.1" 200 None
2026-03-30 08:02:43 [auto1.es] INFO: Scrape type for CP78264: 2
2026-03-30 08:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08cbdf88-9b40-572b-a8f7-0e4a4649ee8c with identifier: CP78264
2026-03-30 08:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08cbdf88-9b40-572b-a8f7-0e4a4649ee8c with scrape type 2
2026-03-30 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08cbdf88-9b40-572b-a8f7-0e4a4649ee8c with scrape type 2
2026-03-30 08:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 08cbdf88-9b40-572b-a8f7-0e4a4649ee8c, identifier: CP78264
2026-03-30 08:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5161effa-00d4-5380-bd9c-2f1e4b548b50 with identifier: JG96257
2026-03-30 08:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5161effa-00d4-5380-bd9c-2f1e4b548b50 with identifier: JG96257
2026-03-30 08:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5161effa-00d4-5380-bd9c-2f1e4b548b50 with identifier: JG96257 to the API
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:51:34Z',
 'fuel_type': 'petrol',
 'id': '5161effa-00d4-5380-bd9c-2f1e4b548b50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG96257',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 79520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-02-10',
 'seller_name': None,
 'title': 'Renault Megane 2.0 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2004}
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG96257%27 HTTP/1.1" 200 None
2026-03-30 08:02:43 [auto1.es] INFO: Saving data for JG96257: {'auction_closing_time': 1774885894.0, 'created_time': 1773127797.126314, 'last_price_update_time': 1774857763.943497}
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JG96257') HTTP/1.1" 204 0
2026-03-30 08:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 08cbdf88-9b40-572b-a8f7-0e4a4649ee8c with identifier: CP78264
2026-03-30 08:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 08cbdf88-9b40-572b-a8f7-0e4a4649ee8c with identifier: CP78264
2026-03-30 08:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 08cbdf88-9b40-572b-a8f7-0e4a4649ee8c with identifier: CP78264 to the API
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:35:43Z',
 'fuel_type': 'petrol',
 'id': '08cbdf88-9b40-572b-a8f7-0e4a4649ee8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP78264',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 73485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2019}
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP78264%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Saving data for CP78264: {'auction_closing_time': 1774884943.0, 'created_time': 1773129172.449466, 'last_price_update_time': 1774857764.254207}
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CP78264') HTTP/1.1" 204 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: XX73025
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: KL57529
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: CH60945
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH60945%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for CH60945: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: UV28052
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: WK61099
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK61099%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for WK61099: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: ER43390
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER43390%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for ER43390: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: ZG91019
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: YA56979
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: MM94561
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM94561%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for MM94561: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: CP55474
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: EK02363
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: RR37429
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: FT14290
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: MV51278
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: TZ15382
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: CH35723
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH35723%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for CH35723: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: BK94618
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK94618%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for BK94618: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: XT80551
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT80551%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for XT80551: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: SL83785
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL83785%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for SL83785: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: RH48139
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: XU11405
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU11405%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for XU11405: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: VR07932
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: TZ59623
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: UZ58756
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ58756%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for UZ58756: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: DK97910
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: TY54994
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: KJ62845
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: UU93913
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: RD73419
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD73419%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for RD73419: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: ZE78921
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE78921%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for ZE78921: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: ZH97805
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: GB64088
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: EC92168
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EC92168%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for EC92168: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: DU03691
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: FY67843
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY67843%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for FY67843: 0
2026-03-30 08:02:44 [auto1.es] INFO: Found listing with ID: NR18889
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR18889%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Scrape type for NR18889: 2
2026-03-30 08:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 267c36ef-2708-5bb4-a1e2-756b6d4e0cb3 with identifier: NR18889
2026-03-30 08:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 267c36ef-2708-5bb4-a1e2-756b6d4e0cb3 with scrape type 2
2026-03-30 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 267c36ef-2708-5bb4-a1e2-756b6d4e0cb3 with scrape type 2
2026-03-30 08:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 267c36ef-2708-5bb4-a1e2-756b6d4e0cb3, identifier: NR18889
2026-03-30 08:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 267c36ef-2708-5bb4-a1e2-756b6d4e0cb3 with identifier: NR18889
2026-03-30 08:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 267c36ef-2708-5bb4-a1e2-756b6d4e0cb3 with identifier: NR18889
2026-03-30 08:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 267c36ef-2708-5bb4-a1e2-756b6d4e0cb3 with identifier: NR18889 to the API
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:45:49Z',
 'fuel_type': 'diesel',
 'id': '267c36ef-2708-5bb4-a1e2-756b6d4e0cb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR18889',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 181745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-17',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR18889%27 HTTP/1.1" 200 None
2026-03-30 08:02:44 [auto1.es] INFO: Saving data for NR18889: {'auction_closing_time': 1774885549.0, 'created_time': 1772623303.493192, 'last_price_update_time': 1774857764.971004}
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NR18889') HTTP/1.1" 204 0
2026-03-30 08:02:45 [auto1.es] INFO: Found listing with ID: JR87984
2026-03-30 08:02:45 [auto1.es] INFO: Found listing with ID: BD30925
2026-03-30 08:02:45 [auto1.es] INFO: Found listing with ID: XL11781
2026-03-30 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL11781%27 HTTP/1.1" 200 None
2026-03-30 08:02:45 [auto1.es] INFO: Scrape type for XL11781: 2
2026-03-30 08:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55b4b61b-f218-5031-9ebb-9551b8fb5d07 with identifier: XL11781
2026-03-30 08:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b4b61b-f218-5031-9ebb-9551b8fb5d07 with scrape type 2
2026-03-30 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55b4b61b-f218-5031-9ebb-9551b8fb5d07 with scrape type 2
2026-03-30 08:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 55b4b61b-f218-5031-9ebb-9551b8fb5d07, identifier: XL11781
2026-03-30 08:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 55b4b61b-f218-5031-9ebb-9551b8fb5d07 with identifier: XL11781
2026-03-30 08:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 55b4b61b-f218-5031-9ebb-9551b8fb5d07 with identifier: XL11781
2026-03-30 08:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 55b4b61b-f218-5031-9ebb-9551b8fb5d07 with identifier: XL11781 to the API
2026-03-30 08:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:31:03Z',
 'fuel_type': 'diesel',
 'id': '55b4b61b-f218-5031-9ebb-9551b8fb5d07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL11781',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 135717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2016}
2026-03-30 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL11781%27 HTTP/1.1" 200 None
2026-03-30 08:02:45 [auto1.es] INFO: Saving data for XL11781: {'auction_closing_time': 1774884663.0, 'created_time': 1773129167.293052, 'last_price_update_time': 1774857765.967375}
2026-03-30 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XL11781') HTTP/1.1" 204 0
2026-03-30 08:02:45 [auto1.es] INFO: Found listing with ID: YE53281
2026-03-30 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE53281%27 HTTP/1.1" 200 None
2026-03-30 08:02:46 [auto1.es] INFO: Scrape type for YE53281: 2
2026-03-30 08:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c13e9a1-51d4-58e9-a538-80963809b14b with identifier: YE53281
2026-03-30 08:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c13e9a1-51d4-58e9-a538-80963809b14b with scrape type 2
2026-03-30 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c13e9a1-51d4-58e9-a538-80963809b14b with scrape type 2
2026-03-30 08:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c13e9a1-51d4-58e9-a538-80963809b14b, identifier: YE53281
2026-03-30 08:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c13e9a1-51d4-58e9-a538-80963809b14b with identifier: YE53281
2026-03-30 08:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c13e9a1-51d4-58e9-a538-80963809b14b with identifier: YE53281
2026-03-30 08:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3c13e9a1-51d4-58e9-a538-80963809b14b with identifier: YE53281 to the API
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:38Z',
 'fuel_type': 'petrol',
 'id': '3c13e9a1-51d4-58e9-a538-80963809b14b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE53281',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 64617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-20',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Tecno 2WD',
 'transmission': 'automatic',
 'trim': 'Tecno 2WD',
 'year': 2022}
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE53281%27 HTTP/1.1" 200 None
2026-03-30 08:02:46 [auto1.es] INFO: Saving data for YE53281: {'auction_closing_time': 1774885058.0, 'created_time': 1773127048.480382, 'last_price_update_time': 1774857766.404913}
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YE53281') HTTP/1.1" 204 0
2026-03-30 08:02:46 [auto1.es] INFO: Found listing with ID: TU71868
2026-03-30 08:02:46 [auto1.es] INFO: Found listing with ID: KE29048
2026-03-30 08:02:46 [auto1.es] INFO: Found listing with ID: SZ79556
2026-03-30 08:02:46 [auto1.es] INFO: Found listing with ID: ZV95361
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV95361%27 HTTP/1.1" 200 None
2026-03-30 08:02:46 [auto1.es] INFO: Scrape type for ZV95361: 2
2026-03-30 08:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69e5d46c-f282-5024-a2d9-5d4b10fe9dc9 with identifier: ZV95361
2026-03-30 08:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69e5d46c-f282-5024-a2d9-5d4b10fe9dc9 with scrape type 2
2026-03-30 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69e5d46c-f282-5024-a2d9-5d4b10fe9dc9 with scrape type 2
2026-03-30 08:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 69e5d46c-f282-5024-a2d9-5d4b10fe9dc9, identifier: ZV95361
2026-03-30 08:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 69e5d46c-f282-5024-a2d9-5d4b10fe9dc9 with identifier: ZV95361
2026-03-30 08:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 69e5d46c-f282-5024-a2d9-5d4b10fe9dc9 with identifier: ZV95361
2026-03-30 08:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 69e5d46c-f282-5024-a2d9-5d4b10fe9dc9 with identifier: ZV95361 to the API
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:46:57Z',
 'fuel_type': 'diesel',
 'id': '69e5d46c-f282-5024-a2d9-5d4b10fe9dc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV95361',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 145451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-21',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Ocean Race 2WD',
 'transmission': 'automatic',
 'trim': 'Ocean Race 2WD',
 'year': 2016}
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV95361%27 HTTP/1.1" 200 None
2026-03-30 08:02:46 [auto1.es] INFO: Saving data for ZV95361: {'auction_closing_time': 1774885617.0, 'created_time': 1773133760.43865, 'last_price_update_time': 1774857766.865246}
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZV95361') HTTP/1.1" 204 0
2026-03-30 08:02:46 [auto1.es] INFO: Found listing with ID: TT67656
2026-03-30 08:02:46 [auto1.es] INFO: Found listing with ID: WA75456
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA75456%27 HTTP/1.1" 200 None
2026-03-30 08:02:46 [auto1.es] INFO: Scrape type for WA75456: 0
2026-03-30 08:02:46 [auto1.es] INFO: Found listing with ID: ME86804
2026-03-30 08:02:46 [auto1.es] INFO: Found listing with ID: WM80180
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM80180%27 HTTP/1.1" 200 None
2026-03-30 08:02:46 [auto1.es] INFO: Scrape type for WM80180: 2
2026-03-30 08:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a299f45-3791-59c0-b666-3b5cfd97ada9 with identifier: WM80180
2026-03-30 08:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a299f45-3791-59c0-b666-3b5cfd97ada9 with scrape type 2
2026-03-30 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a299f45-3791-59c0-b666-3b5cfd97ada9 with scrape type 2
2026-03-30 08:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a299f45-3791-59c0-b666-3b5cfd97ada9, identifier: WM80180
2026-03-30 08:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a299f45-3791-59c0-b666-3b5cfd97ada9 with identifier: WM80180
2026-03-30 08:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a299f45-3791-59c0-b666-3b5cfd97ada9 with identifier: WM80180
2026-03-30 08:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5a299f45-3791-59c0-b666-3b5cfd97ada9 with identifier: WM80180 to the API
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:28Z',
 'fuel_type': 'diesel',
 'id': '5a299f45-3791-59c0-b666-3b5cfd97ada9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM80180',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 156372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-20',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM80180%27 HTTP/1.1" 200 None
2026-03-30 08:02:47 [auto1.es] INFO: Saving data for WM80180: {'auction_closing_time': 1774885528.0, 'created_time': 1773127880.339447, 'last_price_update_time': 1774857767.321653}
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WM80180') HTTP/1.1" 204 0
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: DY56989
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: XS16270
2026-03-30 08:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:47 [auto1.es] INFO: Channel: 24h | Page: 20 | totalHits: 2179 | hits on page: 40
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: LA22899
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA22899%27 HTTP/1.1" 200 None
2026-03-30 08:02:47 [auto1.es] INFO: Scrape type for LA22899: 0
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: BK29060
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: FE11610
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE11610%27 HTTP/1.1" 200 None
2026-03-30 08:02:47 [auto1.es] INFO: Scrape type for FE11610: 0
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: MD24315
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: DF11976
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: HL11989
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL11989%27 HTTP/1.1" 200 None
2026-03-30 08:02:47 [auto1.es] INFO: Scrape type for HL11989: 0
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: EE18578
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: HV58793
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: AU82484
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU82484%27 HTTP/1.1" 200 None
2026-03-30 08:02:47 [auto1.es] INFO: Scrape type for AU82484: 0
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: CL32416
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL32416%27 HTTP/1.1" 200 None
2026-03-30 08:02:47 [auto1.es] INFO: Scrape type for CL32416: 0
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: JT03070
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT03070%27 HTTP/1.1" 200 None
2026-03-30 08:02:47 [auto1.es] INFO: Scrape type for JT03070: 0
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: NE16283
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE16283%27 HTTP/1.1" 200 None
2026-03-30 08:02:47 [auto1.es] INFO: Scrape type for NE16283: 0
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: CZ44348
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: ZA37078
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: UE66949
2026-03-30 08:02:47 [auto1.es] INFO: Found listing with ID: UZ91236
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ91236%27 HTTP/1.1" 200 None
2026-03-30 08:02:47 [auto1.es] INFO: Scrape type for UZ91236: 2
2026-03-30 08:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf63b43e-8f59-5ec7-8a2f-7c50a6f10009 with identifier: UZ91236
2026-03-30 08:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf63b43e-8f59-5ec7-8a2f-7c50a6f10009 with scrape type 2
2026-03-30 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf63b43e-8f59-5ec7-8a2f-7c50a6f10009 with scrape type 2
2026-03-30 08:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bf63b43e-8f59-5ec7-8a2f-7c50a6f10009, identifier: UZ91236
2026-03-30 08:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bf63b43e-8f59-5ec7-8a2f-7c50a6f10009 with identifier: UZ91236
2026-03-30 08:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bf63b43e-8f59-5ec7-8a2f-7c50a6f10009 with identifier: UZ91236
2026-03-30 08:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bf63b43e-8f59-5ec7-8a2f-7c50a6f10009 with identifier: UZ91236 to the API
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:34:34Z',
 'fuel_type': 'petrol',
 'id': 'bf63b43e-8f59-5ec7-8a2f-7c50a6f10009',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ91236',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 298211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-27',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI GT Line Essential 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line Essential 4WD',
 'year': 2018}
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ91236%27 HTTP/1.1" 200 None
2026-03-30 08:02:48 [auto1.es] INFO: Saving data for UZ91236: {'auction_closing_time': 1774884874.0, 'created_time': 1773842614.106582, 'last_price_update_time': 1774857768.084604}
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UZ91236') HTTP/1.1" 204 0
2026-03-30 08:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: CU24817
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU24817%27 HTTP/1.1" 200 None
2026-03-30 08:02:48 [auto1.es] INFO: Scrape type for CU24817: 0
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: RR40846
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: UG21171
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: GZ25501
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ25501%27 HTTP/1.1" 200 None
2026-03-30 08:02:48 [auto1.es] INFO: Scrape type for GZ25501: 0
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: AS83743
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: LS55149
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS55149%27 HTTP/1.1" 200 None
2026-03-30 08:02:48 [auto1.es] INFO: Scrape type for LS55149: 2
2026-03-30 08:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88 with identifier: LS55149
2026-03-30 08:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88 with scrape type 2
2026-03-30 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88 with scrape type 2
2026-03-30 08:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88, identifier: LS55149
2026-03-30 08:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88 with identifier: LS55149
2026-03-30 08:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88 with identifier: LS55149
2026-03-30 08:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88 with identifier: LS55149 to the API
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:05:24Z',
 'fuel_type': 'petrol',
 'id': 'e6f5e9c9-ac2d-5806-b07e-8a1af51e2b88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS55149',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 136212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-26',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS55149%27 HTTP/1.1" 200 None
2026-03-30 08:02:48 [auto1.es] INFO: Saving data for LS55149: {'auction_closing_time': 1774883124.0, 'created_time': 1774555476.741137, 'last_price_update_time': 1774857768.627849}
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LS55149') HTTP/1.1" 204 0
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: PD21728
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: GT92698
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: VD81677
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD81677%27 HTTP/1.1" 200 None
2026-03-30 08:02:48 [auto1.es] INFO: Scrape type for VD81677: 0
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: NN86390
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN86390%27 HTTP/1.1" 200 None
2026-03-30 08:02:48 [auto1.es] INFO: Scrape type for NN86390: 0
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: YT10361
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: XB61397
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: ZD67493
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD67493%27 HTTP/1.1" 200 None
2026-03-30 08:02:48 [auto1.es] INFO: Scrape type for ZD67493: 0
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: UG63824
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG63824%27 HTTP/1.1" 200 None
2026-03-30 08:02:48 [auto1.es] INFO: Scrape type for UG63824: 0
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: FC07978
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC07978%27 HTTP/1.1" 200 None
2026-03-30 08:02:48 [auto1.es] INFO: Scrape type for FC07978: 0
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: WW69130
2026-03-30 08:02:48 [auto1.es] INFO: Found listing with ID: MX84470
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX84470%27 HTTP/1.1" 200 None
2026-03-30 08:02:48 [auto1.es] INFO: Scrape type for MX84470: 2
2026-03-30 08:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bd4f01b-d69f-53f8-926d-f55cf7496d7c with identifier: MX84470
2026-03-30 08:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bd4f01b-d69f-53f8-926d-f55cf7496d7c with scrape type 2
2026-03-30 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bd4f01b-d69f-53f8-926d-f55cf7496d7c with scrape type 2
2026-03-30 08:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7bd4f01b-d69f-53f8-926d-f55cf7496d7c, identifier: MX84470
2026-03-30 08:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7bd4f01b-d69f-53f8-926d-f55cf7496d7c with identifier: MX84470
2026-03-30 08:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7bd4f01b-d69f-53f8-926d-f55cf7496d7c with identifier: MX84470
2026-03-30 08:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7bd4f01b-d69f-53f8-926d-f55cf7496d7c with identifier: MX84470 to the API
2026-03-30 08:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:15:45Z',
 'fuel_type': 'diesel',
 'id': '7bd4f01b-d69f-53f8-926d-f55cf7496d7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX84470',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 280035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-30',
 'seller_name': None,
 'title': 'Seat Altea 1.9 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2006}
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX84470%27 HTTP/1.1" 200 None
2026-03-30 08:02:49 [auto1.es] INFO: Saving data for MX84470: {'auction_closing_time': 1774883745.0, 'created_time': 1774555328.549955, 'last_price_update_time': 1774857769.137542}
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MX84470') HTTP/1.1" 204 0
2026-03-30 08:02:49 [auto1.es] INFO: Found listing with ID: JR86606
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR86606%27 HTTP/1.1" 200 None
2026-03-30 08:02:49 [auto1.es] INFO: Scrape type for JR86606: 0
2026-03-30 08:02:49 [auto1.es] INFO: Found listing with ID: YX82549
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX82549%27 HTTP/1.1" 200 None
2026-03-30 08:02:49 [auto1.es] INFO: Scrape type for YX82549: 0
2026-03-30 08:02:49 [auto1.es] INFO: Found listing with ID: TX02408
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX02408%27 HTTP/1.1" 200 None
2026-03-30 08:02:49 [auto1.es] INFO: Scrape type for TX02408: 0
2026-03-30 08:02:49 [auto1.es] INFO: Found listing with ID: MT58185
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT58185%27 HTTP/1.1" 200 None
2026-03-30 08:02:49 [auto1.es] INFO: Scrape type for MT58185: 0
2026-03-30 08:02:49 [auto1.es] INFO: Found listing with ID: JP19484
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP19484%27 HTTP/1.1" 200 None
2026-03-30 08:02:49 [auto1.es] INFO: Scrape type for JP19484: 0
2026-03-30 08:02:49 [auto1.es] INFO: Found listing with ID: BM81559
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM81559%27 HTTP/1.1" 200 None
2026-03-30 08:02:49 [auto1.es] INFO: Scrape type for BM81559: 0
2026-03-30 08:02:49 [auto1.es] INFO: Found listing with ID: CK76032
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CK76032%27 HTTP/1.1" 200 None
2026-03-30 08:02:49 [auto1.es] INFO: Scrape type for CK76032: 0
2026-03-30 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:51 [auto1.es] INFO: Channel: 24h | Page: 21 | totalHits: 2179 | hits on page: 40
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: WV75018
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: PA43540
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: PG51774
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG51774%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for PG51774: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: CB03666
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB03666%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for CB03666: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: ZJ67299
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: MD81888
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD81888%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for MD81888: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: ZN02005
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: ZW95177
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW95177%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for ZW95177: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: KD17519
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD17519%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for KD17519: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: LC37713
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC37713%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for LC37713: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: BD22709
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: VB81501
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB81501%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for VB81501: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: ZZ62546
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ62546%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for ZZ62546: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: FA71297
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA71297%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for FA71297: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: UV08458
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: CL10688
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: NL01395
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: WA88394
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: VR45740
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR45740%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for VR45740: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: EZ05662
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: UJ64573
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ64573%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for UJ64573: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: CB84377
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB84377%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for CB84377: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: TT52004
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT52004%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for TT52004: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: VU50837
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU50837%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for VU50837: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: YW59434
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW59434%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for YW59434: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: DW22650
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW22650%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for DW22650: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: NL32920
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL32920%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for NL32920: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: PZ72634
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: XF10257
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF10257%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for XF10257: 0
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: YT02265
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT02265%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for YT02265: 2
2026-03-30 08:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d864ca91-5b36-58e1-b590-7fdcb4492892 with identifier: YT02265
2026-03-30 08:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d864ca91-5b36-58e1-b590-7fdcb4492892 with scrape type 2
2026-03-30 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d864ca91-5b36-58e1-b590-7fdcb4492892 with scrape type 2
2026-03-30 08:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d864ca91-5b36-58e1-b590-7fdcb4492892, identifier: YT02265
2026-03-30 08:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d864ca91-5b36-58e1-b590-7fdcb4492892 with identifier: YT02265
2026-03-30 08:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d864ca91-5b36-58e1-b590-7fdcb4492892 with identifier: YT02265
2026-03-30 08:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d864ca91-5b36-58e1-b590-7fdcb4492892 with identifier: YT02265 to the API
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:03:27Z',
 'fuel_type': 'diesel',
 'id': 'd864ca91-5b36-58e1-b590-7fdcb4492892',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT02265',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 182306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-29',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT02265%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Saving data for YT02265: {'auction_closing_time': 1774883007.0, 'created_time': 1774555374.472077, 'last_price_update_time': 1774857771.765464}
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YT02265') HTTP/1.1" 204 0
2026-03-30 08:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: GJ58304
2026-03-30 08:02:51 [auto1.es] INFO: Found listing with ID: TG66753
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG66753%27 HTTP/1.1" 200 None
2026-03-30 08:02:51 [auto1.es] INFO: Scrape type for TG66753: 2
2026-03-30 08:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60e5f8c2-eaad-5b37-a02e-4ea6e2411bcc with identifier: TG66753
2026-03-30 08:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60e5f8c2-eaad-5b37-a02e-4ea6e2411bcc with scrape type 2
2026-03-30 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60e5f8c2-eaad-5b37-a02e-4ea6e2411bcc with scrape type 2
2026-03-30 08:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 60e5f8c2-eaad-5b37-a02e-4ea6e2411bcc, identifier: TG66753
2026-03-30 08:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 60e5f8c2-eaad-5b37-a02e-4ea6e2411bcc with identifier: TG66753
2026-03-30 08:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 60e5f8c2-eaad-5b37-a02e-4ea6e2411bcc with identifier: TG66753
2026-03-30 08:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 60e5f8c2-eaad-5b37-a02e-4ea6e2411bcc with identifier: TG66753 to the API
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:18:28Z',
 'fuel_type': 'diesel',
 'id': '60e5f8c2-eaad-5b37-a02e-4ea6e2411bcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG66753',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 167038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG66753%27 HTTP/1.1" 200 None
2026-03-30 08:02:52 [auto1.es] INFO: Saving data for TG66753: {'auction_closing_time': 1774883908.0, 'created_time': 1774080030.276923, 'last_price_update_time': 1774857772.280248}
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TG66753') HTTP/1.1" 204 0
2026-03-30 08:02:52 [auto1.es] INFO: Found listing with ID: TH38754
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH38754%27 HTTP/1.1" 200 None
2026-03-30 08:02:52 [auto1.es] INFO: Scrape type for TH38754: 0
2026-03-30 08:02:52 [auto1.es] INFO: Found listing with ID: CM92438
2026-03-30 08:02:52 [auto1.es] INFO: Found listing with ID: GA23722
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA23722%27 HTTP/1.1" 200 None
2026-03-30 08:02:52 [auto1.es] INFO: Scrape type for GA23722: 0
2026-03-30 08:02:52 [auto1.es] INFO: Found listing with ID: BX60688
2026-03-30 08:02:52 [auto1.es] INFO: Found listing with ID: ER91055
2026-03-30 08:02:52 [auto1.es] INFO: Found listing with ID: ES48862
2026-03-30 08:02:52 [auto1.es] INFO: Found listing with ID: TV58646
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV58646%27 HTTP/1.1" 200 None
2026-03-30 08:02:52 [auto1.es] INFO: Scrape type for TV58646: 2
2026-03-30 08:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf460618-520f-5616-81f5-a4f732e00ea2 with identifier: TV58646
2026-03-30 08:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf460618-520f-5616-81f5-a4f732e00ea2 with scrape type 2
2026-03-30 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf460618-520f-5616-81f5-a4f732e00ea2 with scrape type 2
2026-03-30 08:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bf460618-520f-5616-81f5-a4f732e00ea2, identifier: TV58646
2026-03-30 08:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bf460618-520f-5616-81f5-a4f732e00ea2 with identifier: TV58646
2026-03-30 08:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bf460618-520f-5616-81f5-a4f732e00ea2 with identifier: TV58646
2026-03-30 08:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bf460618-520f-5616-81f5-a4f732e00ea2 with identifier: TV58646 to the API
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:45:17Z',
 'fuel_type': 'diesel',
 'id': 'bf460618-520f-5616-81f5-a4f732e00ea2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV58646',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 297306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-28',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV58646%27 HTTP/1.1" 200 None
2026-03-30 08:02:52 [auto1.es] INFO: Saving data for TV58646: {'auction_closing_time': 1774885517.0, 'created_time': 1774555397.760579, 'last_price_update_time': 1774857772.734611}
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TV58646') HTTP/1.1" 204 0
2026-03-30 08:02:52 [auto1.es] INFO: Found listing with ID: PK58195
2026-03-30 08:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:53 [auto1.es] INFO: Channel: 24h | Page: 22 | totalHits: 2179 | hits on page: 40
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: BC07750
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: TV36726
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: RU11910
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: KL17939
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: XH50909
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: SM25064
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM25064%27 HTTP/1.1" 200 None
2026-03-30 08:02:53 [auto1.es] INFO: Scrape type for SM25064: 0
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: XE30764
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE30764%27 HTTP/1.1" 200 None
2026-03-30 08:02:53 [auto1.es] INFO: Scrape type for XE30764: 0
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: UZ86093
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: GT72542
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: KE66826
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE66826%27 HTTP/1.1" 200 None
2026-03-30 08:02:53 [auto1.es] INFO: Scrape type for KE66826: 0
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: HF65167
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF65167%27 HTTP/1.1" 200 None
2026-03-30 08:02:53 [auto1.es] INFO: Scrape type for HF65167: 0
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: LH51054
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH51054%27 HTTP/1.1" 200 None
2026-03-30 08:02:53 [auto1.es] INFO: Scrape type for LH51054: 0
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: TW93253
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW93253%27 HTTP/1.1" 200 None
2026-03-30 08:02:53 [auto1.es] INFO: Scrape type for TW93253: 0
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: MS49436
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: AW49477
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW49477%27 HTTP/1.1" 200 None
2026-03-30 08:02:53 [auto1.es] INFO: Scrape type for AW49477: 0
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: ZE41555
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: ZZ72823
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ72823%27 HTTP/1.1" 200 None
2026-03-30 08:02:53 [auto1.es] INFO: Scrape type for ZZ72823: 0
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: XE32619
2026-03-30 08:02:53 [auto1.es] INFO: Found listing with ID: SB32545
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB32545%27 HTTP/1.1" 200 None
2026-03-30 08:02:53 [auto1.es] INFO: Scrape type for SB32545: 2
2026-03-30 08:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31d06b00-97ba-577c-ba4a-5ee820422d8a with identifier: SB32545
2026-03-30 08:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31d06b00-97ba-577c-ba4a-5ee820422d8a with scrape type 2
2026-03-30 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31d06b00-97ba-577c-ba4a-5ee820422d8a with scrape type 2
2026-03-30 08:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 31d06b00-97ba-577c-ba4a-5ee820422d8a, identifier: SB32545
2026-03-30 08:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 31d06b00-97ba-577c-ba4a-5ee820422d8a with identifier: SB32545
2026-03-30 08:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 31d06b00-97ba-577c-ba4a-5ee820422d8a with identifier: SB32545
2026-03-30 08:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 31d06b00-97ba-577c-ba4a-5ee820422d8a with identifier: SB32545 to the API
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:13:07Z',
 'fuel_type': 'petrol',
 'id': '31d06b00-97ba-577c-ba4a-5ee820422d8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB32545',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 120896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-31',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2021}
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB32545%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Saving data for SB32545: {'auction_closing_time': 1774883587.0, 'created_time': 1774274584.664609, 'last_price_update_time': 1774857774.347727}
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SB32545') HTTP/1.1" 204 0
2026-03-30 08:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: XR29035
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: UG14230
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: HZ04358
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ04358%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Scrape type for HZ04358: 0
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: US15459
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US15459%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Scrape type for US15459: 0
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: VC98401
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: VJ61689
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: MA92923
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA92923%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Scrape type for MA92923: 0
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: TZ36663
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ36663%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Scrape type for TZ36663: 0
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: RK72644
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK72644%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Scrape type for RK72644: 0
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: GT49964
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT49964%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Scrape type for GT49964: 0
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: XW07664
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: UR00464
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: FA05952
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA05952%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Scrape type for FA05952: 0
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: HA22815
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA22815%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Scrape type for HA22815: 0
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: EE78385
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: KT28524
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT28524%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Scrape type for KT28524: 0
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: BZ29136
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: US76988
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US76988%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Scrape type for US76988: 0
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: ZA28450
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: XY35870
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY35870%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Scrape type for XY35870: 0
2026-03-30 08:02:54 [auto1.es] INFO: Found listing with ID: MB16167
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB16167%27 HTTP/1.1" 200 None
2026-03-30 08:02:54 [auto1.es] INFO: Scrape type for MB16167: 0
2026-03-30 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:55 [auto1.es] INFO: Channel: 24h | Page: 23 | totalHits: 2178 | hits on page: 40
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: SD86160
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: UT04175
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT04175%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for UT04175: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: KK78857
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK78857%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for KK78857: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: NJ25414
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: GP92404
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP92404%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for GP92404: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: MZ66022
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ66022%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for MZ66022: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: ZD85047
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: TV99660
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV99660%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for TV99660: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: LE09183
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE09183%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for LE09183: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: MK04112
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK04112%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for MK04112: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: CJ74975
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: RE01082
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: GF91510
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF91510%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for GF91510: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: DH50359
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: CY33639
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: MV66149
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV66149%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for MV66149: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: TH42321
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH42321%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for TH42321: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: LZ46895
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ46895%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for LZ46895: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: YN87603
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN87603%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for YN87603: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: AX44077
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX44077%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for AX44077: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: KA03965
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA03965%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for KA03965: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: VY79156
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: ZD98631
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD98631%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for ZD98631: 0
2026-03-30 08:02:55 [auto1.es] INFO: Found listing with ID: WF38269
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF38269%27 HTTP/1.1" 200 None
2026-03-30 08:02:55 [auto1.es] INFO: Scrape type for WF38269: 2
2026-03-30 08:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb7e7d7-c6db-5463-8d99-6a9936aa6da9 with identifier: WF38269
2026-03-30 08:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb7e7d7-c6db-5463-8d99-6a9936aa6da9 with scrape type 2
2026-03-30 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abb7e7d7-c6db-5463-8d99-6a9936aa6da9 with scrape type 2
2026-03-30 08:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: abb7e7d7-c6db-5463-8d99-6a9936aa6da9, identifier: WF38269
2026-03-30 08:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: abb7e7d7-c6db-5463-8d99-6a9936aa6da9 with identifier: WF38269
2026-03-30 08:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: abb7e7d7-c6db-5463-8d99-6a9936aa6da9 with identifier: WF38269
2026-03-30 08:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: abb7e7d7-c6db-5463-8d99-6a9936aa6da9 with identifier: WF38269 to the API
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:16:43Z',
 'fuel_type': 'petrol',
 'id': 'abb7e7d7-c6db-5463-8d99-6a9936aa6da9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF38269',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 32738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-17',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2008}
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF38269%27 HTTP/1.1" 200 None
2026-03-30 08:02:56 [auto1.es] INFO: Saving data for WF38269: {'auction_closing_time': 1774883803.0, 'created_time': 1773133400.361325, 'last_price_update_time': 1774857776.267329}
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WF38269') HTTP/1.1" 204 0
2026-03-30 08:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: ZP63371
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: LN79000
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN79000%27 HTTP/1.1" 200 None
2026-03-30 08:02:56 [auto1.es] INFO: Scrape type for LN79000: 0
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: VB06067
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB06067%27 HTTP/1.1" 200 None
2026-03-30 08:02:56 [auto1.es] INFO: Scrape type for VB06067: 0
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: AR66930
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR66930%27 HTTP/1.1" 200 None
2026-03-30 08:02:56 [auto1.es] INFO: Scrape type for AR66930: 0
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: NF50225
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: UY91237
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UY91237%27 HTTP/1.1" 200 None
2026-03-30 08:02:56 [auto1.es] INFO: Scrape type for UY91237: 0
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: BW95892
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW95892%27 HTTP/1.1" 200 None
2026-03-30 08:02:56 [auto1.es] INFO: Scrape type for BW95892: 0
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: WJ41546
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ41546%27 HTTP/1.1" 200 None
2026-03-30 08:02:56 [auto1.es] INFO: Scrape type for WJ41546: 0
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: EV24986
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: CV55647
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV55647%27 HTTP/1.1" 200 None
2026-03-30 08:02:56 [auto1.es] INFO: Scrape type for CV55647: 0
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: AK39366
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: MP42129
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: US62841
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US62841%27 HTTP/1.1" 200 None
2026-03-30 08:02:56 [auto1.es] INFO: Scrape type for US62841: 0
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: ZF52825
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF52825%27 HTTP/1.1" 200 None
2026-03-30 08:02:56 [auto1.es] INFO: Scrape type for ZF52825: 0
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: ZT28887
2026-03-30 08:02:56 [auto1.es] INFO: Found listing with ID: RU33051
2026-03-30 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:57 [auto1.es] INFO: Channel: 24h | Page: 24 | totalHits: 2178 | hits on page: 40
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: RE88096
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE88096%27 HTTP/1.1" 200 None
2026-03-30 08:02:57 [auto1.es] INFO: Scrape type for RE88096: 0
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: AB11386
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: MZ44217
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ44217%27 HTTP/1.1" 200 None
2026-03-30 08:02:57 [auto1.es] INFO: Scrape type for MZ44217: 0
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: ZZ54358
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ54358%27 HTTP/1.1" 200 None
2026-03-30 08:02:57 [auto1.es] INFO: Scrape type for ZZ54358: 0
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: RK37999
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: CE45579
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE45579%27 HTTP/1.1" 200 None
2026-03-30 08:02:57 [auto1.es] INFO: Scrape type for CE45579: 0
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: FB55193
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: NT36194
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: MR81111
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: NN13578
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN13578%27 HTTP/1.1" 200 None
2026-03-30 08:02:57 [auto1.es] INFO: Scrape type for NN13578: 0
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: WS59204
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: NB97215
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: JM88117
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM88117%27 HTTP/1.1" 200 None
2026-03-30 08:02:57 [auto1.es] INFO: Scrape type for JM88117: 0
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: TF20925
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: BB64860
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: CD37802
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: MN42055
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN42055%27 HTTP/1.1" 200 None
2026-03-30 08:02:57 [auto1.es] INFO: Scrape type for MN42055: 0
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: UM01301
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: DA46223
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA46223%27 HTTP/1.1" 200 None
2026-03-30 08:02:57 [auto1.es] INFO: Scrape type for DA46223: 0
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: EK86006
2026-03-30 08:02:57 [auto1.es] INFO: Found listing with ID: JB16763
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB16763%27 HTTP/1.1" 200 None
2026-03-30 08:02:57 [auto1.es] INFO: Scrape type for JB16763: 2
2026-03-30 08:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7395209-c7fc-5cca-8aee-30d93c4de95a with identifier: JB16763
2026-03-30 08:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7395209-c7fc-5cca-8aee-30d93c4de95a with scrape type 2
2026-03-30 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7395209-c7fc-5cca-8aee-30d93c4de95a with scrape type 2
2026-03-30 08:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a7395209-c7fc-5cca-8aee-30d93c4de95a, identifier: JB16763
2026-03-30 08:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a7395209-c7fc-5cca-8aee-30d93c4de95a with identifier: JB16763
2026-03-30 08:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a7395209-c7fc-5cca-8aee-30d93c4de95a with identifier: JB16763
2026-03-30 08:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a7395209-c7fc-5cca-8aee-30d93c4de95a with identifier: JB16763 to the API
2026-03-30 08:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:22:13Z',
 'fuel_type': 'petrol',
 'id': 'a7395209-c7fc-5cca-8aee-30d93c4de95a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB16763',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 131018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-31',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2012}
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB16763%27 HTTP/1.1" 200 None
2026-03-30 08:02:58 [auto1.es] INFO: Saving data for JB16763: {'auction_closing_time': 1774884133.0, 'created_time': 1773950672.969923, 'last_price_update_time': 1774857778.178529}
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JB16763') HTTP/1.1" 204 0
2026-03-30 08:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: XT42288
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT42288%27 HTTP/1.1" 200 None
2026-03-30 08:02:58 [auto1.es] INFO: Scrape type for XT42288: 0
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: VM06943
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: EE09579
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE09579%27 HTTP/1.1" 200 None
2026-03-30 08:02:58 [auto1.es] INFO: Scrape type for EE09579: 0
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: BB29813
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB29813%27 HTTP/1.1" 200 None
2026-03-30 08:02:58 [auto1.es] INFO: Scrape type for BB29813: 0
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: YU03196
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: WZ44927
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: HU12913
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU12913%27 HTTP/1.1" 200 None
2026-03-30 08:02:58 [auto1.es] INFO: Scrape type for HU12913: 0
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: UG25415
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG25415%27 HTTP/1.1" 200 None
2026-03-30 08:02:58 [auto1.es] INFO: Scrape type for UG25415: 0
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: LJ64414
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ64414%27 HTTP/1.1" 200 None
2026-03-30 08:02:58 [auto1.es] INFO: Scrape type for LJ64414: 0
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: FJ09985
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ09985%27 HTTP/1.1" 200 None
2026-03-30 08:02:58 [auto1.es] INFO: Scrape type for FJ09985: 0
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: BV69737
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV69737%27 HTTP/1.1" 200 None
2026-03-30 08:02:58 [auto1.es] INFO: Scrape type for BV69737: 0
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: DV40298
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV40298%27 HTTP/1.1" 200 None
2026-03-30 08:02:58 [auto1.es] INFO: Scrape type for DV40298: 0
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: XT49013
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: BM13295
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM13295%27 HTTP/1.1" 200 None
2026-03-30 08:02:58 [auto1.es] INFO: Scrape type for BM13295: 0
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: JF42327
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF42327%27 HTTP/1.1" 200 None
2026-03-30 08:02:58 [auto1.es] INFO: Scrape type for JF42327: 0
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: NT66217
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: UE32558
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: FZ71320
2026-03-30 08:02:58 [auto1.es] INFO: Found listing with ID: EH99000
2026-03-30 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:02:59 [auto1.es] INFO: Channel: 24h | Page: 25 | totalHits: 2178 | hits on page: 40
2026-03-30 08:02:59 [auto1.es] INFO: Found listing with ID: VP11478
2026-03-30 08:02:59 [auto1.es] INFO: Found listing with ID: SR43030
2026-03-30 08:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR43030%27 HTTP/1.1" 200 None
2026-03-30 08:02:59 [auto1.es] INFO: Scrape type for SR43030: 0
2026-03-30 08:02:59 [auto1.es] INFO: Found listing with ID: EB93661
2026-03-30 08:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB93661%27 HTTP/1.1" 200 None
2026-03-30 08:02:59 [auto1.es] INFO: Scrape type for EB93661: 2
2026-03-30 08:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 330f8dfe-88c7-567d-9971-fbaffbaba0c2 with identifier: EB93661
2026-03-30 08:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2 with scrape type 2
2026-03-30 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 330f8dfe-88c7-567d-9971-fbaffbaba0c2 with scrape type 2
2026-03-30 08:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 330f8dfe-88c7-567d-9971-fbaffbaba0c2, identifier: EB93661
2026-03-30 08:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 330f8dfe-88c7-567d-9971-fbaffbaba0c2 with identifier: EB93661
2026-03-30 08:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 330f8dfe-88c7-567d-9971-fbaffbaba0c2 with identifier: EB93661
2026-03-30 08:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 330f8dfe-88c7-567d-9971-fbaffbaba0c2 with identifier: EB93661 to the API
2026-03-30 08:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:15:42Z',
 'fuel_type': 'diesel',
 'id': '330f8dfe-88c7-567d-9971-fbaffbaba0c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB93661',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 187105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-29',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 08:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB93661%27 HTTP/1.1" 200 None
2026-03-30 08:02:59 [auto1.es] INFO: Saving data for EB93661: {'auction_closing_time': 1774883742.0, 'created_time': 1774555473.16526, 'last_price_update_time': 1774857779.888379}
2026-03-30 08:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EB93661') HTTP/1.1" 204 0
2026-03-30 08:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: TJ92656
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: RC43522
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC43522%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for RC43522: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: AE79363
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE79363%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for AE79363: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: CB57175
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB57175%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for CB57175: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: AR16993
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: RP83421
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: EB96855
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: SU20973
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: JM72010
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM72010%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for JM72010: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: PT78708
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: AZ15880
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ15880%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for AZ15880: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: KK58093
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK58093%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for KK58093: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: UD80780
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD80780%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for UD80780: 2
2026-03-30 08:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11d46f5a-f6f3-526c-9c2c-214238204559 with identifier: UD80780
2026-03-30 08:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11d46f5a-f6f3-526c-9c2c-214238204559 with scrape type 2
2026-03-30 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11d46f5a-f6f3-526c-9c2c-214238204559 with scrape type 2
2026-03-30 08:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 11d46f5a-f6f3-526c-9c2c-214238204559, identifier: UD80780
2026-03-30 08:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 11d46f5a-f6f3-526c-9c2c-214238204559 with identifier: UD80780
2026-03-30 08:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 11d46f5a-f6f3-526c-9c2c-214238204559 with identifier: UD80780
2026-03-30 08:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 11d46f5a-f6f3-526c-9c2c-214238204559 with identifier: UD80780 to the API
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:31:17Z',
 'fuel_type': 'petrol',
 'id': '11d46f5a-f6f3-526c-9c2c-214238204559',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD80780',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 88837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-31',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Country',
 'transmission': 'automatic',
 'trim': 'Country',
 'year': 2009}
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD80780%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Saving data for UD80780: {'auction_closing_time': 1774884677.0, 'created_time': 1774555409.70329, 'last_price_update_time': 1774857780.569503}
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UD80780') HTTP/1.1" 204 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: DW27035
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW27035%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for DW27035: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: ZG18454
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: HA25095
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: XC39222
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC39222%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for XC39222: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: JW76352
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: XV58633
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: FJ32217
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: JJ54433
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: LB05915
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB05915%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for LB05915: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: PW99692
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: RT81282
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: AW04396
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW04396%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for AW04396: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: SN13846
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN13846%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for SN13846: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: SE78782
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE78782%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for SE78782: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: YG58121
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG58121%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for YG58121: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: YX61230
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX61230%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for YX61230: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: ZJ79467
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: DX86055
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX86055%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for DX86055: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: RM79142
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM79142%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for RM79142: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: TC70621
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC70621%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for TC70621: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: MC49666
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC49666%27 HTTP/1.1" 200 None
2026-03-30 08:03:00 [auto1.es] INFO: Scrape type for MC49666: 0
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: HZ02297
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: AG74382
2026-03-30 08:03:00 [auto1.es] INFO: Found listing with ID: HU25614
2026-03-30 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:01 [auto1.es] INFO: Channel: 24h | Page: 26 | totalHits: 2178 | hits on page: 40
2026-03-30 08:03:01 [auto1.es] INFO: Found listing with ID: KE44681
2026-03-30 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE44681%27 HTTP/1.1" 200 None
2026-03-30 08:03:01 [auto1.es] INFO: Scrape type for KE44681: 0
2026-03-30 08:03:01 [auto1.es] INFO: Found listing with ID: GS59468
2026-03-30 08:03:01 [auto1.es] INFO: Found listing with ID: AV97332
2026-03-30 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV97332%27 HTTP/1.1" 200 None
2026-03-30 08:03:01 [auto1.es] INFO: Scrape type for AV97332: 0
2026-03-30 08:03:01 [auto1.es] INFO: Found listing with ID: EH44076
2026-03-30 08:03:01 [auto1.es] INFO: Found listing with ID: LT61588
2026-03-30 08:03:01 [auto1.es] INFO: Found listing with ID: HJ75824
2026-03-30 08:03:01 [auto1.es] INFO: Found listing with ID: PE24027
2026-03-30 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE24027%27 HTTP/1.1" 200 None
2026-03-30 08:03:01 [auto1.es] INFO: Scrape type for PE24027: 0
2026-03-30 08:03:01 [auto1.es] INFO: Found listing with ID: ZL28914
2026-03-30 08:03:01 [auto1.es] INFO: Found listing with ID: HB55085
2026-03-30 08:03:01 [auto1.es] INFO: Found listing with ID: LU70143
2026-03-30 08:03:01 [auto1.es] INFO: Found listing with ID: SH67409
2026-03-30 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH67409%27 HTTP/1.1" 200 None
2026-03-30 08:03:01 [auto1.es] INFO: Scrape type for SH67409: 0
2026-03-30 08:03:01 [auto1.es] INFO: Found listing with ID: VE50785
2026-03-30 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE50785%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for VE50785: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: PC36576
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC36576%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for PC36576: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: LX82632
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX82632%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for LX82632: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: PJ00608
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ00608%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for PJ00608: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: RY19109
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY19109%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for RY19109: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: RK31632
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: ZA80784
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: RH35807
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: AP01935
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP01935%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for AP01935: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: FK59567
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: HA98182
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: LC81120
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC81120%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for LC81120: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: NG74473
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG74473%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for NG74473: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: HB38669
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB38669%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for HB38669: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: WH24419
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: GF99536
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: JX70017
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX70017%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for JX70017: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: PL21143
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL21143%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for PL21143: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: PD17011
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: GZ61403
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ61403%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for GZ61403: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: CW88498
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW88498%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for CW88498: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: MG47386
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG47386%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for MG47386: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: RT90695
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: BF22404
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF22404%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for BF22404: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: TF90504
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: BL42593
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: EL32039
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: HG47154
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG47154%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for HG47154: 0
2026-03-30 08:03:02 [auto1.es] INFO: Found listing with ID: NM67545
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM67545%27 HTTP/1.1" 200 None
2026-03-30 08:03:02 [auto1.es] INFO: Scrape type for NM67545: 0
2026-03-30 08:03:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:03 [auto1.es] INFO: Channel: 24h | Page: 27 | totalHits: 2178 | hits on page: 40
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: HZ40578
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: GG84553
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG84553%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for GG84553: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: SM50481
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: KG64326
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: HF28057
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF28057%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for HF28057: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: AD15625
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD15625%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for AD15625: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: DV59548
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV59548%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for DV59548: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: XC28006
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC28006%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for XC28006: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: ZY07880
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY07880%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for ZY07880: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: EZ75681
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: GT68357
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT68357%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for GT68357: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: MZ54464
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: NM44751
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: BT54234
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT54234%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for BT54234: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: ZP51440
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: MM77073
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: GT62572
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: AK44201
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK44201%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for AK44201: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: XC60196
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: XT74556
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT74556%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for XT74556: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: YM46867
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: WH83968
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH83968%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for WH83968: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: KS63423
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: KP83247
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: ET28977
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: GM08675
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: RX29075
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: PP39110
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: XS51461
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: YG24338
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: ZY52551
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: RJ73355
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ73355%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for RJ73355: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: SK48295
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: BG55573
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: FP05442
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP05442%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for FP05442: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: FB43319
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB43319%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for FB43319: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: FM79545
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: TC59600
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: WP31785
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP31785%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for WP31785: 0
2026-03-30 08:03:03 [auto1.es] INFO: Found listing with ID: WA45592
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA45592%27 HTTP/1.1" 200 None
2026-03-30 08:03:03 [auto1.es] INFO: Scrape type for WA45592: 0
2026-03-30 08:03:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:04 [auto1.es] INFO: Channel: 24h | Page: 28 | totalHits: 2178 | hits on page: 40
2026-03-30 08:03:04 [auto1.es] INFO: Found listing with ID: FG05757
2026-03-30 08:03:04 [auto1.es] INFO: Found listing with ID: PD85443
2026-03-30 08:03:04 [auto1.es] INFO: Found listing with ID: SR16333
2026-03-30 08:03:04 [auto1.es] INFO: Found listing with ID: KB02477
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB02477%27 HTTP/1.1" 200 None
2026-03-30 08:03:04 [auto1.es] INFO: Scrape type for KB02477: 0
2026-03-30 08:03:04 [auto1.es] INFO: Found listing with ID: GS63441
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS63441%27 HTTP/1.1" 200 None
2026-03-30 08:03:04 [auto1.es] INFO: Scrape type for GS63441: 0
2026-03-30 08:03:04 [auto1.es] INFO: Found listing with ID: WY33726
2026-03-30 08:03:04 [auto1.es] INFO: Found listing with ID: UN48469
2026-03-30 08:03:04 [auto1.es] INFO: Found listing with ID: TJ35606
2026-03-30 08:03:04 [auto1.es] INFO: Found listing with ID: PD75300
2026-03-30 08:03:04 [auto1.es] INFO: Found listing with ID: MS70085
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS70085%27 HTTP/1.1" 200 None
2026-03-30 08:03:04 [auto1.es] INFO: Scrape type for MS70085: 0
2026-03-30 08:03:04 [auto1.es] INFO: Found listing with ID: PN16892
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN16892%27 HTTP/1.1" 200 None
2026-03-30 08:03:04 [auto1.es] INFO: Scrape type for PN16892: 2
2026-03-30 08:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8e50e25-000c-54a8-8c53-1eef62e48de1 with identifier: PN16892
2026-03-30 08:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8e50e25-000c-54a8-8c53-1eef62e48de1 with scrape type 2
2026-03-30 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8e50e25-000c-54a8-8c53-1eef62e48de1 with scrape type 2
2026-03-30 08:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8e50e25-000c-54a8-8c53-1eef62e48de1, identifier: PN16892
2026-03-30 08:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8e50e25-000c-54a8-8c53-1eef62e48de1 with identifier: PN16892
2026-03-30 08:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8e50e25-000c-54a8-8c53-1eef62e48de1 with identifier: PN16892
2026-03-30 08:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c8e50e25-000c-54a8-8c53-1eef62e48de1 with identifier: PN16892 to the API
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:00:32Z',
 'fuel_type': 'diesel',
 'id': 'c8e50e25-000c-54a8-8c53-1eef62e48de1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN16892',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 113549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2017}
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN16892%27 HTTP/1.1" 200 None
2026-03-30 08:03:04 [auto1.es] INFO: Saving data for PN16892: {'auction_closing_time': 1774882832.0, 'created_time': 1773934247.585498, 'last_price_update_time': 1774857784.983449}
2026-03-30 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PN16892') HTTP/1.1" 204 0
2026-03-30 08:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: PS31871
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS31871%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Scrape type for PS31871: 0
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: XV71103
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: LG37212
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG37212%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Scrape type for LG37212: 0
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: DG38450
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: RP86418
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP86418%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Scrape type for RP86418: 0
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: MH48496
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH48496%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Scrape type for MH48496: 0
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: RD09772
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: MM73463
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM73463%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Scrape type for MM73463: 0
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: ZR14615
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR14615%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Scrape type for ZR14615: 0
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: ES15520
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES15520%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Scrape type for ES15520: 0
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: LR89235
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: UF76170
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: HS16028
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: HT23405
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: FH47587
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: PJ49539
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: GB32148
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: NM59518
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: JJ75829
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: LS97770
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: VK38327
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK38327%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Scrape type for VK38327: 0
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: XK60422
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK60422%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Scrape type for XK60422: 0
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: GW16894
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: LP80713
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP80713%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Scrape type for LP80713: 0
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: LA45475
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA45475%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Scrape type for LA45475: 0
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: FT33215
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: UD26451
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD26451%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Scrape type for UD26451: 2
2026-03-30 08:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fc70589-9c16-52ca-92ce-266aadc773d6 with identifier: UD26451
2026-03-30 08:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc70589-9c16-52ca-92ce-266aadc773d6 with scrape type 2
2026-03-30 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fc70589-9c16-52ca-92ce-266aadc773d6 with scrape type 2
2026-03-30 08:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0fc70589-9c16-52ca-92ce-266aadc773d6, identifier: UD26451
2026-03-30 08:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0fc70589-9c16-52ca-92ce-266aadc773d6 with identifier: UD26451
2026-03-30 08:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0fc70589-9c16-52ca-92ce-266aadc773d6 with identifier: UD26451
2026-03-30 08:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0fc70589-9c16-52ca-92ce-266aadc773d6 with identifier: UD26451 to the API
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:31:10Z',
 'fuel_type': 'diesel',
 'id': '0fc70589-9c16-52ca-92ce-266aadc773d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD26451',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 102924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion BlueMotion',
 'year': 2017}
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD26451%27 HTTP/1.1" 200 None
2026-03-30 08:03:05 [auto1.es] INFO: Saving data for UD26451: {'auction_closing_time': 1774884670.0, 'created_time': 1773932625.503548, 'last_price_update_time': 1774857785.7667}
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UD26451') HTTP/1.1" 204 0
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: FY66249
2026-03-30 08:03:05 [auto1.es] INFO: Found listing with ID: LK07555
2026-03-30 08:03:05 [scrapy.extensions.logstats] INFO: Crawled 74 pages (at 15 pages/min), scraped 240 items (at 92 items/min)
2026-03-30 08:03:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 08:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:06 [auto1.es] INFO: Channel: 24h | Page: 29 | totalHits: 2178 | hits on page: 40
2026-03-30 08:03:06 [auto1.es] INFO: Found listing with ID: LF19420
2026-03-30 08:03:06 [auto1.es] INFO: Found listing with ID: NJ00425
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ00425%27 HTTP/1.1" 200 None
2026-03-30 08:03:06 [auto1.es] INFO: Scrape type for NJ00425: 0
2026-03-30 08:03:06 [auto1.es] INFO: Found listing with ID: MA33029
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA33029%27 HTTP/1.1" 200 None
2026-03-30 08:03:06 [auto1.es] INFO: Scrape type for MA33029: 0
2026-03-30 08:03:06 [auto1.es] INFO: Found listing with ID: LX51563
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX51563%27 HTTP/1.1" 200 None
2026-03-30 08:03:06 [auto1.es] INFO: Scrape type for LX51563: 0
2026-03-30 08:03:06 [auto1.es] INFO: Found listing with ID: YH79403
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH79403%27 HTTP/1.1" 200 None
2026-03-30 08:03:06 [auto1.es] INFO: Scrape type for YH79403: 0
2026-03-30 08:03:06 [auto1.es] INFO: Found listing with ID: MA08789
2026-03-30 08:03:06 [auto1.es] INFO: Found listing with ID: LG55317
2026-03-30 08:03:06 [auto1.es] INFO: Found listing with ID: JW67554
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW67554%27 HTTP/1.1" 200 None
2026-03-30 08:03:06 [auto1.es] INFO: Scrape type for JW67554: 0
2026-03-30 08:03:06 [auto1.es] INFO: Found listing with ID: UD21856
2026-03-30 08:03:06 [auto1.es] INFO: Found listing with ID: ZS20717
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS20717%27 HTTP/1.1" 200 None
2026-03-30 08:03:06 [auto1.es] INFO: Scrape type for ZS20717: 0
2026-03-30 08:03:06 [auto1.es] INFO: Found listing with ID: TA73897
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA73897%27 HTTP/1.1" 200 None
2026-03-30 08:03:06 [auto1.es] INFO: Scrape type for TA73897: 2
2026-03-30 08:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 438b4245-e4a0-539d-9580-4355ee8df827 with identifier: TA73897
2026-03-30 08:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 438b4245-e4a0-539d-9580-4355ee8df827 with scrape type 2
2026-03-30 08:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 438b4245-e4a0-539d-9580-4355ee8df827 with scrape type 2
2026-03-30 08:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 438b4245-e4a0-539d-9580-4355ee8df827, identifier: TA73897
2026-03-30 08:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 438b4245-e4a0-539d-9580-4355ee8df827 with identifier: TA73897
2026-03-30 08:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 438b4245-e4a0-539d-9580-4355ee8df827 with identifier: TA73897
2026-03-30 08:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 438b4245-e4a0-539d-9580-4355ee8df827 with identifier: TA73897 to the API
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:36:49Z',
 'fuel_type': 'diesel',
 'id': '438b4245-e4a0-539d-9580-4355ee8df827',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA73897',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 132503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-05',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2017}
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA73897%27 HTTP/1.1" 200 None
2026-03-30 08:03:07 [auto1.es] INFO: Saving data for TA73897: {'auction_closing_time': 1774885009.0, 'created_time': 1773130353.082261, 'last_price_update_time': 1774857787.39295}
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TA73897') HTTP/1.1" 204 0
2026-03-30 08:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:07 [auto1.es] INFO: Found listing with ID: HH46764
2026-03-30 08:03:07 [auto1.es] INFO: Found listing with ID: GY66563
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY66563%27 HTTP/1.1" 200 None
2026-03-30 08:03:07 [auto1.es] INFO: Scrape type for GY66563: 0
2026-03-30 08:03:07 [auto1.es] INFO: Found listing with ID: HW09758
2026-03-30 08:03:07 [auto1.es] INFO: Found listing with ID: JY07683
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY07683%27 HTTP/1.1" 200 None
2026-03-30 08:03:07 [auto1.es] INFO: Scrape type for JY07683: 0
2026-03-30 08:03:07 [auto1.es] INFO: Found listing with ID: BV18028
2026-03-30 08:03:07 [auto1.es] INFO: Found listing with ID: CV84892
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV84892%27 HTTP/1.1" 200 None
2026-03-30 08:03:07 [auto1.es] INFO: Scrape type for CV84892: 0
2026-03-30 08:03:07 [auto1.es] INFO: Found listing with ID: LG59471
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG59471%27 HTTP/1.1" 200 None
2026-03-30 08:03:07 [auto1.es] INFO: Scrape type for LG59471: 0
2026-03-30 08:03:07 [auto1.es] INFO: Found listing with ID: SU85789
2026-03-30 08:03:07 [auto1.es] INFO: Found listing with ID: HE05235
2026-03-30 08:03:07 [auto1.es] INFO: Found listing with ID: XH86580
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH86580%27 HTTP/1.1" 200 None
2026-03-30 08:03:07 [auto1.es] INFO: Scrape type for XH86580: 0
2026-03-30 08:03:07 [auto1.es] INFO: Found listing with ID: PP21573
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP21573%27 HTTP/1.1" 200 None
2026-03-30 08:03:07 [auto1.es] INFO: Scrape type for PP21573: 2
2026-03-30 08:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ca98239-e44b-5822-8897-d54d4791dd66 with identifier: PP21573
2026-03-30 08:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ca98239-e44b-5822-8897-d54d4791dd66 with scrape type 2
2026-03-30 08:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ca98239-e44b-5822-8897-d54d4791dd66 with scrape type 2
2026-03-30 08:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ca98239-e44b-5822-8897-d54d4791dd66, identifier: PP21573
2026-03-30 08:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ca98239-e44b-5822-8897-d54d4791dd66 with identifier: PP21573
2026-03-30 08:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ca98239-e44b-5822-8897-d54d4791dd66 with identifier: PP21573
2026-03-30 08:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ca98239-e44b-5822-8897-d54d4791dd66 with identifier: PP21573 to the API
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:38:01Z',
 'fuel_type': 'diesel',
 'id': '1ca98239-e44b-5822-8897-d54d4791dd66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP21573',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 231892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-11',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2011}
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP21573%27 HTTP/1.1" 200 None
2026-03-30 08:03:08 [auto1.es] INFO: Saving data for PP21573: {'auction_closing_time': 1774885081.0, 'created_time': 1774555380.346497, 'last_price_update_time': 1774857788.052695}
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PP21573') HTTP/1.1" 204 0
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: ZE71239
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: FF26714
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: NC38723
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: XX72262
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX72262%27 HTTP/1.1" 200 None
2026-03-30 08:03:08 [auto1.es] INFO: Scrape type for XX72262: 0
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: LG94479
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: DZ42678
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: ZS73380
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: DB92602
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB92602%27 HTTP/1.1" 200 None
2026-03-30 08:03:08 [auto1.es] INFO: Scrape type for DB92602: 0
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: AL10193
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: JH13002
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: NZ88130
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: PM27944
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM27944%27 HTTP/1.1" 200 None
2026-03-30 08:03:08 [auto1.es] INFO: Scrape type for PM27944: 0
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: CT66486
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: CL84602
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: RF22633
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF22633%27 HTTP/1.1" 200 None
2026-03-30 08:03:08 [auto1.es] INFO: Scrape type for RF22633: 0
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: DD15597
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD15597%27 HTTP/1.1" 200 None
2026-03-30 08:03:08 [auto1.es] INFO: Scrape type for DD15597: 0
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: AS08117
2026-03-30 08:03:08 [auto1.es] INFO: Found listing with ID: HE42254
2026-03-30 08:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:09 [auto1.es] INFO: Channel: 24h | Page: 30 | totalHits: 2178 | hits on page: 40
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: RB01014
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB01014%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for RB01014: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: GP88698
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP88698%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for GP88698: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: JD79732
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JD79732%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for JD79732: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: DL05579
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: RK45787
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK45787%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for RK45787: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: DR60635
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR60635%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for DR60635: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: RR55958
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: XH33697
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH33697%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for XH33697: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: CH33556
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH33556%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for CH33556: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: ZE13912
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE13912%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for ZE13912: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: FJ63213
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ63213%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for FJ63213: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: MJ15003
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: EN16009
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN16009%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for EN16009: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: LN78930
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN78930%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for LN78930: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: VU96042
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU96042%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for VU96042: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: FL07647
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: SB36142
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: VC51295
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC51295%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for VC51295: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: TN84578
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN84578%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for TN84578: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: WH54771
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: BC37690
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: XY62505
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: AK05110
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK05110%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for AK05110: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: CC73171
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC73171%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for CC73171: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: JL87579
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: MS33551
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: HV86151
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV86151%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for HV86151: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: YZ57313
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: WH79460
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH79460%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for WH79460: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: ZN70323
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: AG66489
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: SW56869
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: VM02811
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: VJ40506
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: BX46671
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: CW49447
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW49447%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for CW49447: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: HY73546
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: MG44284
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: FA05527
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA05527%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for FA05527: 0
2026-03-30 08:03:09 [auto1.es] INFO: Found listing with ID: VV22800
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV22800%27 HTTP/1.1" 200 None
2026-03-30 08:03:09 [auto1.es] INFO: Scrape type for VV22800: 0
2026-03-30 08:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:10 [auto1.es] INFO: Channel: 24h | Page: 31 | totalHits: 2178 | hits on page: 40
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: JC46060
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC46060%27 HTTP/1.1" 200 None
2026-03-30 08:03:10 [auto1.es] INFO: Scrape type for JC46060: 0
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: SM77284
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM77284%27 HTTP/1.1" 200 None
2026-03-30 08:03:10 [auto1.es] INFO: Scrape type for SM77284: 0
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: AG32524
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG32524%27 HTTP/1.1" 200 None
2026-03-30 08:03:10 [auto1.es] INFO: Scrape type for AG32524: 0
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: BK45760
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK45760%27 HTTP/1.1" 200 None
2026-03-30 08:03:10 [auto1.es] INFO: Scrape type for BK45760: 0
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: YF13100
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: PH11049
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH11049%27 HTTP/1.1" 200 None
2026-03-30 08:03:10 [auto1.es] INFO: Scrape type for PH11049: 0
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: XY25635
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: NK92990
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: WP66264
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP66264%27 HTTP/1.1" 200 None
2026-03-30 08:03:10 [auto1.es] INFO: Scrape type for WP66264: 0
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: LG93188
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG93188%27 HTTP/1.1" 200 None
2026-03-30 08:03:10 [auto1.es] INFO: Scrape type for LG93188: 0
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: UR64839
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR64839%27 HTTP/1.1" 200 None
2026-03-30 08:03:10 [auto1.es] INFO: Scrape type for UR64839: 0
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: BT14659
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT14659%27 HTTP/1.1" 200 None
2026-03-30 08:03:10 [auto1.es] INFO: Scrape type for BT14659: 0
2026-03-30 08:03:10 [auto1.es] INFO: Found listing with ID: TR46498
2026-03-30 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR46498%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for TR46498: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: NN09509
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN09509%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for NN09509: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: LL30707
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL30707%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for LL30707: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: XY10294
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY10294%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for XY10294: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: FD66693
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD66693%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for FD66693: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: FL72079
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL72079%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for FL72079: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: DC98818
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC98818%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for DC98818: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: YG93174
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG93174%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for YG93174: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: RF10879
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF10879%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for RF10879: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: LV62700
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: TS70412
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS70412%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for TS70412: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: UA50937
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA50937%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for UA50937: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: ZH85985
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH85985%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for ZH85985: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: LC97484
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC97484%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for LC97484: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: EE07728
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: CV75612
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: ZJ52163
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ52163%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for ZJ52163: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: BL83097
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: TV15408
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV15408%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for TV15408: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: XH71672
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: CH38483
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: YH80645
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: JP11260
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: TN34966
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: NK34270
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK34270%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for NK34270: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: WW97634
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: CZ73203
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ73203%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for CZ73203: 0
2026-03-30 08:03:11 [auto1.es] INFO: Found listing with ID: LV49477
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV49477%27 HTTP/1.1" 200 None
2026-03-30 08:03:11 [auto1.es] INFO: Scrape type for LV49477: 0
2026-03-30 08:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:13 [auto1.es] INFO: Channel: 24h | Page: 32 | totalHits: 2178 | hits on page: 40
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: KX05892
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX05892%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for KX05892: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: TV57362
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV57362%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for TV57362: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: PH10774
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: JZ86442
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: CZ94183
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: NM83304
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM83304%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for NM83304: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: YC76181
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: FD92977
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD92977%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for FD92977: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: GY52926
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY52926%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for GY52926: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: VF82701
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: NZ53366
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ53366%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for NZ53366: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: LR10742
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: RV28339
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: JM46031
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM46031%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for JM46031: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: UV92160
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: XX07827
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: YL57759
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL57759%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for YL57759: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: SJ56624
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ56624%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for SJ56624: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: VZ06267
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: PF88217
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF88217%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for PF88217: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: ZT56570
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT56570%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for ZT56570: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: NW09077
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: AB11281
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: YY21107
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: RK54634
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: YT85498
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: YC39574
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: TL16652
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL16652%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for TL16652: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: VY69585
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: EP39863
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP39863%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for EP39863: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: MA45744
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: XU33886
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU33886%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for XU33886: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: VG77720
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: CD12764
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD12764%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for CD12764: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: RL13967
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL13967%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for RL13967: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: EE62782
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: GU02949
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU02949%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for GU02949: 0
2026-03-30 08:03:13 [auto1.es] INFO: Found listing with ID: FS30541
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS30541%27 HTTP/1.1" 200 None
2026-03-30 08:03:13 [auto1.es] INFO: Scrape type for FS30541: 2
2026-03-30 08:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d14c54eb-302d-5d9b-a9b3-e2d896ef774f with identifier: FS30541
2026-03-30 08:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d14c54eb-302d-5d9b-a9b3-e2d896ef774f with scrape type 2
2026-03-30 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d14c54eb-302d-5d9b-a9b3-e2d896ef774f with scrape type 2
2026-03-30 08:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d14c54eb-302d-5d9b-a9b3-e2d896ef774f, identifier: FS30541
2026-03-30 08:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d14c54eb-302d-5d9b-a9b3-e2d896ef774f with identifier: FS30541
2026-03-30 08:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d14c54eb-302d-5d9b-a9b3-e2d896ef774f with identifier: FS30541
2026-03-30 08:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d14c54eb-302d-5d9b-a9b3-e2d896ef774f with identifier: FS30541 to the API
2026-03-30 08:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:08Z',
 'fuel_type': 'diesel',
 'id': 'd14c54eb-302d-5d9b-a9b3-e2d896ef774f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS30541',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 177979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 S AWD',
 'transmission': 'manual',
 'trim': 'S AWD',
 'year': 2018}
2026-03-30 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS30541%27 HTTP/1.1" 200 None
2026-03-30 08:03:15 [auto1.es] INFO: Saving data for FS30541: {'auction_closing_time': 1774884428.0, 'created_time': 1774555463.523061, 'last_price_update_time': 1774857795.19151}
2026-03-30 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FS30541') HTTP/1.1" 204 0
2026-03-30 08:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:15 [auto1.es] INFO: Found listing with ID: WA94101
2026-03-30 08:03:15 [auto1.es] INFO: Found listing with ID: SG84832
2026-03-30 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG84832%27 HTTP/1.1" 200 None
2026-03-30 08:03:15 [auto1.es] INFO: Scrape type for SG84832: 0
2026-03-30 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:16 [auto1.es] INFO: Channel: 24h | Page: 33 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: SG84832
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG84832%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for SG84832: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: VL72913
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: RT56400
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT56400%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for RT56400: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: DD02198
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD02198%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for DD02198: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: EN73965
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN73965%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for EN73965: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: NJ18297
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: AV04114
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: WC85393
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC85393%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for WC85393: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: CH09218
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: YD82310
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: CE26517
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE26517%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for CE26517: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: SZ71076
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: GG82225
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: GT34308
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: GY32674
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY32674%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for GY32674: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: CF71670
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF71670%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for CF71670: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: ML55356
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: EB66984
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: ES45064
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: YM72054
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: KX99272
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: BF43819
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF43819%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for BF43819: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: UU25578
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU25578%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for UU25578: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: WC57455
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: DT02195
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT02195%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for DT02195: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: SF05146
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF05146%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for SF05146: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: RH85625
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: SA98238
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: HN11800
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: TB50178
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: FU14405
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU14405%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for FU14405: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: KH58468
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH58468%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for KH58468: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: PN60622
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: PZ51501
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ51501%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for PZ51501: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: FG12610
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG12610%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for FG12610: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: FM31640
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM31640%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for FM31640: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: SP11103
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: MD28950
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD28950%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for MD28950: 0
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: GX93030
2026-03-30 08:03:16 [auto1.es] INFO: Found listing with ID: KZ85278
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ85278%27 HTTP/1.1" 200 None
2026-03-30 08:03:16 [auto1.es] INFO: Scrape type for KZ85278: 0
2026-03-30 08:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:17 [auto1.es] INFO: Channel: 24h | Page: 34 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:17 [auto1.es] INFO: Found listing with ID: KL48857
2026-03-30 08:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL48857%27 HTTP/1.1" 200 None
2026-03-30 08:03:17 [auto1.es] INFO: Scrape type for KL48857: 0
2026-03-30 08:03:17 [auto1.es] INFO: Found listing with ID: XR91515
2026-03-30 08:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR91515%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for XR91515: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: ZD58886
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD58886%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for ZD58886: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: MA84687
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: GN52396
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: ND20390
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND20390%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for ND20390: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: RW68168
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: SN05044
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: XP48517
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: DR19910
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR19910%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for DR19910: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: VW52839
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW52839%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for VW52839: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: RJ81343
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: KU93995
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: UT51740
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT51740%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for UT51740: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: CD34626
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: ZT16054
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: YY16835
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: WN15214
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: ZF10967
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: YK01379
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK01379%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for YK01379: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: VL89620
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL89620%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for VL89620: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: EV20244
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV20244%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for EV20244: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: TX42049
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: SB84191
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: WM47601
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: PL43950
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: AE81863
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE81863%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for AE81863: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: LK68537
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: NZ09379
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ09379%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for NZ09379: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: EH39769
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH39769%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for EH39769: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: SH75312
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH75312%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for SH75312: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: XD15291
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: NR06015
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR06015%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for NR06015: 0
2026-03-30 08:03:18 [auto1.es] INFO: Found listing with ID: VT03580
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT03580%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Scrape type for VT03580: 2
2026-03-30 08:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f14b57-a8ff-5a46-987c-4de21d497e35 with identifier: VT03580
2026-03-30 08:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f14b57-a8ff-5a46-987c-4de21d497e35 with scrape type 2
2026-03-30 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97f14b57-a8ff-5a46-987c-4de21d497e35 with scrape type 2
2026-03-30 08:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 97f14b57-a8ff-5a46-987c-4de21d497e35, identifier: VT03580
2026-03-30 08:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 97f14b57-a8ff-5a46-987c-4de21d497e35 with identifier: VT03580
2026-03-30 08:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 97f14b57-a8ff-5a46-987c-4de21d497e35 with identifier: VT03580
2026-03-30 08:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 97f14b57-a8ff-5a46-987c-4de21d497e35 with identifier: VT03580 to the API
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:49:02Z',
 'fuel_type': 'diesel',
 'id': '97f14b57-a8ff-5a46-987c-4de21d497e35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT03580',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 313546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-29',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Ocean Race AWD',
 'transmission': 'automatic',
 'trim': 'Ocean Race AWD',
 'year': 2011}
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT03580%27 HTTP/1.1" 200 None
2026-03-30 08:03:18 [auto1.es] INFO: Saving data for VT03580: {'auction_closing_time': 1774885742.0, 'created_time': 1773345859.468805, 'last_price_update_time': 1774857798.968182}
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VT03580') HTTP/1.1" 204 0
2026-03-30 08:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:19 [auto1.es] INFO: Found listing with ID: GY71785
2026-03-30 08:03:19 [auto1.es] INFO: Found listing with ID: DB28446
2026-03-30 08:03:19 [auto1.es] INFO: Found listing with ID: LU54456
2026-03-30 08:03:19 [auto1.es] INFO: Found listing with ID: UY97217
2026-03-30 08:03:19 [auto1.es] INFO: Found listing with ID: PK04858
2026-03-30 08:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK04858%27 HTTP/1.1" 200 None
2026-03-30 08:03:19 [auto1.es] INFO: Scrape type for PK04858: 2
2026-03-30 08:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d65790fb-b9ae-5508-a0b4-545f0cc79260 with identifier: PK04858
2026-03-30 08:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d65790fb-b9ae-5508-a0b4-545f0cc79260 with scrape type 2
2026-03-30 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d65790fb-b9ae-5508-a0b4-545f0cc79260 with scrape type 2
2026-03-30 08:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d65790fb-b9ae-5508-a0b4-545f0cc79260, identifier: PK04858
2026-03-30 08:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d65790fb-b9ae-5508-a0b4-545f0cc79260 with identifier: PK04858
2026-03-30 08:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d65790fb-b9ae-5508-a0b4-545f0cc79260 with identifier: PK04858
2026-03-30 08:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d65790fb-b9ae-5508-a0b4-545f0cc79260 with identifier: PK04858 to the API
2026-03-30 08:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:28:26Z',
 'fuel_type': 'diesel',
 'id': 'd65790fb-b9ae-5508-a0b4-545f0cc79260',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK04858',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 240123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-03',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 08:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK04858%27 HTTP/1.1" 200 None
2026-03-30 08:03:19 [auto1.es] INFO: Saving data for PK04858: {'auction_closing_time': 1774884506.0, 'created_time': 1774555410.86158, 'last_price_update_time': 1774857799.455992}
2026-03-30 08:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PK04858') HTTP/1.1" 204 0
2026-03-30 08:03:19 [auto1.es] INFO: Found listing with ID: UH45112
2026-03-30 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:20 [auto1.es] INFO: Channel: 24h | Page: 35 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:20 [auto1.es] INFO: Found listing with ID: UM71516
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM71516%27 HTTP/1.1" 200 None
2026-03-30 08:03:20 [auto1.es] INFO: Scrape type for UM71516: 0
2026-03-30 08:03:20 [auto1.es] INFO: Found listing with ID: HF92394
2026-03-30 08:03:20 [auto1.es] INFO: Found listing with ID: PX22333
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX22333%27 HTTP/1.1" 200 None
2026-03-30 08:03:20 [auto1.es] INFO: Scrape type for PX22333: 0
2026-03-30 08:03:20 [auto1.es] INFO: Found listing with ID: YF90515
2026-03-30 08:03:20 [auto1.es] INFO: Found listing with ID: SG11403
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG11403%27 HTTP/1.1" 200 None
2026-03-30 08:03:20 [auto1.es] INFO: Scrape type for SG11403: 0
2026-03-30 08:03:20 [auto1.es] INFO: Found listing with ID: DH00541
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH00541%27 HTTP/1.1" 200 None
2026-03-30 08:03:20 [auto1.es] INFO: Scrape type for DH00541: 0
2026-03-30 08:03:20 [auto1.es] INFO: Found listing with ID: YS60567
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS60567%27 HTTP/1.1" 200 None
2026-03-30 08:03:20 [auto1.es] INFO: Scrape type for YS60567: 0
2026-03-30 08:03:20 [auto1.es] INFO: Found listing with ID: HL39596
2026-03-30 08:03:20 [auto1.es] INFO: Found listing with ID: LK18237
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK18237%27 HTTP/1.1" 200 None
2026-03-30 08:03:20 [auto1.es] INFO: Scrape type for LK18237: 0
2026-03-30 08:03:20 [auto1.es] INFO: Found listing with ID: LC05327
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC05327%27 HTTP/1.1" 200 None
2026-03-30 08:03:20 [auto1.es] INFO: Scrape type for LC05327: 2
2026-03-30 08:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 793c833e-69f3-5c6f-aa36-5ad6eacb3fe2 with identifier: LC05327
2026-03-30 08:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 793c833e-69f3-5c6f-aa36-5ad6eacb3fe2 with scrape type 2
2026-03-30 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 793c833e-69f3-5c6f-aa36-5ad6eacb3fe2 with scrape type 2
2026-03-30 08:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 793c833e-69f3-5c6f-aa36-5ad6eacb3fe2, identifier: LC05327
2026-03-30 08:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 793c833e-69f3-5c6f-aa36-5ad6eacb3fe2 with identifier: LC05327
2026-03-30 08:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 793c833e-69f3-5c6f-aa36-5ad6eacb3fe2 with identifier: LC05327
2026-03-30 08:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 793c833e-69f3-5c6f-aa36-5ad6eacb3fe2 with identifier: LC05327 to the API
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:39Z',
 'fuel_type': 'petrol',
 'id': '793c833e-69f3-5c6f-aa36-5ad6eacb3fe2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC05327',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 244326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-02-29',
 'seller_name': None,
 'title': 'Honda Civic 1.6 VTEC Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2004}
2026-03-30 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC05327%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Saving data for LC05327: {'auction_closing_time': 1774884879.0, 'created_time': 1774555465.548793, 'last_price_update_time': 1774857801.001979}
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LC05327') HTTP/1.1" 204 0
2026-03-30 08:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: WA10977
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA10977%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for WA10977: 0
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: PS29729
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: WC91216
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: RV14480
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV14480%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for RV14480: 0
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: NS96167
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: MN90156
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: MW68540
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW68540%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for MW68540: 0
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: LW73612
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: SK17439
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: YY10601
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY10601%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for YY10601: 0
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: VR51792
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: HT85667
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT85667%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for HT85667: 0
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: PD96380
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD96380%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for PD96380: 0
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: MU04629
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: ZZ21581
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: GY39157
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: ED43827
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED43827%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for ED43827: 0
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: BE62587
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE62587%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for BE62587: 0
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: UR06074
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: XR92407
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: CB32241
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: XZ87449
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: GT44883
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT44883%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for GT44883: 0
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: UD00521
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD00521%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for UD00521: 0
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: NA66808
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: KR53631
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR53631%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for KR53631: 0
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: JW04171
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: YA86748
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: ZC78414
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC78414%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for ZC78414: 0
2026-03-30 08:03:21 [auto1.es] INFO: Found listing with ID: RJ55423
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ55423%27 HTTP/1.1" 200 None
2026-03-30 08:03:21 [auto1.es] INFO: Scrape type for RJ55423: 0
2026-03-30 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:22 [auto1.es] INFO: Channel: 24h | Page: 36 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: HA27882
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA27882%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for HA27882: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: TE16269
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: SK01159
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: CE82736
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE82736%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for CE82736: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: ZZ49032
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ49032%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for ZZ49032: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: SU07288
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: CP72287
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP72287%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for CP72287: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: WJ83814
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: BJ36748
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: YP76490
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: RS45242
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS45242%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for RS45242: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: NN72545
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN72545%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for NN72545: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: AB84528
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB84528%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for AB84528: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: PS20422
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS20422%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for PS20422: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: ZR59289
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR59289%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for ZR59289: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: XV33818
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV33818%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for XV33818: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: EN12947
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: KK99044
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK99044%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for KK99044: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: VL09919
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL09919%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for VL09919: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: SX15472
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX15472%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for SX15472: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: FT05886
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT05886%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for FT05886: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: DG13081
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: EU03494
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: ZC21665
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC21665%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for ZC21665: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: MF02343
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: HP01859
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: VL50797
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: WZ30869
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ30869%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for WZ30869: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: PT49535
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT49535%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for PT49535: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: ZM69944
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: YB94347
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: YB76254
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB76254%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for YB76254: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: LD17478
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: RN76428
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: GU38907
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: VG01013
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: WL49874
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL49874%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for WL49874: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: FD79630
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: WX54724
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX54724%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for WX54724: 0
2026-03-30 08:03:22 [auto1.es] INFO: Found listing with ID: MP83522
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP83522%27 HTTP/1.1" 200 None
2026-03-30 08:03:22 [auto1.es] INFO: Scrape type for MP83522: 0
2026-03-30 08:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:23 [auto1.es] INFO: Channel: 24h | Page: 37 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:23 [auto1.es] INFO: Found listing with ID: XN30812
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN30812%27 HTTP/1.1" 200 None
2026-03-30 08:03:23 [auto1.es] INFO: Scrape type for XN30812: 0
2026-03-30 08:03:23 [auto1.es] INFO: Found listing with ID: RX23320
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX23320%27 HTTP/1.1" 200 None
2026-03-30 08:03:23 [auto1.es] INFO: Scrape type for RX23320: 0
2026-03-30 08:03:23 [auto1.es] INFO: Found listing with ID: GX06456
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX06456%27 HTTP/1.1" 200 None
2026-03-30 08:03:23 [auto1.es] INFO: Scrape type for GX06456: 0
2026-03-30 08:03:23 [auto1.es] INFO: Found listing with ID: XZ41303
2026-03-30 08:03:23 [auto1.es] INFO: Found listing with ID: FK50437
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK50437%27 HTTP/1.1" 200 None
2026-03-30 08:03:23 [auto1.es] INFO: Scrape type for FK50437: 0
2026-03-30 08:03:23 [auto1.es] INFO: Found listing with ID: CJ73946
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ73946%27 HTTP/1.1" 200 None
2026-03-30 08:03:23 [auto1.es] INFO: Scrape type for CJ73946: 0
2026-03-30 08:03:23 [auto1.es] INFO: Found listing with ID: KS53137
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS53137%27 HTTP/1.1" 200 None
2026-03-30 08:03:23 [auto1.es] INFO: Scrape type for KS53137: 0
2026-03-30 08:03:23 [auto1.es] INFO: Found listing with ID: BR63324
2026-03-30 08:03:23 [auto1.es] INFO: Found listing with ID: TF28365
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF28365%27 HTTP/1.1" 200 None
2026-03-30 08:03:23 [auto1.es] INFO: Scrape type for TF28365: 2
2026-03-30 08:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cfd2cfe-70a2-522a-b41c-120aa6bf7f78 with identifier: TF28365
2026-03-30 08:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cfd2cfe-70a2-522a-b41c-120aa6bf7f78 with scrape type 2
2026-03-30 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cfd2cfe-70a2-522a-b41c-120aa6bf7f78 with scrape type 2
2026-03-30 08:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3cfd2cfe-70a2-522a-b41c-120aa6bf7f78, identifier: TF28365
2026-03-30 08:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3cfd2cfe-70a2-522a-b41c-120aa6bf7f78 with identifier: TF28365
2026-03-30 08:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3cfd2cfe-70a2-522a-b41c-120aa6bf7f78 with identifier: TF28365
2026-03-30 08:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3cfd2cfe-70a2-522a-b41c-120aa6bf7f78 with identifier: TF28365 to the API
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:17:56Z',
 'fuel_type': 'diesel',
 'id': '3cfd2cfe-70a2-522a-b41c-120aa6bf7f78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF28365',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 157651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-07',
 'seller_name': None,
 'title': 'Seat Altea 2.0 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2007}
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF28365%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Saving data for TF28365: {'auction_closing_time': 1774883876.0, 'created_time': 1774555408.721476, 'last_price_update_time': 1774857804.415632}
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TF28365') HTTP/1.1" 204 0
2026-03-30 08:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: KD08887
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD08887%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Scrape type for KD08887: 0
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: PF82044
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: VT35195
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: LU79245
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: EH02657
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH02657%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Scrape type for EH02657: 0
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: JG20309
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: LB45570
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: UV89988
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: JC23738
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: DE75422
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE75422%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Scrape type for DE75422: 0
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: UB42787
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB42787%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Scrape type for UB42787: 0
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: YU77194
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: DD46195
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD46195%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Scrape type for DD46195: 0
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: CZ41335
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: BS14602
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: WE77493
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE77493%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Scrape type for WE77493: 0
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: CW02489
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: JM60139
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: KE47103
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: YL07915
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: UX78126
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX78126%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Scrape type for UX78126: 0
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: LY43971
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY43971%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Scrape type for LY43971: 0
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: JC37021
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC37021%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Scrape type for JC37021: 0
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: ML86623
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: CL39322
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL39322%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Scrape type for CL39322: 0
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: JC17966
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: UT20809
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT20809%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Scrape type for UT20809: 0
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: MX17134
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: LK62452
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: TS75802
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS75802%27 HTTP/1.1" 200 None
2026-03-30 08:03:24 [auto1.es] INFO: Scrape type for TS75802: 0
2026-03-30 08:03:24 [auto1.es] INFO: Found listing with ID: UZ32916
2026-03-30 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:36 [auto1.es] INFO: Channel: 24h | Page: 38 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: YM80761
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM80761%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for YM80761: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: VL93613
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL93613%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for VL93613: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: YU55670
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU55670%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for YU55670: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: YS21780
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: GJ99683
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ99683%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for GJ99683: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: PC51622
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: RT35335
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT35335%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for RT35335: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: PS45222
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: TU21075
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: AP64708
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: YY12745
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: MW15131
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: TF48403
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF48403%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for TF48403: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: XL12491
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: RB88414
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB88414%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for RB88414: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: FR95558
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: XL66794
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL66794%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for XL66794: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: WE21693
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE21693%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for WE21693: 2
2026-03-30 08:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 506fc010-cc44-5512-b92b-b1992c0f5cc1 with identifier: WE21693
2026-03-30 08:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 506fc010-cc44-5512-b92b-b1992c0f5cc1 with scrape type 2
2026-03-30 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 506fc010-cc44-5512-b92b-b1992c0f5cc1 with scrape type 2
2026-03-30 08:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 506fc010-cc44-5512-b92b-b1992c0f5cc1, identifier: WE21693
2026-03-30 08:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 506fc010-cc44-5512-b92b-b1992c0f5cc1 with identifier: WE21693
2026-03-30 08:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 506fc010-cc44-5512-b92b-b1992c0f5cc1 with identifier: WE21693
2026-03-30 08:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 506fc010-cc44-5512-b92b-b1992c0f5cc1 with identifier: WE21693 to the API
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-30T15:33:53Z',
 'fuel_type': 'hybrid',
 'id': '506fc010-cc44-5512-b92b-b1992c0f5cc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE21693',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 58445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-23',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2020}
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE21693%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Saving data for WE21693: {'auction_closing_time': 1774884833.0, 'created_time': 1774468961.494868, 'last_price_update_time': 1774857816.541745}
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WE21693') HTTP/1.1" 204 0
2026-03-30 08:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: XY73701
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: FG54373
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG54373%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for FG54373: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: XS23007
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS23007%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for XS23007: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: UA81124
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA81124%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for UA81124: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: JC49855
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: GT09442
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT09442%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for GT09442: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: SN05978
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN05978%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for SN05978: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: JH04975
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH04975%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for JH04975: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: KP85608
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: EN74570
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN74570%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for EN74570: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: XA71436
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA71436%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for XA71436: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: LB26536
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB26536%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for LB26536: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: XP57901
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP57901%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for XP57901: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: BF21105
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF21105%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for BF21105: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: FN32638
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: PP85710
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: GJ06814
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: PY80888
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: WC72839
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: UF43058
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF43058%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for UF43058: 0
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: XZ49849
2026-03-30 08:03:36 [auto1.es] INFO: Found listing with ID: WW04715
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW04715%27 HTTP/1.1" 200 None
2026-03-30 08:03:36 [auto1.es] INFO: Scrape type for WW04715: 0
2026-03-30 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:38 [auto1.es] INFO: Channel: 24h | Page: 39 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: TU32370
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: YW58225
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW58225%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for YW58225: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: UZ29384
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: GR21814
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: WH26152
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH26152%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for WH26152: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: DU33012
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: GJ16527
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ16527%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for GJ16527: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: AN25119
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN25119%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for AN25119: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: EA52375
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA52375%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for EA52375: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: PD86662
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: JK64156
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: EW34917
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW34917%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for EW34917: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: XN31464
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: DF08485
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF08485%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for DF08485: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: HF43561
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: ZE85496
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: ME40836
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME40836%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for ME40836: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: MF18812
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: DU61809
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: AP77113
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: YF73149
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: KW07393
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: HC67204
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC67204%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for HC67204: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: XS50380
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: WD34727
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD34727%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for WD34727: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: BY74928
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: XA81448
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: XW29028
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW29028%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for XW29028: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: NJ73279
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: BR73846
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: LA48157
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA48157%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for LA48157: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: YX91165
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: UU20141
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: TR96675
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR96675%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for TR96675: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: DW68520
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: VB99654
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB99654%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for VB99654: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: PK37230
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK37230%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for PK37230: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: DR08098
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: YP54060
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP54060%27 HTTP/1.1" 200 None
2026-03-30 08:03:38 [auto1.es] INFO: Scrape type for YP54060: 0
2026-03-30 08:03:38 [auto1.es] INFO: Found listing with ID: WC06824
2026-03-30 08:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:39 [auto1.es] INFO: Channel: 24h | Page: 40 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: AJ61664
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ61664%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for AJ61664: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: FR40817
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: FJ48335
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ48335%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for FJ48335: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: DL11284
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL11284%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for DL11284: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: SK07271
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: VY31603
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: XW86216
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW86216%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for XW86216: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: XH48089
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: EN05559
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN05559%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for EN05559: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: ZL78219
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL78219%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for ZL78219: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: TV08054
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: KV41270
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV41270%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for KV41270: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: TV36544
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: NY16020
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: XJ18059
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: ZZ18199
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: SL87514
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL87514%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for SL87514: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: TR33339
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: LV56361
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: JW07247
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: VY28267
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY28267%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for VY28267: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: ZW73484
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: JF75670
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: EU98432
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: FH30373
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH30373%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for FH30373: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: FP96823
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: LS36094
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS36094%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for LS36094: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: UK08613
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: XX98366
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX98366%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for XX98366: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: LL24572
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL24572%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for LL24572: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: NL75511
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: FT04300
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT04300%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for FT04300: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: BP62909
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP62909%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for BP62909: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: GX91950
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX91950%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for GX91950: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: TZ81028
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ81028%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for TZ81028: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: ZC95482
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC95482%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for ZC95482: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: UB71741
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB71741%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for UB71741: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: XJ69303
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: UU89702
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU89702%27 HTTP/1.1" 200 None
2026-03-30 08:03:39 [auto1.es] INFO: Scrape type for UU89702: 0
2026-03-30 08:03:39 [auto1.es] INFO: Found listing with ID: GF25247
2026-03-30 08:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:40 [auto1.es] INFO: Channel: 24h | Page: 41 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:40 [auto1.es] INFO: Found listing with ID: GG25367
2026-03-30 08:03:40 [auto1.es] INFO: Found listing with ID: PR26492
2026-03-30 08:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR26492%27 HTTP/1.1" 200 None
2026-03-30 08:03:40 [auto1.es] INFO: Scrape type for PR26492: 0
2026-03-30 08:03:40 [auto1.es] INFO: Found listing with ID: JC38983
2026-03-30 08:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC38983%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for JC38983: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: VC68158
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: YS92814
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: VR01411
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: PD45625
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: CU51757
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: VY26684
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY26684%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for VY26684: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: ND59157
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND59157%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for ND59157: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: MK23766
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: VC05043
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC05043%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for VC05043: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: UH68821
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: UP55531
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: KK03288
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK03288%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for KK03288: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: BR35184
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR35184%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for BR35184: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: HP42544
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP42544%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for HP42544: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: AR59073
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: FG15461
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG15461%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for FG15461: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: NB66504
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: PN97483
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN97483%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for PN97483: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: CR84391
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR84391%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for CR84391: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: UP27315
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: KD09714
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD09714%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for KD09714: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: WU84058
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: ZM86466
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM86466%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for ZM86466: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: VM24550
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: VP18393
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP18393%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for VP18393: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: MZ62170
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: GV40212
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV40212%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for GV40212: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: LJ17115
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ17115%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for LJ17115: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: JT33139
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT33139%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for JT33139: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: NY33487
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY33487%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for NY33487: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: NW63422
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: XN45249
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: DS74778
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS74778%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for DS74778: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: MD70003
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD70003%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for MD70003: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: TB74372
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB74372%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for TB74372: 0
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: AM05329
2026-03-30 08:03:41 [auto1.es] INFO: Found listing with ID: BY33283
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY33283%27 HTTP/1.1" 200 None
2026-03-30 08:03:41 [auto1.es] INFO: Scrape type for BY33283: 0
2026-03-30 08:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:45 [auto1.es] INFO: Channel: 24h | Page: 42 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: UP13396
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: VU28227
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: ZL27133
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL27133%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for ZL27133: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: JZ51794
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ51794%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for JZ51794: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: AP64153
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP64153%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for AP64153: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: RD07091
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: DK89612
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: JG89903
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: LE34718
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: GX38118
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: ZM34932
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: CG09187
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG09187%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for CG09187: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: TB67105
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB67105%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for TB67105: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: EB62750
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB62750%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for EB62750: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: TK95363
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: WN54679
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN54679%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for WN54679: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: SW23101
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW23101%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for SW23101: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: LC59267
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC59267%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for LC59267: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: YD48242
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: KF74515
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF74515%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for KF74515: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: YK51395
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: ZL32724
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: GL92788
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: VF01083
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: BG05674
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: JG83987
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: FZ04394
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ04394%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for FZ04394: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: UD80298
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: KD32086
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD32086%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for KD32086: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: YL06778
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: AV93278
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: MP31569
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP31569%27 HTTP/1.1" 200 None
2026-03-30 08:03:45 [auto1.es] INFO: Scrape type for MP31569: 0
2026-03-30 08:03:45 [auto1.es] INFO: Found listing with ID: GR78945
2026-03-30 08:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR78945%27 HTTP/1.1" 200 None
2026-03-30 08:03:46 [auto1.es] INFO: Scrape type for GR78945: 0
2026-03-30 08:03:46 [auto1.es] INFO: Found listing with ID: CR48575
2026-03-30 08:03:46 [auto1.es] INFO: Found listing with ID: JY09497
2026-03-30 08:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY09497%27 HTTP/1.1" 200 None
2026-03-30 08:03:46 [auto1.es] INFO: Scrape type for JY09497: 0
2026-03-30 08:03:46 [auto1.es] INFO: Found listing with ID: BZ21450
2026-03-30 08:03:46 [auto1.es] INFO: Found listing with ID: JX90216
2026-03-30 08:03:46 [auto1.es] INFO: Found listing with ID: UT89838
2026-03-30 08:03:46 [auto1.es] INFO: Found listing with ID: DC35826
2026-03-30 08:03:46 [auto1.es] INFO: Found listing with ID: UN21453
2026-03-30 08:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN21453%27 HTTP/1.1" 200 None
2026-03-30 08:03:46 [auto1.es] INFO: Scrape type for UN21453: 0
2026-03-30 08:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:47 [auto1.es] INFO: Channel: 24h | Page: 43 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: FG81749
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG81749%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for FG81749: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: SJ07079
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: PP93305
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP93305%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for PP93305: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: BR13060
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR13060%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for BR13060: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: HA51253
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA51253%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for HA51253: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: RR74853
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR74853%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for RR74853: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: GE94512
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: CY04008
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: ST64769
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST64769%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for ST64769: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: JV95856
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JV95856%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for JV95856: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: CM70741
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: ZS64271
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: WB36611
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB36611%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for WB36611: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: DD74793
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: DC47971
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: KC53673
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC53673%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for KC53673: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: VT11458
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT11458%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for VT11458: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: XC40695
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC40695%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for XC40695: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: BM28897
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM28897%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for BM28897: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: TT72287
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: EY91693
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY91693%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for EY91693: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: NG44542
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: PW28611
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: ME07403
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: JR29098
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR29098%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for JR29098: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: JE65744
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE65744%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for JE65744: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: LC77404
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: RU65769
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU65769%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for RU65769: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: FK65100
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK65100%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for FK65100: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: LS69638
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: XG18917
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG18917%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for XG18917: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: FU29422
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: JK63504
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK63504%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for JK63504: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: FX14772
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX14772%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for FX14772: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: ML17412
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML17412%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for ML17412: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: KC46578
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC46578%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for KC46578: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: XR73155
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR73155%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for XR73155: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: RK55405
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: MW76524
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW76524%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for MW76524: 0
2026-03-30 08:03:47 [auto1.es] INFO: Found listing with ID: PL96310
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL96310%27 HTTP/1.1" 200 None
2026-03-30 08:03:47 [auto1.es] INFO: Scrape type for PL96310: 0
2026-03-30 08:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:48 [auto1.es] INFO: Channel: 24h | Page: 44 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: XZ20616
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: VU00284
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU00284%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for VU00284: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: NF35716
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: XA12312
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: DL51279
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: KD88168
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: LP98864
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: SZ95909
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: YK45669
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: XX41705
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: ZN14981
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN14981%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for ZN14981: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: KE50509
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE50509%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for KE50509: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: RR11017
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: WX13119
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX13119%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for WX13119: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: XF66468
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: JE90684
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE90684%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for JE90684: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: CT91769
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: WZ85087
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ85087%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for WZ85087: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: AE24734
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: TT49974
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: YW75502
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW75502%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for YW75502: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: JY28028
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: ER70032
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: CT45338
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: LV60077
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV60077%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for LV60077: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: WZ34012
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ34012%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for WZ34012: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: BP77567
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP77567%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for BP77567: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: MT58726
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT58726%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for MT58726: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: ZW56409
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW56409%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for ZW56409: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: KT63961
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: ZA21810
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: VR29926
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR29926%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for VR29926: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: SV29323
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV29323%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for SV29323: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: VT96833
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT96833%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for VT96833: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: BE63337
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE63337%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for BE63337: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: RH33829
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH33829%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for RH33829: 0
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: RK09701
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: GC12859
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: SM51869
2026-03-30 08:03:48 [auto1.es] INFO: Found listing with ID: MY48214
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY48214%27 HTTP/1.1" 200 None
2026-03-30 08:03:48 [auto1.es] INFO: Scrape type for MY48214: 0
2026-03-30 08:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:49 [auto1.es] INFO: Channel: 24h | Page: 45 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:49 [auto1.es] INFO: Found listing with ID: EY86051
2026-03-30 08:03:49 [auto1.es] INFO: Found listing with ID: UN59874
2026-03-30 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN59874%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for UN59874: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: DH56387
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH56387%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for DH56387: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: XU82709
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: SC27418
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC27418%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for SC27418: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: ZJ95453
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ95453%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for ZJ95453: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: HR31272
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR31272%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for HR31272: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: RH73314
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: PA92548
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: LM00276
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: YU51978
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: MA61689
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: ED57476
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED57476%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for ED57476: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: TW11063
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW11063%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for TW11063: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: RN82930
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN82930%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for RN82930: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: MF36359
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: JG85850
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: FC13262
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: ZW97071
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: EG32676
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG32676%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for EG32676: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: VC62552
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC62552%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for VC62552: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: PF61621
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF61621%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for PF61621: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: CP49442
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: WD56273
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD56273%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for WD56273: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: AD67761
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD67761%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for AD67761: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: RT04886
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: GA00375
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA00375%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for GA00375: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: ZJ56625
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ56625%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for ZJ56625: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: VN13138
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: ZC64345
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: AR88261
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR88261%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for AR88261: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: MD04984
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: MU93951
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: VZ90970
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ90970%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for VZ90970: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: ZX65175
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX65175%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for ZX65175: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: WV15930
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV15930%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for WV15930: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: WW30264
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: WX65667
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX65667%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for WX65667: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: WN06367
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN06367%27 HTTP/1.1" 200 None
2026-03-30 08:03:50 [auto1.es] INFO: Scrape type for WN06367: 0
2026-03-30 08:03:50 [auto1.es] INFO: Found listing with ID: UF95473
2026-03-30 08:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:51 [auto1.es] INFO: Channel: 24h | Page: 46 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:51 [auto1.es] INFO: Found listing with ID: TH31010
2026-03-30 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH31010%27 HTTP/1.1" 200 None
2026-03-30 08:03:51 [auto1.es] INFO: Scrape type for TH31010: 0
2026-03-30 08:03:51 [auto1.es] INFO: Found listing with ID: TZ65854
2026-03-30 08:03:51 [auto1.es] INFO: Found listing with ID: TD60260
2026-03-30 08:03:51 [auto1.es] INFO: Found listing with ID: UL24539
2026-03-30 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL24539%27 HTTP/1.1" 200 None
2026-03-30 08:03:51 [auto1.es] INFO: Scrape type for UL24539: 0
2026-03-30 08:03:51 [auto1.es] INFO: Found listing with ID: LV38775
2026-03-30 08:03:51 [auto1.es] INFO: Found listing with ID: TB73704
2026-03-30 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB73704%27 HTTP/1.1" 200 None
2026-03-30 08:03:51 [auto1.es] INFO: Scrape type for TB73704: 0
2026-03-30 08:03:51 [auto1.es] INFO: Found listing with ID: GB72499
2026-03-30 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB72499%27 HTTP/1.1" 200 None
2026-03-30 08:03:51 [auto1.es] INFO: Scrape type for GB72499: 0
2026-03-30 08:03:51 [auto1.es] INFO: Found listing with ID: WE46909
2026-03-30 08:03:51 [auto1.es] INFO: Found listing with ID: TX70336
2026-03-30 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX70336%27 HTTP/1.1" 200 None
2026-03-30 08:03:52 [auto1.es] INFO: Scrape type for TX70336: 0
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: RY22174
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: MA61086
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: YH86623
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH86623%27 HTTP/1.1" 200 None
2026-03-30 08:03:52 [auto1.es] INFO: Scrape type for YH86623: 0
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: YX68233
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: SV12911
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: EJ16249
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: GZ44252
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: FX21213
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: AS19038
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS19038%27 HTTP/1.1" 200 None
2026-03-30 08:03:52 [auto1.es] INFO: Scrape type for AS19038: 0
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: YH97828
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: BF55946
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: WV47930
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: YJ04642
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ04642%27 HTTP/1.1" 200 None
2026-03-30 08:03:52 [auto1.es] INFO: Scrape type for YJ04642: 0
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: ET46210
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: KZ49779
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ49779%27 HTTP/1.1" 200 None
2026-03-30 08:03:52 [auto1.es] INFO: Scrape type for KZ49779: 0
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: TK05995
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: FG46245
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: KP17570
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP17570%27 HTTP/1.1" 200 None
2026-03-30 08:03:52 [auto1.es] INFO: Scrape type for KP17570: 0
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: JG12549
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: KR67716
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: CA13811
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: GP65825
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: KH58937
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: ZT52456
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: LA57781
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: DM84841
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: TL38815
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: DS90195
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: FY96744
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: VP19091
2026-03-30 08:03:52 [auto1.es] INFO: Found listing with ID: NH85653
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH85653%27 HTTP/1.1" 200 None
2026-03-30 08:03:52 [auto1.es] INFO: Scrape type for NH85653: 0
2026-03-30 08:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:53 [auto1.es] INFO: Channel: 24h | Page: 47 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:53 [auto1.es] INFO: Found listing with ID: BZ65753
2026-03-30 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ65753%27 HTTP/1.1" 200 None
2026-03-30 08:03:53 [auto1.es] INFO: Scrape type for BZ65753: 0
2026-03-30 08:03:53 [auto1.es] INFO: Found listing with ID: PK26809
2026-03-30 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK26809%27 HTTP/1.1" 200 None
2026-03-30 08:03:53 [auto1.es] INFO: Scrape type for PK26809: 0
2026-03-30 08:03:53 [auto1.es] INFO: Found listing with ID: GH53703
2026-03-30 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH53703%27 HTTP/1.1" 200 None
2026-03-30 08:03:53 [auto1.es] INFO: Scrape type for GH53703: 0
2026-03-30 08:03:53 [auto1.es] INFO: Found listing with ID: HH60103
2026-03-30 08:03:53 [auto1.es] INFO: Found listing with ID: DY61189
2026-03-30 08:03:53 [auto1.es] INFO: Found listing with ID: FJ44146
2026-03-30 08:03:53 [auto1.es] INFO: Found listing with ID: SF85973
2026-03-30 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF85973%27 HTTP/1.1" 200 None
2026-03-30 08:03:53 [auto1.es] INFO: Scrape type for SF85973: 0
2026-03-30 08:03:53 [auto1.es] INFO: Found listing with ID: EK60433
2026-03-30 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK60433%27 HTTP/1.1" 200 None
2026-03-30 08:03:53 [auto1.es] INFO: Scrape type for EK60433: 0
2026-03-30 08:03:53 [auto1.es] INFO: Found listing with ID: ZT13794
2026-03-30 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT13794%27 HTTP/1.1" 200 None
2026-03-30 08:03:53 [auto1.es] INFO: Scrape type for ZT13794: 0
2026-03-30 08:03:53 [auto1.es] INFO: Found listing with ID: VA59339
2026-03-30 08:03:53 [auto1.es] INFO: Found listing with ID: DY95344
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY95344%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for DY95344: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: DC79827
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC79827%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for DC79827: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: BL04446
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: YV38932
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: MW67047
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW67047%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for MW67047: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: VU55173
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU55173%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for VU55173: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: KL23416
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: BM49479
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: ZV45444
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV45444%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for ZV45444: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: UD75301
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD75301%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for UD75301: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: CD83035
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD83035%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for CD83035: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: PZ56509
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: AJ69515
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ69515%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for AJ69515: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: YS20114
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: AU66709
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU66709%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for AU66709: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: EK69979
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: CS18132
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: AS37941
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS37941%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for AS37941: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: HC11332
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC11332%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for HC11332: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: UN29242
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN29242%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for UN29242: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: ZX62184
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX62184%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for ZX62184: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: BW10675
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW10675%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for BW10675: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: MG85806
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG85806%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for MG85806: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: DX19120
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX19120%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for DX19120: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: KS42658
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS42658%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for KS42658: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: UE67433
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE67433%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for UE67433: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: TZ01977
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ01977%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for TZ01977: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: GW37320
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: GG74961
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG74961%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for GG74961: 0
2026-03-30 08:03:54 [auto1.es] INFO: Found listing with ID: XW94395
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW94395%27 HTTP/1.1" 200 None
2026-03-30 08:03:54 [auto1.es] INFO: Scrape type for XW94395: 0
2026-03-30 08:03:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:55 [auto1.es] INFO: Channel: 24h | Page: 48 | totalHits: 2179 | hits on page: 40
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: PK32914
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: GW88114
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: RH91028
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: LZ33351
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: TR19943
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: JS77996
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: ZE40352
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: CC76703
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: ES07988
2026-03-30 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES07988%27 HTTP/1.1" 200 None
2026-03-30 08:03:55 [auto1.es] INFO: Scrape type for ES07988: 0
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: HY65431
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: RB15615
2026-03-30 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB15615%27 HTTP/1.1" 200 None
2026-03-30 08:03:55 [auto1.es] INFO: Scrape type for RB15615: 0
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: VZ79262
2026-03-30 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ79262%27 HTTP/1.1" 200 None
2026-03-30 08:03:55 [auto1.es] INFO: Scrape type for VZ79262: 0
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: HA87935
2026-03-30 08:03:55 [auto1.es] INFO: Found listing with ID: XC96716
2026-03-30 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC96716%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for XC96716: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: VC74313
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC74313%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for VC74313: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: RG03753
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG03753%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for RG03753: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: CN77625
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: XD32564
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: BB89966
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB89966%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for BB89966: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: EA80671
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA80671%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for EA80671: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: YK19704
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK19704%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for YK19704: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: AE50164
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE50164%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for AE50164: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: RK07615
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK07615%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for RK07615: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: UD30245
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: BX14033
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: FY68249
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: AA00980
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA00980%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for AA00980: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: HZ31017
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: KC96149
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: PJ13315
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ13315%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for PJ13315: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: PL39404
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: VD65621
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: HG29658
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG29658%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for HG29658: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: VM52348
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM52348%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for VM52348: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: JZ79034
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: DD78517
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: BC82698
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC82698%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for BC82698: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: ZV53496
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: ZX43091
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX43091%27 HTTP/1.1" 200 None
2026-03-30 08:03:56 [auto1.es] INFO: Scrape type for ZX43091: 0
2026-03-30 08:03:56 [auto1.es] INFO: Found listing with ID: UC73568
2026-03-30 08:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:57 [auto1.es] INFO: Channel: 24h | Page: 49 | totalHits: 2180 | hits on page: 40
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: UC73568
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: LN12503
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN12503%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for LN12503: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: GV64854
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: GY48827
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: DA78268
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA78268%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for DA78268: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: UM67436
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: PZ10001
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ10001%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for PZ10001: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: DB51566
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: HE30029
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE30029%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for HE30029: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: MG60856
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG60856%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for MG60856: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: FC66995
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: BA40352
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: AF24010
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: SR31558
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR31558%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for SR31558: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: GG87039
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG87039%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for GG87039: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: KB02091
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: MW66330
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: VA34349
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA34349%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for VA34349: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: TW43134
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: CE25443
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: MP79118
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: JM41258
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM41258%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for JM41258: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: GU18953
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU18953%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for GU18953: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: HX86510
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX86510%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for HX86510: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: MW71818
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW71818%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for MW71818: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: YA27330
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: SX49726
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: ZD82748
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD82748%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for ZD82748: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: DM23337
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: ZJ73246
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: EA73564
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA73564%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for EA73564: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: ZM37535
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM37535%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for ZM37535: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: PE94683
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: UD02034
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: FK96312
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: SL01045
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: WA68428
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: DK05159
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DK05159%27 HTTP/1.1" 200 None
2026-03-30 08:03:57 [auto1.es] INFO: Scrape type for DK05159: 0
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: VJ61216
2026-03-30 08:03:57 [auto1.es] INFO: Found listing with ID: KX75561
2026-03-30 08:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:03:58 [auto1.es] INFO: Channel: 24h | Page: 50 | totalHits: 2180 | hits on page: 40
2026-03-30 08:03:58 [auto1.es] INFO: Found listing with ID: ZE38757
2026-03-30 08:03:58 [auto1.es] INFO: Found listing with ID: HX37636
2026-03-30 08:03:58 [auto1.es] INFO: Found listing with ID: GW51820
2026-03-30 08:03:58 [auto1.es] INFO: Found listing with ID: BT71977
2026-03-30 08:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT71977%27 HTTP/1.1" 200 None
2026-03-30 08:03:58 [auto1.es] INFO: Scrape type for BT71977: 0
2026-03-30 08:03:58 [auto1.es] INFO: Found listing with ID: TH94228
2026-03-30 08:03:58 [auto1.es] INFO: Found listing with ID: JK26154
2026-03-30 08:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK26154%27 HTTP/1.1" 200 None
2026-03-30 08:03:58 [auto1.es] INFO: Scrape type for JK26154: 0
2026-03-30 08:03:58 [auto1.es] INFO: Found listing with ID: EA32126
2026-03-30 08:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA32126%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for EA32126: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: JE13816
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: XP47447
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP47447%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for XP47447: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: YV42226
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: NG71405
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: GU66337
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: CC89526
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC89526%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for CC89526: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: MY23078
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY23078%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for MY23078: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: PN58754
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN58754%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for PN58754: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: XM15498
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: XL95591
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL95591%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for XL95591: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: DA49671
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: KC85026
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC85026%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for KC85026: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: GH57787
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: BX27064
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: AT82365
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT82365%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for AT82365: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: WK81773
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: TS39016
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS39016%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for TS39016: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: TT65809
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT65809%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for TT65809: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: EH49664
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH49664%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for EH49664: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: EB66589
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: PA52283
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA52283%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for PA52283: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: PG75974
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: BE72749
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE72749%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for BE72749: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: ZK42012
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: PS53569
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS53569%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for PS53569: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: LG52328
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: RF71791
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF71791%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for RF71791: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: GE54234
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE54234%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for GE54234: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: VN90638
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: UF54007
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF54007%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for UF54007: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: DH26781
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: XP71209
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP71209%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for XP71209: 0
2026-03-30 08:03:59 [auto1.es] INFO: Found listing with ID: AT12035
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT12035%27 HTTP/1.1" 200 None
2026-03-30 08:03:59 [auto1.es] INFO: Scrape type for AT12035: 0
2026-03-30 08:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:04:03 [auto1.es] INFO: Channel: 24h | Page: 51 | totalHits: 2180 | hits on page: 40
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: CB66471
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB66471%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for CB66471: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: XJ81708
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ81708%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for XJ81708: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: BT51966
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: WU60183
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: LK89400
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: DV24306
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV24306%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for DV24306: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: TV24981
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV24981%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for TV24981: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: PC32522
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: HV31906
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV31906%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for HV31906: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: CP18304
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: YD38751
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: MF35221
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: LR44040
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: XZ62069
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ62069%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for XZ62069: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: LV43298
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV43298%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for LV43298: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: AW26906
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW26906%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for AW26906: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: BF82684
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: LS22424
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS22424%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for LS22424: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: JN16141
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: RE29158
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: XM37259
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: DD08743
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD08743%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for DD08743: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: MB84722
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: LJ76741
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: EJ15822
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ15822%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for EJ15822: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: MY16878
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: SR36141
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: PW93745
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW93745%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for PW93745: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: RW31062
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW31062%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for RW31062: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: UB86701
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: XP60269
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP60269%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for XP60269: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: KL17964
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: NM08693
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: MM24927
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: WG45325
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG45325%27 HTTP/1.1" 200 None
2026-03-30 08:04:03 [auto1.es] INFO: Scrape type for WG45325: 0
2026-03-30 08:04:03 [auto1.es] INFO: Found listing with ID: MD68479
2026-03-30 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD68479%27 HTTP/1.1" 200 None
2026-03-30 08:04:04 [auto1.es] INFO: Scrape type for MD68479: 0
2026-03-30 08:04:04 [auto1.es] INFO: Found listing with ID: AZ60367
2026-03-30 08:04:04 [auto1.es] INFO: Found listing with ID: LJ63273
2026-03-30 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ63273%27 HTTP/1.1" 200 None
2026-03-30 08:04:04 [auto1.es] INFO: Scrape type for LJ63273: 0
2026-03-30 08:04:04 [auto1.es] INFO: Found listing with ID: EH03748
2026-03-30 08:04:04 [auto1.es] INFO: Found listing with ID: GF33961
2026-03-30 08:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:04:05 [auto1.es] INFO: Channel: 24h | Page: 52 | totalHits: 2180 | hits on page: 40
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: LX05735
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX05735%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for LX05735: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: FX69665
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: NV64390
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: UH53722
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: UP08006
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP08006%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for UP08006: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: AP47288
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP47288%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for AP47288: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: EG51857
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG51857%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for EG51857: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: TS53334
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS53334%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for TS53334: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: HP31470
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: TW94946
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW94946%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for TW94946: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: KE70928
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE70928%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for KE70928: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: HX30017
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX30017%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for HX30017: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: PE66788
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: WA65207
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: SY19830
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY19830%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for SY19830: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: RR07700
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: RF07402
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF07402%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for RF07402: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: FR94321
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR94321%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for FR94321: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: UA24744
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA24744%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for UA24744: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: US29597
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: NJ67875
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ67875%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for NJ67875: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: XF82752
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: RK77233
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: YJ22884
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ22884%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for YJ22884: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: VV48329
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV48329%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for VV48329: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: NR06421
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: UE40961
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: KH51643
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH51643%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for KH51643: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: VK88655
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: VY33491
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: MK70823
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK70823%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for MK70823: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: WJ13987
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: CV66475
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV66475%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for CV66475: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: WV13003
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV13003%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for WV13003: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: RU20773
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU20773%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for RU20773: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: DX72954
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX72954%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for DX72954: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: VA33750
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA33750%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for VA33750: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: SR52978
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: BA23720
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA23720%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for BA23720: 0
2026-03-30 08:04:05 [auto1.es] INFO: Found listing with ID: PL84711
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL84711%27 HTTP/1.1" 200 None
2026-03-30 08:04:05 [auto1.es] INFO: Scrape type for PL84711: 0
2026-03-30 08:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:04:05 [scrapy.extensions.logstats] INFO: Crawled 98 pages (at 24 pages/min), scraped 248 items (at 8 items/min)
2026-03-30 08:04:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:04:07 [auto1.es] INFO: Channel: 24h | Page: 53 | totalHits: 2180 | hits on page: 40
2026-03-30 08:04:07 [auto1.es] INFO: Found listing with ID: AZ04928
2026-03-30 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ04928%27 HTTP/1.1" 200 None
2026-03-30 08:04:07 [auto1.es] INFO: Scrape type for AZ04928: 0
2026-03-30 08:04:07 [auto1.es] INFO: Found listing with ID: ZK54179
2026-03-30 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK54179%27 HTTP/1.1" 200 None
2026-03-30 08:04:07 [auto1.es] INFO: Scrape type for ZK54179: 0
2026-03-30 08:04:07 [auto1.es] INFO: Found listing with ID: JA60709
2026-03-30 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA60709%27 HTTP/1.1" 200 None
2026-03-30 08:04:08 [auto1.es] INFO: Scrape type for JA60709: 0
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: BK75900
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: EF82008
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: TX62344
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: CY52892
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY52892%27 HTTP/1.1" 200 None
2026-03-30 08:04:08 [auto1.es] INFO: Scrape type for CY52892: 0
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: RW90517
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW90517%27 HTTP/1.1" 200 None
2026-03-30 08:04:08 [auto1.es] INFO: Scrape type for RW90517: 0
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: KK87704
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK87704%27 HTTP/1.1" 200 None
2026-03-30 08:04:08 [auto1.es] INFO: Scrape type for KK87704: 0
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: AF53027
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF53027%27 HTTP/1.1" 200 None
2026-03-30 08:04:08 [auto1.es] INFO: Scrape type for AF53027: 0
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: NX17648
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX17648%27 HTTP/1.1" 200 None
2026-03-30 08:04:08 [auto1.es] INFO: Scrape type for NX17648: 0
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: RX17538
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: PP42780
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: EK21860
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: EM88527
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: ML70720
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: XA25667
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA25667%27 HTTP/1.1" 200 None
2026-03-30 08:04:08 [auto1.es] INFO: Scrape type for XA25667: 0
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: LH42756
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: YS26400
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: DL67174
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: VT22035
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: BM94316
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: NP14618
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: MS21138
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: EG18417
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: MH61134
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: SJ29812
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ29812%27 HTTP/1.1" 200 None
2026-03-30 08:04:08 [auto1.es] INFO: Scrape type for SJ29812: 0
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: YR47021
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: HD15587
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: RV46161
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: BE52894
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: VG10975
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: VC46387
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC46387%27 HTTP/1.1" 200 None
2026-03-30 08:04:08 [auto1.es] INFO: Scrape type for VC46387: 0
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: PT83214
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT83214%27 HTTP/1.1" 200 None
2026-03-30 08:04:08 [auto1.es] INFO: Scrape type for PT83214: 0
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: JM22028
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM22028%27 HTTP/1.1" 200 None
2026-03-30 08:04:08 [auto1.es] INFO: Scrape type for JM22028: 0
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: BE06656
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: BB43424
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: PP51748
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP51748%27 HTTP/1.1" 200 None
2026-03-30 08:04:08 [auto1.es] INFO: Scrape type for PP51748: 0
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: UR52438
2026-03-30 08:04:08 [auto1.es] INFO: Found listing with ID: PS14149
2026-03-30 08:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:04:09 [auto1.es] INFO: Channel: 24h | Page: 54 | totalHits: 2180 | hits on page: 40
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: KW41207
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW41207%27 HTTP/1.1" 200 None
2026-03-30 08:04:09 [auto1.es] INFO: Scrape type for KW41207: 0
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: DZ14313
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ14313%27 HTTP/1.1" 200 None
2026-03-30 08:04:09 [auto1.es] INFO: Scrape type for DZ14313: 0
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: GB85500
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: MM10114
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM10114%27 HTTP/1.1" 200 None
2026-03-30 08:04:09 [auto1.es] INFO: Scrape type for MM10114: 0
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: HB49696
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: BD69274
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD69274%27 HTTP/1.1" 200 None
2026-03-30 08:04:09 [auto1.es] INFO: Scrape type for BD69274: 0
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: ES13897
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES13897%27 HTTP/1.1" 200 None
2026-03-30 08:04:09 [auto1.es] INFO: Scrape type for ES13897: 0
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: PD50482
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD50482%27 HTTP/1.1" 200 None
2026-03-30 08:04:09 [auto1.es] INFO: Scrape type for PD50482: 0
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: FP09547
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: KU62533
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: JZ72773
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ72773%27 HTTP/1.1" 200 None
2026-03-30 08:04:09 [auto1.es] INFO: Scrape type for JZ72773: 0
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: SX89883
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: KP23641
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: FN14601
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN14601%27 HTTP/1.1" 200 None
2026-03-30 08:04:09 [auto1.es] INFO: Scrape type for FN14601: 0
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: ZT45272
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: EW17140
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW17140%27 HTTP/1.1" 200 None
2026-03-30 08:04:09 [auto1.es] INFO: Scrape type for EW17140: 0
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: GP84876
2026-03-30 08:04:09 [auto1.es] INFO: Found listing with ID: FF19626
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF19626%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for FF19626: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: GG14536
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: XF41535
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF41535%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for XF41535: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: KK57262
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK57262%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for KK57262: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: GZ44796
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: EU70316
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU70316%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for EU70316: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: PN86377
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: MF61460
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF61460%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for MF61460: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: JS10706
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS10706%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for JS10706: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: UG73300
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG73300%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for UG73300: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: CE73826
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: DW64016
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW64016%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for DW64016: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: XB82673
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: NM22189
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: BA61536
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA61536%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for BA61536: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: UP09375
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP09375%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for UP09375: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: GE22021
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE22021%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for GE22021: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: FA09072
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA09072%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for FA09072: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: ZH42049
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH42049%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for ZH42049: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: LB38939
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB38939%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for LB38939: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: RV29319
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV29319%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for RV29319: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: US62634
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US62634%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for US62634: 0
2026-03-30 08:04:10 [auto1.es] INFO: Found listing with ID: XN12672
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN12672%27 HTTP/1.1" 200 None
2026-03-30 08:04:10 [auto1.es] INFO: Scrape type for XN12672: 0
2026-03-30 08:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:04:11 [auto1.es] INFO: Channel: 24h | Page: 55 | totalHits: 2180 | hits on page: 20
2026-03-30 08:04:11 [auto1.es] INFO: Found listing with ID: YH49695
2026-03-30 08:04:11 [auto1.es] INFO: Found listing with ID: RW91373
2026-03-30 08:04:11 [auto1.es] INFO: Found listing with ID: RP67068
2026-03-30 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP67068%27 HTTP/1.1" 200 None
2026-03-30 08:04:11 [auto1.es] INFO: Scrape type for RP67068: 2
2026-03-30 08:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1abbd3e0-01a2-526e-8df7-19190935a1d8 with identifier: RP67068
2026-03-30 08:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1abbd3e0-01a2-526e-8df7-19190935a1d8 with scrape type 2
2026-03-30 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1abbd3e0-01a2-526e-8df7-19190935a1d8 with scrape type 2
2026-03-30 08:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1abbd3e0-01a2-526e-8df7-19190935a1d8, identifier: RP67068
2026-03-30 08:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1abbd3e0-01a2-526e-8df7-19190935a1d8 with identifier: RP67068
2026-03-30 08:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1abbd3e0-01a2-526e-8df7-19190935a1d8 with identifier: RP67068
2026-03-30 08:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1abbd3e0-01a2-526e-8df7-19190935a1d8 with identifier: RP67068 to the API
2026-03-30 08:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:02:03Z',
 'fuel_type': 'petrol',
 'id': '1abbd3e0-01a2-526e-8df7-19190935a1d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP67068',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 161206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-01',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Zenith 2WD',
 'transmission': 'manual',
 'trim': 'Zenith 2WD',
 'year': 2020}
2026-03-30 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP67068%27 HTTP/1.1" 200 None
2026-03-30 08:04:11 [auto1.es] INFO: Saving data for RP67068: {'auction_closing_time': 1774882923.0, 'created_time': 1772749215.864137, 'last_price_update_time': 1774857851.934943}
2026-03-30 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RP67068') HTTP/1.1" 204 0
2026-03-30 08:04:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:04:12 [auto1.es] INFO: Found listing with ID: LG74328
2026-03-30 08:04:12 [auto1.es] INFO: Found listing with ID: RF85744
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF85744%27 HTTP/1.1" 200 None
2026-03-30 08:04:12 [auto1.es] INFO: Scrape type for RF85744: 2
2026-03-30 08:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e5d7459-a842-5ef3-9f84-e532ad349a16 with identifier: RF85744
2026-03-30 08:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5d7459-a842-5ef3-9f84-e532ad349a16 with scrape type 2
2026-03-30 08:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e5d7459-a842-5ef3-9f84-e532ad349a16 with scrape type 2
2026-03-30 08:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9e5d7459-a842-5ef3-9f84-e532ad349a16, identifier: RF85744
2026-03-30 08:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9e5d7459-a842-5ef3-9f84-e532ad349a16 with identifier: RF85744
2026-03-30 08:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9e5d7459-a842-5ef3-9f84-e532ad349a16 with identifier: RF85744
2026-03-30 08:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9e5d7459-a842-5ef3-9f84-e532ad349a16 with identifier: RF85744 to the API
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:12Z',
 'fuel_type': 'diesel',
 'id': '9e5d7459-a842-5ef3-9f84-e532ad349a16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF85744',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 336471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-24',
 'seller_name': None,
 'title': 'Renault Laguna 2.0 dCi Avantage',
 'transmission': 'manual',
 'trim': 'Avantage',
 'year': 2006}
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF85744%27 HTTP/1.1" 200 None
2026-03-30 08:04:12 [auto1.es] INFO: Saving data for RF85744: {'auction_closing_time': 1774886292.0, 'created_time': 1774684826.580821, 'last_price_update_time': 1774857852.450461}
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RF85744') HTTP/1.1" 204 0
2026-03-30 08:04:12 [auto1.es] INFO: Found listing with ID: YX32704
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX32704%27 HTTP/1.1" 200 None
2026-03-30 08:04:12 [auto1.es] INFO: Scrape type for YX32704: 2
2026-03-30 08:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c4b8883-f737-5320-99c3-ad0db2ce5b3b with identifier: YX32704
2026-03-30 08:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c4b8883-f737-5320-99c3-ad0db2ce5b3b with scrape type 2
2026-03-30 08:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c4b8883-f737-5320-99c3-ad0db2ce5b3b with scrape type 2
2026-03-30 08:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9c4b8883-f737-5320-99c3-ad0db2ce5b3b, identifier: YX32704
2026-03-30 08:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9c4b8883-f737-5320-99c3-ad0db2ce5b3b with identifier: YX32704
2026-03-30 08:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9c4b8883-f737-5320-99c3-ad0db2ce5b3b with identifier: YX32704
2026-03-30 08:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9c4b8883-f737-5320-99c3-ad0db2ce5b3b with identifier: YX32704 to the API
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:31:32Z',
 'fuel_type': 'diesel',
 'id': '9c4b8883-f737-5320-99c3-ad0db2ce5b3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX32704',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 140615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-02',
 'seller_name': None,
 'title': 'Porsche Panamera Diesel Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2015}
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX32704%27 HTTP/1.1" 200 None
2026-03-30 08:04:12 [auto1.es] INFO: Saving data for YX32704: {'auction_closing_time': 1774884692.0, 'created_time': 1773127568.811858, 'last_price_update_time': 1774857852.891759}
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YX32704') HTTP/1.1" 204 0
2026-03-30 08:04:12 [auto1.es] INFO: Found listing with ID: ZG63896
2026-03-30 08:04:12 [auto1.es] INFO: Found listing with ID: XN94474
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN94474%27 HTTP/1.1" 200 None
2026-03-30 08:04:12 [auto1.es] INFO: Scrape type for XN94474: 2
2026-03-30 08:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beb55327-83d8-5f2e-8bbc-dabff0a29337 with identifier: XN94474
2026-03-30 08:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beb55327-83d8-5f2e-8bbc-dabff0a29337 with scrape type 2
2026-03-30 08:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beb55327-83d8-5f2e-8bbc-dabff0a29337 with scrape type 2
2026-03-30 08:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: beb55327-83d8-5f2e-8bbc-dabff0a29337, identifier: XN94474
2026-03-30 08:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: beb55327-83d8-5f2e-8bbc-dabff0a29337 with identifier: XN94474
2026-03-30 08:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: beb55327-83d8-5f2e-8bbc-dabff0a29337 with identifier: XN94474
2026-03-30 08:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: beb55327-83d8-5f2e-8bbc-dabff0a29337 with identifier: XN94474 to the API
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:32:34Z',
 'fuel_type': 'petrol',
 'id': 'beb55327-83d8-5f2e-8bbc-dabff0a29337',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN94474',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 88351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-01',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2013}
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN94474%27 HTTP/1.1" 200 None
2026-03-30 08:04:13 [auto1.es] INFO: Saving data for XN94474: {'auction_closing_time': 1774884754.0, 'created_time': 1774090915.919666, 'last_price_update_time': 1774857853.29309}
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XN94474') HTTP/1.1" 204 0
2026-03-30 08:04:13 [auto1.es] INFO: Found listing with ID: VU26922
2026-03-30 08:04:13 [auto1.es] INFO: Found listing with ID: AG57096
2026-03-30 08:04:13 [auto1.es] INFO: Found listing with ID: CM29770
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM29770%27 HTTP/1.1" 200 None
2026-03-30 08:04:13 [auto1.es] INFO: Scrape type for CM29770: 2
2026-03-30 08:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 366e1803-1268-58d1-ac71-0594679a9342 with identifier: CM29770
2026-03-30 08:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 366e1803-1268-58d1-ac71-0594679a9342 with scrape type 2
2026-03-30 08:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 366e1803-1268-58d1-ac71-0594679a9342 with scrape type 2
2026-03-30 08:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 366e1803-1268-58d1-ac71-0594679a9342, identifier: CM29770
2026-03-30 08:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 366e1803-1268-58d1-ac71-0594679a9342 with identifier: CM29770
2026-03-30 08:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 366e1803-1268-58d1-ac71-0594679a9342 with identifier: CM29770
2026-03-30 08:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 366e1803-1268-58d1-ac71-0594679a9342 with identifier: CM29770 to the API
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:15:04Z',
 'fuel_type': 'petrol',
 'id': '366e1803-1268-58d1-ac71-0594679a9342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM29770',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 58097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2007}
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM29770%27 HTTP/1.1" 200 None
2026-03-30 08:04:13 [auto1.es] INFO: Saving data for CM29770: {'auction_closing_time': 1774883704.0, 'created_time': 1772749431.869192, 'last_price_update_time': 1774857853.692762}
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CM29770') HTTP/1.1" 204 0
2026-03-30 08:04:13 [auto1.es] INFO: Found listing with ID: PU80612
2026-03-30 08:04:13 [auto1.es] INFO: Found listing with ID: RX82713
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX82713%27 HTTP/1.1" 200 None
2026-03-30 08:04:13 [auto1.es] INFO: Scrape type for RX82713: 2
2026-03-30 08:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a486e152-9ad0-5862-8393-6531e48ea006 with identifier: RX82713
2026-03-30 08:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a486e152-9ad0-5862-8393-6531e48ea006 with scrape type 2
2026-03-30 08:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a486e152-9ad0-5862-8393-6531e48ea006 with scrape type 2
2026-03-30 08:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a486e152-9ad0-5862-8393-6531e48ea006, identifier: RX82713
2026-03-30 08:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a486e152-9ad0-5862-8393-6531e48ea006 with identifier: RX82713
2026-03-30 08:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a486e152-9ad0-5862-8393-6531e48ea006 with identifier: RX82713
2026-03-30 08:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a486e152-9ad0-5862-8393-6531e48ea006 with identifier: RX82713 to the API
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:15:13Z',
 'fuel_type': 'diesel',
 'id': 'a486e152-9ad0-5862-8393-6531e48ea006',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX82713',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 155085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-20',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 Blue-HDi Feel Edition',
 'transmission': 'manual',
 'trim': 'Feel Edition',
 'year': 2016}
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX82713%27 HTTP/1.1" 200 None
2026-03-30 08:04:14 [auto1.es] INFO: Saving data for RX82713: {'auction_closing_time': 1774883713.0, 'created_time': 1773432062.950588, 'last_price_update_time': 1774857854.092434}
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RX82713') HTTP/1.1" 204 0
2026-03-30 08:04:14 [auto1.es] INFO: Found listing with ID: AE71783
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE71783%27 HTTP/1.1" 200 None
2026-03-30 08:04:14 [auto1.es] INFO: Scrape type for AE71783: 0
2026-03-30 08:04:14 [auto1.es] INFO: Found listing with ID: GH02704
2026-03-30 08:04:14 [auto1.es] INFO: Found listing with ID: CM09391
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM09391%27 HTTP/1.1" 200 None
2026-03-30 08:04:14 [auto1.es] INFO: Scrape type for CM09391: 2
2026-03-30 08:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd3d8aab-2d1d-5a36-a74e-1b607ee2aef4 with identifier: CM09391
2026-03-30 08:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd3d8aab-2d1d-5a36-a74e-1b607ee2aef4 with scrape type 2
2026-03-30 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd3d8aab-2d1d-5a36-a74e-1b607ee2aef4 with scrape type 2
2026-03-30 08:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cd3d8aab-2d1d-5a36-a74e-1b607ee2aef4, identifier: CM09391
2026-03-30 08:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cd3d8aab-2d1d-5a36-a74e-1b607ee2aef4 with identifier: CM09391
2026-03-30 08:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cd3d8aab-2d1d-5a36-a74e-1b607ee2aef4 with identifier: CM09391
2026-03-30 08:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cd3d8aab-2d1d-5a36-a74e-1b607ee2aef4 with identifier: CM09391 to the API
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:42:47Z',
 'fuel_type': 'diesel',
 'id': 'cd3d8aab-2d1d-5a36-a74e-1b607ee2aef4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM09391',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 274125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-31',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM09391%27 HTTP/1.1" 200 None
2026-03-30 08:04:14 [auto1.es] INFO: Saving data for CM09391: {'auction_closing_time': 1774885367.0, 'created_time': 1774090870.768039, 'last_price_update_time': 1774857854.517933}
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CM09391') HTTP/1.1" 204 0
2026-03-30 08:04:14 [auto1.es] INFO: Found listing with ID: GR51630
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR51630%27 HTTP/1.1" 200 None
2026-03-30 08:04:14 [auto1.es] INFO: Scrape type for GR51630: 2
2026-03-30 08:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98eae32d-38f7-51ed-bf70-c8663455103e with identifier: GR51630
2026-03-30 08:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98eae32d-38f7-51ed-bf70-c8663455103e with scrape type 2
2026-03-30 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98eae32d-38f7-51ed-bf70-c8663455103e with scrape type 2
2026-03-30 08:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 98eae32d-38f7-51ed-bf70-c8663455103e, identifier: GR51630
2026-03-30 08:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 98eae32d-38f7-51ed-bf70-c8663455103e with identifier: GR51630
2026-03-30 08:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 98eae32d-38f7-51ed-bf70-c8663455103e with identifier: GR51630
2026-03-30 08:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 98eae32d-38f7-51ed-bf70-c8663455103e with identifier: GR51630 to the API
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:09:31Z',
 'fuel_type': 'diesel',
 'id': '98eae32d-38f7-51ed-bf70-c8663455103e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR51630',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 213512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Edition 1 Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Edition 1 Avantgarde',
 'year': 2014}
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR51630%27 HTTP/1.1" 200 None
2026-03-30 08:04:15 [auto1.es] INFO: Saving data for GR51630: {'auction_closing_time': 1774883371.0, 'created_time': 1774036913.894504, 'last_price_update_time': 1774857855.016711}
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GR51630') HTTP/1.1" 204 0
2026-03-30 08:04:15 [auto1.es] INFO: Found listing with ID: DU59373
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU59373%27 HTTP/1.1" 200 None
2026-03-30 08:04:15 [auto1.es] INFO: Scrape type for DU59373: 2
2026-03-30 08:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7794b12-2618-5425-936e-ae323661bc7b with identifier: DU59373
2026-03-30 08:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7794b12-2618-5425-936e-ae323661bc7b with scrape type 2
2026-03-30 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7794b12-2618-5425-936e-ae323661bc7b with scrape type 2
2026-03-30 08:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c7794b12-2618-5425-936e-ae323661bc7b, identifier: DU59373
2026-03-30 08:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c7794b12-2618-5425-936e-ae323661bc7b with identifier: DU59373
2026-03-30 08:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c7794b12-2618-5425-936e-ae323661bc7b with identifier: DU59373
2026-03-30 08:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c7794b12-2618-5425-936e-ae323661bc7b with identifier: DU59373 to the API
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:55:35Z',
 'fuel_type': 'diesel',
 'id': 'c7794b12-2618-5425-936e-ae323661bc7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU59373',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat Alltrack',
 'odometer': 257165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-06',
 'seller_name': None,
 'title': 'Volkswagen Passat Alltrack 2.0 TDI 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion Tech',
 'year': 2017}
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU59373%27 HTTP/1.1" 200 None
2026-03-30 08:04:15 [auto1.es] INFO: Saving data for DU59373: {'auction_closing_time': 1774886135.0, 'created_time': 1773126787.198236, 'last_price_update_time': 1774857855.430921}
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DU59373') HTTP/1.1" 204 0
2026-03-30 08:04:15 [auto1.es] INFO: Found listing with ID: ZH62909
2026-03-30 08:04:15 [auto1.es] INFO: Found listing with ID: HZ84685
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ84685%27 HTTP/1.1" 200 None
2026-03-30 08:04:15 [auto1.es] INFO: Scrape type for HZ84685: 0
2026-03-30 08:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:04:44 [auto1.es] INFO: Channel: 24h | Page: 56 | totalHits: 2180 | hits on page: 0
2026-03-30 08:04:44 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 08:04:44 [auto1.es] INFO: auto1.es Batch config: batch 1/2
2026-03-30 08:04:44 [auto1.es] INFO: auto1.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 2, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 1, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-30 08:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX69808%27 HTTP/1.1" 200 None
2026-03-30 08:04:44 [auto1.es] INFO: Saving data for BX69808: {'created_time': 1774857884.840439}
2026-03-30 08:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BX69808') HTTP/1.1" 204 0
2026-03-30 08:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20last_price_update_time%20lt%201774425884 HTTP/1.1" 200 None
2026-03-30 08:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BU12846') HTTP/1.1" 204 0
2026-03-30 08:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CD22041') HTTP/1.1" 204 0
2026-03-30 08:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CD30990') HTTP/1.1" 204 0
2026-03-30 08:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CV28044') HTTP/1.1" 204 0
2026-03-30 08:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EM48075') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='FS16711') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GK62462') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HB24827') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HX04467') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JF27046') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LH27989') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LJ75538') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MB25535') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MP23275') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MR16982') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MY47848') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NU87026') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PA10592') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PJ81278') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RC17934') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RG35352') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RN47557') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RZ62327') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='SD35985') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='SW99620') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UA92321') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UL28209') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VE06093') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VJ60171') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VX31855') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WT40413') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WU40715') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WY87874') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='YE82793') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZD73821') HTTP/1.1" 204 0
2026-03-30 08:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZG97055') HTTP/1.1" 204 0
2026-03-30 08:04:45 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (257 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.es/task_21_2026-03-30T08_00_00.jl
2026-03-30 08:04:45 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 339631,
 'downloader/request_count': 152,
 'downloader/request_method_count/GET': 94,
 'downloader/request_method_count/POST': 58,
 'downloader/response_bytes': 17841804,
 'downloader/response_count': 152,
 'downloader/response_status_count/200': 152,
 'dupefilter/filtered': 6,
 'elapsed_time_seconds': 279.42697,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 8, 4, 45, 339440, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 257,
 'log_count/DEBUG': 4924,
 'log_count/ERROR': 8,
 'log_count/INFO': 5955,
 'memusage/max': 180830208,
 'memusage/startup': 149999616,
 'photo_download_count': 50,
 'request_depth_max': 59,
 'response_received_count': 102,
 'scheduler/dequeued': 152,
 'scheduler/dequeued/memory': 152,
 'scheduler/enqueued': 152,
 'scheduler/enqueued/memory': 152,
 'scrape_type/batch_skipped': 1089,
 'scrape_type/new': 22,
 'scrape_type/price_update': 236,
 'scrape_type/skipped': 832,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 102,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 4.420177743199519,
 'scrapy-zyte-api/mean_response_seconds': 4.493812736767506,
 'scrapy-zyte-api/processed': 102,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 102,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 101,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 102,
 'scrapy-zyte-api/request_args/httpRequestBody': 58,
 'scrapy-zyte-api/request_args/httpRequestMethod': 58,
 'scrapy-zyte-api/request_args/httpResponseBody': 102,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 102,
 'scrapy-zyte-api/request_args/sessionContext': 102,
 'scrapy-zyte-api/request_args/url': 102,
 'scrapy-zyte-api/status_codes/200': 102,
 'scrapy-zyte-api/success': 102,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 2220,
 'source/total_available': 2180,
 'spider_exceptions/ValueError': 1,
 'start_time': datetime.datetime(2026, 3, 30, 8, 0, 5, 912470, tzinfo=datetime.timezone.utc)}
2026-03-30 08:04:45 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 08:04:45 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fc894b32350>
2026-03-30 08:04:45 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fc894c80290>