2026-03-28 14:05:09 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 14:05:09 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 14:05:09 [auto1.es] INFO: Batch mode enabled: batch 2/2
2026-03-28 14:05:09 [auto1.es] INFO: Starting spider auto1.es
2026-03-28 14:05:09 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 14:05:09 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 14:05:09 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 14:05:09 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 14:05:09 [scrapy.extensions.telnet] INFO: Telnet Password: 378f1616556a501a
2026-03-28 14:05:09 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 14:05:09 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.es/task_22_2026-03-28T14_05_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 14:05:09 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 14:05:09 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 14:05:09 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 14:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 14:05:09 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 14:05:09 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 14:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-28 14:05:10 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:10 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 14:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 14:05:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 14:05:10 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 14:05:10 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 14:05:10 [scrapy.core.engine] INFO: Spider opened
2026-03-28 14:05:10 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 14:05:10 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-03-28 14:05:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-28 14:05:10 [scrapy-playwright] INFO: Starting download handler
2026-03-28 14:05:10 [scrapy-playwright] INFO: Starting download handler
2026-03-28 14:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 14:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 14:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 14:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 14:05:32 [auto1.es] INFO: Channel: 24h | Page: 0 | totalHits: 2696 | hits on page: 40
2026-03-28 14:05:32 [auto1.es] INFO: Found listing with ID: UE67433
2026-03-28 14:05:32 [auto1.es] INFO: Found listing with ID: TZ01977
2026-03-28 14:05:32 [auto1.es] INFO: Found listing with ID: GW37320
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW37320%27 HTTP/1.1" 200 None
2026-03-28 14:05:32 [auto1.es] INFO: Scrape type for GW37320: 2
2026-03-28 14:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29c7aec2-cfc3-5051-8650-d0b1f634ec19 with identifier: GW37320
2026-03-28 14:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29c7aec2-cfc3-5051-8650-d0b1f634ec19 with scrape type 2
2026-03-28 14:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29c7aec2-cfc3-5051-8650-d0b1f634ec19 with scrape type 2
2026-03-28 14:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29c7aec2-cfc3-5051-8650-d0b1f634ec19, identifier: GW37320
2026-03-28 14:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29c7aec2-cfc3-5051-8650-d0b1f634ec19 with identifier: GW37320
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 14:05:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 14:05:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29c7aec2-cfc3-5051-8650-d0b1f634ec19 with identifier: GW37320
2026-03-28 14:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 29c7aec2-cfc3-5051-8650-d0b1f634ec19 with identifier: GW37320 to the API
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:35:41Z',
 'fuel_type': 'diesel',
 'id': '29c7aec2-cfc3-5051-8650-d0b1f634ec19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW37320',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 185871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW37320%27 HTTP/1.1" 200 None
2026-03-28 14:05:33 [auto1.es] INFO: Saving data for GW37320: {'auction_closing_time': 1774884941.0, 'created_time': 1774015757.738528, 'last_price_update_time': 1774706733.064664}
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GW37320') HTTP/1.1" 204 0
2026-03-28 14:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:33 [auto1.es] INFO: Found listing with ID: GG74961
2026-03-28 14:05:33 [auto1.es] INFO: Found listing with ID: XW94395
2026-03-28 14:05:33 [auto1.es] INFO: Found listing with ID: PK32914
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK32914%27 HTTP/1.1" 200 None
2026-03-28 14:05:33 [auto1.es] INFO: Scrape type for PK32914: 2
2026-03-28 14:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0091f5f8-ec06-59a0-b7fe-e250db4c0560 with identifier: PK32914
2026-03-28 14:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0091f5f8-ec06-59a0-b7fe-e250db4c0560 with scrape type 2
2026-03-28 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0091f5f8-ec06-59a0-b7fe-e250db4c0560 with scrape type 2
2026-03-28 14:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0091f5f8-ec06-59a0-b7fe-e250db4c0560, identifier: PK32914
2026-03-28 14:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0091f5f8-ec06-59a0-b7fe-e250db4c0560 with identifier: PK32914
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 14:05:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 14:05:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0091f5f8-ec06-59a0-b7fe-e250db4c0560 with identifier: PK32914
2026-03-28 14:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0091f5f8-ec06-59a0-b7fe-e250db4c0560 with identifier: PK32914 to the API
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:59:56Z',
 'fuel_type': 'petrol',
 'id': '0091f5f8-ec06-59a0-b7fe-e250db4c0560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK32914',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 84297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-03',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2006}
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK32914%27 HTTP/1.1" 200 None
2026-03-28 14:05:33 [auto1.es] INFO: Saving data for PK32914: {'auction_closing_time': 1774886396.0, 'created_time': 1774015791.756629, 'last_price_update_time': 1774706733.806587}
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PK32914') HTTP/1.1" 204 0
2026-03-28 14:05:33 [auto1.es] INFO: Found listing with ID: GW88114
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW88114%27 HTTP/1.1" 200 None
2026-03-28 14:05:33 [auto1.es] INFO: Scrape type for GW88114: 2
2026-03-28 14:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 114949e7-3c34-52b4-ba15-67736c6bac46 with identifier: GW88114
2026-03-28 14:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 114949e7-3c34-52b4-ba15-67736c6bac46 with scrape type 2
2026-03-28 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 114949e7-3c34-52b4-ba15-67736c6bac46 with scrape type 2
2026-03-28 14:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 114949e7-3c34-52b4-ba15-67736c6bac46, identifier: GW88114
2026-03-28 14:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 114949e7-3c34-52b4-ba15-67736c6bac46 with identifier: GW88114
2026-03-28 14:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 14:05:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 114949e7-3c34-52b4-ba15-67736c6bac46 with identifier: GW88114
2026-03-28 14:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 114949e7-3c34-52b4-ba15-67736c6bac46 with identifier: GW88114 to the API
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:29:14Z',
 'fuel_type': 'diesel',
 'id': '114949e7-3c34-52b4-ba15-67736c6bac46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW88114',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 290772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-26',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 D-4D Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2016}
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW88114%27 HTTP/1.1" 200 None
2026-03-28 14:05:34 [auto1.es] INFO: Saving data for GW88114: {'auction_closing_time': 1774884554.0, 'created_time': 1774037214.594449, 'last_price_update_time': 1774706734.52162}
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GW88114') HTTP/1.1" 204 0
2026-03-28 14:05:34 [auto1.es] INFO: Found listing with ID: RH91028
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH91028%27 HTTP/1.1" 200 None
2026-03-28 14:05:34 [auto1.es] INFO: Scrape type for RH91028: 1
2026-03-28 14:05:34 [auto1.es] INFO: Found listing with ID: LZ33351
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ33351%27 HTTP/1.1" 200 None
2026-03-28 14:05:34 [auto1.es] INFO: Scrape type for LZ33351: 1
2026-03-28 14:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:34 [auto1.es] INFO: Found listing with ID: TR19943
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR19943%27 HTTP/1.1" 200 None
2026-03-28 14:05:34 [auto1.es] INFO: Scrape type for TR19943: 1
2026-03-28 14:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:34 [auto1.es] INFO: Found listing with ID: JS77996
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS77996%27 HTTP/1.1" 200 None
2026-03-28 14:05:34 [auto1.es] INFO: Scrape type for JS77996: 1
2026-03-28 14:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:34 [auto1.es] INFO: Found listing with ID: NH39190
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH39190%27 HTTP/1.1" 200 None
2026-03-28 14:05:34 [auto1.es] INFO: Scrape type for NH39190: 1
2026-03-28 14:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:34 [auto1.es] INFO: Found listing with ID: ZE40352
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE40352%27 HTTP/1.1" 200 None
2026-03-28 14:05:34 [auto1.es] INFO: Scrape type for ZE40352: 1
2026-03-28 14:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:34 [auto1.es] INFO: Found listing with ID: CC76703
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC76703%27 HTTP/1.1" 200 None
2026-03-28 14:05:34 [auto1.es] INFO: Scrape type for CC76703: 1
2026-03-28 14:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:34 [auto1.es] INFO: Found listing with ID: ES07988
2026-03-28 14:05:34 [auto1.es] INFO: Found listing with ID: HY65431
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY65431%27 HTTP/1.1" 200 None
2026-03-28 14:05:34 [auto1.es] INFO: Scrape type for HY65431: 1
2026-03-28 14:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:34 [auto1.es] INFO: Found listing with ID: RB15615
2026-03-28 14:05:34 [auto1.es] INFO: Found listing with ID: VZ79262
2026-03-28 14:05:34 [auto1.es] INFO: Found listing with ID: HA87935
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA87935%27 HTTP/1.1" 200 None
2026-03-28 14:05:34 [auto1.es] INFO: Scrape type for HA87935: 2
2026-03-28 14:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 242d2562-51f8-52c6-975b-ce45ff5fc302 with identifier: HA87935
2026-03-28 14:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 242d2562-51f8-52c6-975b-ce45ff5fc302 with scrape type 2
2026-03-28 14:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 242d2562-51f8-52c6-975b-ce45ff5fc302 with scrape type 2
2026-03-28 14:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 242d2562-51f8-52c6-975b-ce45ff5fc302, identifier: HA87935
2026-03-28 14:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 242d2562-51f8-52c6-975b-ce45ff5fc302 with identifier: HA87935
2026-03-28 14:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 242d2562-51f8-52c6-975b-ce45ff5fc302 with identifier: HA87935
2026-03-28 14:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 242d2562-51f8-52c6-975b-ce45ff5fc302 with identifier: HA87935 to the API
2026-03-28 14:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:01:30Z',
 'fuel_type': 'diesel',
 'id': '242d2562-51f8-52c6-975b-ce45ff5fc302',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA87935',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 191280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-29',
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA87935%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [auto1.es] INFO: Saving data for HA87935: {'auction_closing_time': 1774882890.0, 'created_time': 1774037426.747185, 'last_price_update_time': 1774706735.194782}
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HA87935') HTTP/1.1" 204 0
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: XC96716
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: VC74313
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: RG03753
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: CN77625
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN77625%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [auto1.es] INFO: Scrape type for CN77625: 1
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: XD32564
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD32564%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [auto1.es] INFO: Scrape type for XD32564: 1
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: BB89966
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: EA80671
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: YK19704
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: AE50164
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: RK07615
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: UD30245
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD30245%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [auto1.es] INFO: Scrape type for UD30245: 1
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: BX14033
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX14033%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [auto1.es] INFO: Scrape type for BX14033: 1
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: FY68249
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY68249%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [auto1.es] INFO: Scrape type for FY68249: 1
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: AA00980
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: HZ31017
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ31017%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [auto1.es] INFO: Scrape type for HZ31017: 1
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: KC96149
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC96149%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [auto1.es] INFO: Scrape type for KC96149: 1
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: PJ13315
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: PL39404
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL39404%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [auto1.es] INFO: Scrape type for PL39404: 1
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: VD65621
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD65621%27 HTTP/1.1" 200 None
2026-03-28 14:05:35 [auto1.es] INFO: Scrape type for VD65621: 1
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: HG29658
2026-03-28 14:05:35 [auto1.es] INFO: Found listing with ID: VM52348
2026-03-28 14:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR19943/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC76703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH39190/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE40352/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH91028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ33351/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY65431/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX14033/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD32564/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD30245/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS77996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY68249/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC96149/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VD65621/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH39190> (referer: https://www.auto1.com/v1/car-details-view/NH39190/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC76703> (referer: https://www.auto1.com/v1/car-details-view/CC76703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 318078c8-f979-517a-ac94-5bf7472a7f21 with identifier: NH39190
2026-03-28 14:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 318078c8-f979-517a-ac94-5bf7472a7f21 with scrape type 1
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 318078c8-f979-517a-ac94-5bf7472a7f21
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_7661606a911472112a3928449523aad7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_7661606a911472112a3928449523aad7.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_c222c87c07da91843934d876c8056dee.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_c222c87c07da91843934d876c8056dee.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_051649efdda4a42557d59cd2d4ee0831.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_051649efdda4a42557d59cd2d4ee0831.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_6b4b2afffbc8ba361700606ac5f9275b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_6b4b2afffbc8ba361700606ac5f9275b.jpg not downloaded yet
2026-03-28 14:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00 with identifier: CC76703
2026-03-28 14:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00 with scrape type 1
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_b740f55ff7177a53e4452446a35614f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_b740f55ff7177a53e4452446a35614f0.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_b1d1bf1eeccbf44ab83d64289aa184a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_b1d1bf1eeccbf44ab83d64289aa184a9.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_ca15e13353698eb9f6d20579be378ed0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_ca15e13353698eb9f6d20579be378ed0.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_dcd0a4ff4902540d5162411ee5132985.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_dcd0a4ff4902540d5162411ee5132985.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_7bbc9f2a0606b763bd6b3828227f8619.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_7bbc9f2a0606b763bd6b3828227f8619.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_fdb594579dcaf8b87e1eebbab408de48.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_fdb594579dcaf8b87e1eebbab408de48.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_87e66efe831f747991d83f2a28847743.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_87e66efe831f747991d83f2a28847743.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_900edecdaec2719daab3bfb61a8e7e28.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_900edecdaec2719daab3bfb61a8e7e28.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_4910668589878d68dda4d2a7e9d9b6c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_4910668589878d68dda4d2a7e9d9b6c9.jpg not downloaded yet
2026-03-28 14:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE40352> (referer: https://www.auto1.com/v1/car-details-view/ZE40352/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_1fdb9c193517acf715c5b9157fc4f1e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_1fdb9c193517acf715c5b9157fc4f1e2.jpg not downloaded yet
2026-03-28 14:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_df5b362f9f7156892db1f9eb3770f581.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_df5b362f9f7156892db1f9eb3770f581.jpg not downloaded yet
2026-03-28 14:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL39404/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_6eb94d32c1294c2353fac8d07d84806f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_6eb94d32c1294c2353fac8d07d84806f.jpg not downloaded yet
2026-03-28 14:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_9a0344bb61d784ef69e9a35d762c425c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_9a0344bb61d784ef69e9a35d762c425c.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_7901367f47109ec1abb2ab486baf7417.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_7901367f47109ec1abb2ab486baf7417.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_7ff6be2fc4c1a9c56c4108c8f353e3cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_7ff6be2fc4c1a9c56c4108c8f353e3cd.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_cf1c04eb51b63f8be537e0719d07380f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_cf1c04eb51b63f8be537e0719d07380f.jpg not downloaded yet
2026-03-28 14:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c814f4f-0536-5068-912c-2577463fb071 with identifier: ZE40352
2026-03-28 14:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c814f4f-0536-5068-912c-2577463fb071 with scrape type 1
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c814f4f-0536-5068-912c-2577463fb071
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_ac65d3f0d430b6c404a12021af55db5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_ac65d3f0d430b6c404a12021af55db5c.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_e0ff30f0130387c19b29ff27d572d391.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_e0ff30f0130387c19b29ff27d572d391.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_f413d357b7318f61425e0b2f8d92296f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_f413d357b7318f61425e0b2f8d92296f.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_c9d1e877504a404fc76e7f03f61717b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_c9d1e877504a404fc76e7f03f61717b3.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_9ee1b0eb614caaac2a8457e8c5c9cb8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_9ee1b0eb614caaac2a8457e8c5c9cb8c.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_50cb9a403c82edcb4291b546bd853954.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_50cb9a403c82edcb4291b546bd853954.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_ccc3615bf096c099f6dcdd9a4ba07989.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_ccc3615bf096c099f6dcdd9a4ba07989.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_6b953cab6c5ef88c8cbc2b9ddfe53e1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_6b953cab6c5ef88c8cbc2b9ddfe53e1d.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_54fa89d2615a6cfef9421e97568c8ca0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_54fa89d2615a6cfef9421e97568c8ca0.jpg not downloaded yet
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_6145b19b7e287acf8c4ec0f395a1bd69.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_6145b19b7e287acf8c4ec0f395a1bd69.jpg not downloaded yet
2026-03-28 14:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_1fdb9c193517acf715c5b9157fc4f1e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_4910668589878d68dda4d2a7e9d9b6c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5b9650>
2026-03-28 14:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-28 14:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_1fdb9c193517acf715c5b9157fc4f1e2.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_1fdb9c193517acf715c5b9157fc4f1e2.jpg saved to cache
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 318078c8-f979-517a-ac94-5bf7472a7f21
2026-03-28 14:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_6145b19b7e287acf8c4ec0f395a1bd69.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_54fa89d2615a6cfef9421e97568c8ca0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ33351> (referer: https://www.auto1.com/v1/car-details-view/LZ33351/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6440238fd0>
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_4910668589878d68dda4d2a7e9d9b6c9.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_4910668589878d68dda4d2a7e9d9b6c9.jpg saved to cache
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00
2026-03-28 14:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY65431> (referer: https://www.auto1.com/v1/car-details-view/HY65431/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b47f690>
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_6145b19b7e287acf8c4ec0f395a1bd69.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_6145b19b7e287acf8c4ec0f395a1bd69.jpg saved to cache
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c814f4f-0536-5068-912c-2577463fb071
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3a3990>
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_54fa89d2615a6cfef9421e97568c8ca0.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_54fa89d2615a6cfef9421e97568c8ca0.jpg saved to cache
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c814f4f-0536-5068-912c-2577463fb071
2026-03-28 14:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f806dd9-e7e7-5a1d-baf1-85e3a8280996 with identifier: LZ33351
2026-03-28 14:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f806dd9-e7e7-5a1d-baf1-85e3a8280996 with scrape type 1
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f806dd9-e7e7-5a1d-baf1-85e3a8280996
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fd0%252F44d0404074c63e48654368028c253cf8%252Fpa%252FLZ33351_ff2f3a595957ff2f7932c8fe43130316.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_ff2f3a595957ff2f7932c8fe43130316.jpg already downloaded
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fd0%252F44d0404074c63e48654368028c253cf8%252Fpa%252FLZ33351_603f2b9c6c53bef7354dc120996cf45b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_603f2b9c6c53bef7354dc120996cf45b.jpg already downloaded
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fd0%252F44d0404074c63e48654368028c253cf8%252Fpa%252FLZ33351_9af1e2fe0adc1ecd5112e32fd93aab0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_9af1e2fe0adc1ecd5112e32fd93aab0a.jpg already downloaded
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fd0%252F44d0404074c63e48654368028c253cf8%252Fpa%252FLZ33351_a1110357f3594d82ecaca1a41bf1a53b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_a1110357f3594d82ecaca1a41bf1a53b.jpg already downloaded
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fd0%252F44d0404074c63e48654368028c253cf8%252Fpa%252FLZ33351_10a09f53431a67bf28bb2d4435ab261f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_10a09f53431a67bf28bb2d4435ab261f.jpg already downloaded
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fd0%252F44d0404074c63e48654368028c253cf8%252Fpa%252FLZ33351_da0e34f4f5903061070184c651f0aea6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_da0e34f4f5903061070184c651f0aea6.jpg already downloaded
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fd0%252F44d0404074c63e48654368028c253cf8%252Fpa%252FLZ33351_9ccce7bed00774c5728017966244fe86.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_9ccce7bed00774c5728017966244fe86.jpg already downloaded
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fd0%252F44d0404074c63e48654368028c253cf8%252Fpa%252FLZ33351_37d4ef8525bd44a02c076634c07a41fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_37d4ef8525bd44a02c076634c07a41fc.jpg already downloaded
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fd0%252F44d0404074c63e48654368028c253cf8%252Fpa%252FLZ33351_b2c8f1606d2937e3f9d7936be772123a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_b2c8f1606d2937e3f9d7936be772123a.jpg already downloaded
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fd0%252F44d0404074c63e48654368028c253cf8%252Fpa%252FLZ33351_9b4753f80fad821ae5e17d1a7a48e74e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_9b4753f80fad821ae5e17d1a7a48e74e.jpg already downloaded
2026-03-28 14:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8f806dd9-e7e7-5a1d-baf1-85e3a8280996, identifier: LZ33351
2026-03-28 14:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_ccc3615bf096c099f6dcdd9a4ba07989.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8f806dd9-e7e7-5a1d-baf1-85e3a8280996 with identifier: LZ33351
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 14:05:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8f806dd9-e7e7-5a1d-baf1-85e3a8280996 with identifier: LZ33351
2026-03-28 14:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8f806dd9-e7e7-5a1d-baf1-85e3a8280996 with identifier: LZ33351 to the API
2026-03-28 14:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ33351>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:15:11Z',
 'fuel_type': 'diesel',
 'id': '8f806dd9-e7e7-5a1d-baf1-85e3a8280996',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ33351',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 193336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_ff2f3a595957ff2f7932c8fe43130316.jpg',
                'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_603f2b9c6c53bef7354dc120996cf45b.jpg',
                'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_9af1e2fe0adc1ecd5112e32fd93aab0a.jpg',
                'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_a1110357f3594d82ecaca1a41bf1a53b.jpg',
                'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_10a09f53431a67bf28bb2d4435ab261f.jpg',
                'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_da0e34f4f5903061070184c651f0aea6.jpg',
                'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_9ccce7bed00774c5728017966244fe86.jpg',
                'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_37d4ef8525bd44a02c076634c07a41fc.jpg',
                'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_b2c8f1606d2937e3f9d7936be772123a.jpg',
                'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_9b4753f80fad821ae5e17d1a7a48e74e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f806dd9-e7e7-5a1d-baf1-85e3a8280996/8f806dd9-e7e7-5a1d-baf1-85e3a8280996_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_ff2f3a595957ff2f7932c8fe43130316.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f806dd9-e7e7-5a1d-baf1-85e3a8280996/8f806dd9-e7e7-5a1d-baf1-85e3a8280996_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_603f2b9c6c53bef7354dc120996cf45b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f806dd9-e7e7-5a1d-baf1-85e3a8280996/8f806dd9-e7e7-5a1d-baf1-85e3a8280996_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_9af1e2fe0adc1ecd5112e32fd93aab0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f806dd9-e7e7-5a1d-baf1-85e3a8280996/8f806dd9-e7e7-5a1d-baf1-85e3a8280996_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_a1110357f3594d82ecaca1a41bf1a53b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f806dd9-e7e7-5a1d-baf1-85e3a8280996/8f806dd9-e7e7-5a1d-baf1-85e3a8280996_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_10a09f53431a67bf28bb2d4435ab261f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f806dd9-e7e7-5a1d-baf1-85e3a8280996/8f806dd9-e7e7-5a1d-baf1-85e3a8280996_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_da0e34f4f5903061070184c651f0aea6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f806dd9-e7e7-5a1d-baf1-85e3a8280996/8f806dd9-e7e7-5a1d-baf1-85e3a8280996_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_9ccce7bed00774c5728017966244fe86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f806dd9-e7e7-5a1d-baf1-85e3a8280996/8f806dd9-e7e7-5a1d-baf1-85e3a8280996_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_37d4ef8525bd44a02c076634c07a41fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f806dd9-e7e7-5a1d-baf1-85e3a8280996/8f806dd9-e7e7-5a1d-baf1-85e3a8280996_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_b2c8f1606d2937e3f9d7936be772123a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f806dd9-e7e7-5a1d-baf1-85e3a8280996/8f806dd9-e7e7-5a1d-baf1-85e3a8280996_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/d0/44d0404074c63e48654368028c253cf8/pa/LZ33351_9b4753f80fad821ae5e17d1a7a48e74e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XF 30d Portfolio',
 'transmission': 'automatic',
 'trim': 'Portfolio',
 'year': 2016}
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ33351%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [auto1.es] INFO: Saving data for LZ33351: {'created_time': 1774706741.222183, 'last_price_update_time': 1774706741.222194, 'auction_closing_time': 1774883711.0}
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LZ33351') HTTP/1.1" 204 0
2026-03-28 14:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_6b953cab6c5ef88c8cbc2b9ddfe53e1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH91028> (referer: https://www.auto1.com/v1/car-details-view/RH91028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD32564> (referer: https://www.auto1.com/v1/car-details-view/XD32564/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ31017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35c72166-39d7-5cb3-b059-b63bd5ab0e61 with identifier: HY65431
2026-03-28 14:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61 with scrape type 1
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_7dd2ad2925b4412ee83e2bd4e8449ede.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_7dd2ad2925b4412ee83e2bd4e8449ede.jpg not downloaded yet
2026-03-28 14:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3b12d0>
2026-03-28 14:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_ccc3615bf096c099f6dcdd9a4ba07989.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_ccc3615bf096c099f6dcdd9a4ba07989.jpg saved to cache
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c814f4f-0536-5068-912c-2577463fb071
2026-03-28 14:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_b0dd6b7cd1876366db27d3a88f65513a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_b0dd6b7cd1876366db27d3a88f65513a.jpg not downloaded yet
2026-03-28 14:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_50cb9a403c82edcb4291b546bd853954.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3af510>
2026-03-28 14:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_6b953cab6c5ef88c8cbc2b9ddfe53e1d.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_6b953cab6c5ef88c8cbc2b9ddfe53e1d.jpg saved to cache
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c814f4f-0536-5068-912c-2577463fb071
2026-03-28 14:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 091e10bb-bcc7-5ce5-818a-d21009fc472c with identifier: RH91028
2026-03-28 14:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 091e10bb-bcc7-5ce5-818a-d21009fc472c with scrape type 1
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 091e10bb-bcc7-5ce5-818a-d21009fc472c
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_88862b4bbd971b5918ca3936f5fe0039.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_88862b4bbd971b5918ca3936f5fe0039.jpg not downloaded yet
2026-03-28 14:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f20727b9-78d3-546b-a778-8bb0b2a409d0 with identifier: XD32564
2026-03-28 14:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f20727b9-78d3-546b-a778-8bb0b2a409d0 with scrape type 1
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f20727b9-78d3-546b-a778-8bb0b2a409d0
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F56%252F3a5630a2fc8f73134d146c30929e9171%252Fpa%252FXD32564_ab4ba0109a86d62c104e7b692f364f50.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_ab4ba0109a86d62c104e7b692f364f50.jpg already downloaded
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F56%252F3a5630a2fc8f73134d146c30929e9171%252Fpa%252FXD32564_43a81c6af1e51d95f0c3cca390fb98b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_43a81c6af1e51d95f0c3cca390fb98b3.jpg already downloaded
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F56%252F3a5630a2fc8f73134d146c30929e9171%252Fpa%252FXD32564_1f90c2d2d21223bacb5389f84e2456a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_1f90c2d2d21223bacb5389f84e2456a1.jpg already downloaded
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F56%252F3a5630a2fc8f73134d146c30929e9171%252Fpa%252FXD32564_33d65a879d1b8e462f82c2e12c37736c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_33d65a879d1b8e462f82c2e12c37736c.jpg already downloaded
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F56%252F3a5630a2fc8f73134d146c30929e9171%252Fpa%252FXD32564_ccd791a7853fdb99b61148dd5f014b48.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_ccd791a7853fdb99b61148dd5f014b48.jpg already downloaded
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F56%252F3a5630a2fc8f73134d146c30929e9171%252Fpa%252FXD32564_6b51243d15ea7a270b4d376ed8764b9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_6b51243d15ea7a270b4d376ed8764b9c.jpg already downloaded
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F56%252F3a5630a2fc8f73134d146c30929e9171%252Fpa%252FXD32564_9795f4d52f11f07e8f51a09bfa7cc688.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_9795f4d52f11f07e8f51a09bfa7cc688.jpg already downloaded
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F56%252F3a5630a2fc8f73134d146c30929e9171%252Fpa%252FXD32564_47d654c2d4310bd2f0f113154c48adaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_47d654c2d4310bd2f0f113154c48adaa.jpg already downloaded
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F56%252F3a5630a2fc8f73134d146c30929e9171%252Fpa%252FXD32564_1dac457e8f1d87d8beb59bc3b1937b59.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_1dac457e8f1d87d8beb59bc3b1937b59.jpg already downloaded
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F56%252F3a5630a2fc8f73134d146c30929e9171%252Fpa%252FXD32564_d2274209abb3159103265ccea22fc0e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_d2274209abb3159103265ccea22fc0e6.jpg already downloaded
2026-03-28 14:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f20727b9-78d3-546b-a778-8bb0b2a409d0, identifier: XD32564
2026-03-28 14:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_c9d1e877504a404fc76e7f03f61717b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_951ff015903085b0080f9b36674f5958.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_951ff015903085b0080f9b36674f5958.jpg not downloaded yet
2026-03-28 14:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f20727b9-78d3-546b-a778-8bb0b2a409d0 with identifier: XD32564
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 14:05:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f20727b9-78d3-546b-a778-8bb0b2a409d0 with identifier: XD32564
2026-03-28 14:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f20727b9-78d3-546b-a778-8bb0b2a409d0 with identifier: XD32564 to the API
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XD32564>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': 'Rental',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:21:41Z',
 'fuel_type': 'diesel',
 'id': 'f20727b9-78d3-546b-a778-8bb0b2a409d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD32564',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 55550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_ab4ba0109a86d62c104e7b692f364f50.jpg',
                'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_43a81c6af1e51d95f0c3cca390fb98b3.jpg',
                'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_1f90c2d2d21223bacb5389f84e2456a1.jpg',
                'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_33d65a879d1b8e462f82c2e12c37736c.jpg',
                'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_ccd791a7853fdb99b61148dd5f014b48.jpg',
                'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_6b51243d15ea7a270b4d376ed8764b9c.jpg',
                'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_9795f4d52f11f07e8f51a09bfa7cc688.jpg',
                'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_47d654c2d4310bd2f0f113154c48adaa.jpg',
                'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_1dac457e8f1d87d8beb59bc3b1937b59.jpg',
                'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_d2274209abb3159103265ccea22fc0e6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20727b9-78d3-546b-a778-8bb0b2a409d0/f20727b9-78d3-546b-a778-8bb0b2a409d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_ab4ba0109a86d62c104e7b692f364f50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20727b9-78d3-546b-a778-8bb0b2a409d0/f20727b9-78d3-546b-a778-8bb0b2a409d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_43a81c6af1e51d95f0c3cca390fb98b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20727b9-78d3-546b-a778-8bb0b2a409d0/f20727b9-78d3-546b-a778-8bb0b2a409d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_1f90c2d2d21223bacb5389f84e2456a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20727b9-78d3-546b-a778-8bb0b2a409d0/f20727b9-78d3-546b-a778-8bb0b2a409d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_33d65a879d1b8e462f82c2e12c37736c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20727b9-78d3-546b-a778-8bb0b2a409d0/f20727b9-78d3-546b-a778-8bb0b2a409d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_ccd791a7853fdb99b61148dd5f014b48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20727b9-78d3-546b-a778-8bb0b2a409d0/f20727b9-78d3-546b-a778-8bb0b2a409d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_6b51243d15ea7a270b4d376ed8764b9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20727b9-78d3-546b-a778-8bb0b2a409d0/f20727b9-78d3-546b-a778-8bb0b2a409d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_9795f4d52f11f07e8f51a09bfa7cc688.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20727b9-78d3-546b-a778-8bb0b2a409d0/f20727b9-78d3-546b-a778-8bb0b2a409d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_47d654c2d4310bd2f0f113154c48adaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20727b9-78d3-546b-a778-8bb0b2a409d0/f20727b9-78d3-546b-a778-8bb0b2a409d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_1dac457e8f1d87d8beb59bc3b1937b59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20727b9-78d3-546b-a778-8bb0b2a409d0/f20727b9-78d3-546b-a778-8bb0b2a409d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/56/3a5630a2fc8f73134d146c30929e9171/pa/XD32564_d2274209abb3159103265ccea22fc0e6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TDI Xperience',
 'transmission': 'manual',
 'trim': 'Xperience',
 'year': 2023}
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD32564%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [auto1.es] INFO: Saving data for XD32564: {'created_time': 1774706742.446527, 'last_price_update_time': 1774706742.446535, 'auction_closing_time': 1774884101.0}
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XD32564') HTTP/1.1" 204 0
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_6139fba56563fda34baf8bf3ced1790b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_6139fba56563fda34baf8bf3ced1790b.jpg not downloaded yet
2026-03-28 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_f413d357b7318f61425e0b2f8d92296f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_9ee1b0eb614caaac2a8457e8c5c9cb8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_0b206fc00fce25eedd8a65a3d3a8364b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_0b206fc00fce25eedd8a65a3d3a8364b.jpg not downloaded yet
2026-03-28 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS77996> (referer: https://www.auto1.com/v1/car-details-view/JS77996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR19943> (referer: https://www.auto1.com/v1/car-details-view/TR19943/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_cd81c9b5256edd052ebe54de362d3022.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_cd81c9b5256edd052ebe54de362d3022.jpg not downloaded yet
2026-03-28 14:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD30245> (referer: https://www.auto1.com/v1/car-details-view/UD30245/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa2f190>
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_50cb9a403c82edcb4291b546bd853954.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_50cb9a403c82edcb4291b546bd853954.jpg saved to cache
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c814f4f-0536-5068-912c-2577463fb071
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa29810>
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_c9d1e877504a404fc76e7f03f61717b3.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_c9d1e877504a404fc76e7f03f61717b3.jpg saved to cache
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c814f4f-0536-5068-912c-2577463fb071
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_d9e84b506772779cbf5fc27235f1c94e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_d9e84b506772779cbf5fc27235f1c94e.jpg not downloaded yet
2026-03-28 14:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_7dd2ad2925b4412ee83e2bd4e8449ede.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_58b9e8c560058b7592c53da99a98542a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_58b9e8c560058b7592c53da99a98542a.jpg not downloaded yet
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_3318d23dcea2065ca9c378b0e853586d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_3318d23dcea2065ca9c378b0e853586d.jpg not downloaded yet
2026-03-28 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa30050>
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_f413d357b7318f61425e0b2f8d92296f.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_f413d357b7318f61425e0b2f8d92296f.jpg saved to cache
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c814f4f-0536-5068-912c-2577463fb071
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a911a90>
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_9ee1b0eb614caaac2a8457e8c5c9cb8c.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_9ee1b0eb614caaac2a8457e8c5c9cb8c.jpg saved to cache
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c814f4f-0536-5068-912c-2577463fb071
2026-03-28 14:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25e622ba-f859-5089-a008-a03bd1f92a81 with identifier: JS77996
2026-03-28 14:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25e622ba-f859-5089-a008-a03bd1f92a81 with scrape type 1
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25e622ba-f859-5089-a008-a03bd1f92a81
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fef%252F7fef616e29a70979dc6f5908a259bc97%252Fpa%252FJS77996_8a94b5da8250a7f28027be8f56e9c53d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_8a94b5da8250a7f28027be8f56e9c53d.jpg already downloaded
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fef%252F7fef616e29a70979dc6f5908a259bc97%252Fpa%252FJS77996_2397698300114ebebe5bdfd69f3910a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_2397698300114ebebe5bdfd69f3910a7.jpg already downloaded
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fef%252F7fef616e29a70979dc6f5908a259bc97%252Fpa%252FJS77996_f1ca2a09525342d6d56d86477eee70f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_f1ca2a09525342d6d56d86477eee70f9.jpg already downloaded
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fef%252F7fef616e29a70979dc6f5908a259bc97%252Fpa%252FJS77996_ade473561c6261f7caaa4b4997601d4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_ade473561c6261f7caaa4b4997601d4b.jpg already downloaded
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fef%252F7fef616e29a70979dc6f5908a259bc97%252Fpa%252FJS77996_8030a6fc4e03ca377cbbc0bb6665e534.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_8030a6fc4e03ca377cbbc0bb6665e534.jpg already downloaded
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fef%252F7fef616e29a70979dc6f5908a259bc97%252Fpa%252FJS77996_4cb56708623ad5bb026a9b01f061519e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_4cb56708623ad5bb026a9b01f061519e.jpg already downloaded
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fef%252F7fef616e29a70979dc6f5908a259bc97%252Fpa%252FJS77996_fe97475e6447f670c2ea8088818cd2c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_fe97475e6447f670c2ea8088818cd2c5.jpg already downloaded
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fef%252F7fef616e29a70979dc6f5908a259bc97%252Fpa%252FJS77996_08c1fdc4e6011f3a8c98686837c8beff.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_08c1fdc4e6011f3a8c98686837c8beff.jpg already downloaded
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fef%252F7fef616e29a70979dc6f5908a259bc97%252Fpa%252FJS77996_ce88534781016ae8f60ec590cbd5f632.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_ce88534781016ae8f60ec590cbd5f632.jpg already downloaded
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fef%252F7fef616e29a70979dc6f5908a259bc97%252Fpa%252FJS77996_92f17485d14ad9c44e7a75884ceae744.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_92f17485d14ad9c44e7a75884ceae744.jpg already downloaded
2026-03-28 14:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 25e622ba-f859-5089-a008-a03bd1f92a81, identifier: JS77996
2026-03-28 14:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b969be5-acac-5468-bdca-45322a1bbcb3 with identifier: TR19943
2026-03-28 14:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b969be5-acac-5468-bdca-45322a1bbcb3 with scrape type 1
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8b969be5-acac-5468-bdca-45322a1bbcb3
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F7b%252F9f7bd0684910f75155791a1f9e7279b0%252Fpa%252FTR19943_b791557631f9b7171bf1a589959c588b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_b791557631f9b7171bf1a589959c588b.jpg already downloaded
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F7b%252F9f7bd0684910f75155791a1f9e7279b0%252Fpa%252FTR19943_73652ba02cd17ce695d76316bfa3d37b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_73652ba02cd17ce695d76316bfa3d37b.jpg already downloaded
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F7b%252F9f7bd0684910f75155791a1f9e7279b0%252Fpa%252FTR19943_1ce225e3706866cb44e35481a2d88e1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_1ce225e3706866cb44e35481a2d88e1f.jpg already downloaded
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F7b%252F9f7bd0684910f75155791a1f9e7279b0%252Fpa%252FTR19943_8cd6b529b52bffa6587d76a4b413c795.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_8cd6b529b52bffa6587d76a4b413c795.jpg already downloaded
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F7b%252F9f7bd0684910f75155791a1f9e7279b0%252Fpa%252FTR19943_d30e8273c5684d7be46f9a75b04d3c1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_d30e8273c5684d7be46f9a75b04d3c1e.jpg already downloaded
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F7b%252F9f7bd0684910f75155791a1f9e7279b0%252Fpa%252FTR19943_a63450af5ac270ba0e32dd2a5d8a440b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_a63450af5ac270ba0e32dd2a5d8a440b.jpg already downloaded
2026-03-28 14:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8b969be5-acac-5468-bdca-45322a1bbcb3, identifier: TR19943
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_66e9ac3f75cad6bb67e0b11ae6556b2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_66e9ac3f75cad6bb67e0b11ae6556b2e.jpg not downloaded yet
2026-03-28 14:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 25e622ba-f859-5089-a008-a03bd1f92a81 with identifier: JS77996
2026-03-28 14:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 25e622ba-f859-5089-a008-a03bd1f92a81 with identifier: JS77996
2026-03-28 14:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 25e622ba-f859-5089-a008-a03bd1f92a81 with identifier: JS77996 to the API
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JS77996>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:35:16Z',
 'fuel_type': 'petrol',
 'id': '25e622ba-f859-5089-a008-a03bd1f92a81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS77996',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 97695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_8a94b5da8250a7f28027be8f56e9c53d.jpg',
                'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_2397698300114ebebe5bdfd69f3910a7.jpg',
                'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_f1ca2a09525342d6d56d86477eee70f9.jpg',
                'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_ade473561c6261f7caaa4b4997601d4b.jpg',
                'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_8030a6fc4e03ca377cbbc0bb6665e534.jpg',
                'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_4cb56708623ad5bb026a9b01f061519e.jpg',
                'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_fe97475e6447f670c2ea8088818cd2c5.jpg',
                'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_08c1fdc4e6011f3a8c98686837c8beff.jpg',
                'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_ce88534781016ae8f60ec590cbd5f632.jpg',
                'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_92f17485d14ad9c44e7a75884ceae744.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e622ba-f859-5089-a008-a03bd1f92a81/25e622ba-f859-5089-a008-a03bd1f92a81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_8a94b5da8250a7f28027be8f56e9c53d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e622ba-f859-5089-a008-a03bd1f92a81/25e622ba-f859-5089-a008-a03bd1f92a81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_2397698300114ebebe5bdfd69f3910a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e622ba-f859-5089-a008-a03bd1f92a81/25e622ba-f859-5089-a008-a03bd1f92a81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_f1ca2a09525342d6d56d86477eee70f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e622ba-f859-5089-a008-a03bd1f92a81/25e622ba-f859-5089-a008-a03bd1f92a81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_ade473561c6261f7caaa4b4997601d4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e622ba-f859-5089-a008-a03bd1f92a81/25e622ba-f859-5089-a008-a03bd1f92a81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_8030a6fc4e03ca377cbbc0bb6665e534.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e622ba-f859-5089-a008-a03bd1f92a81/25e622ba-f859-5089-a008-a03bd1f92a81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_4cb56708623ad5bb026a9b01f061519e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e622ba-f859-5089-a008-a03bd1f92a81/25e622ba-f859-5089-a008-a03bd1f92a81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_fe97475e6447f670c2ea8088818cd2c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e622ba-f859-5089-a008-a03bd1f92a81/25e622ba-f859-5089-a008-a03bd1f92a81_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_08c1fdc4e6011f3a8c98686837c8beff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e622ba-f859-5089-a008-a03bd1f92a81/25e622ba-f859-5089-a008-a03bd1f92a81_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_ce88534781016ae8f60ec590cbd5f632.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e622ba-f859-5089-a008-a03bd1f92a81/25e622ba-f859-5089-a008-a03bd1f92a81_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/ef/7fef616e29a70979dc6f5908a259bc97/pa/JS77996_92f17485d14ad9c44e7a75884ceae744.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 SCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2021}
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS77996%27 HTTP/1.1" 200 None
2026-03-28 14:05:43 [auto1.es] INFO: Saving data for JS77996: {'created_time': 1774706743.592606, 'last_price_update_time': 1774706743.592617, 'auction_closing_time': 1774884916.0}
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JS77996') HTTP/1.1" 204 0
2026-03-28 14:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8b969be5-acac-5468-bdca-45322a1bbcb3 with identifier: TR19943
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:05:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8b969be5-acac-5468-bdca-45322a1bbcb3 with identifier: TR19943
2026-03-28 14:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8b969be5-acac-5468-bdca-45322a1bbcb3 with identifier: TR19943 to the API
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TR19943>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:19:35Z',
 'fuel_type': 'diesel',
 'id': '8b969be5-acac-5468-bdca-45322a1bbcb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR19943',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 151294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_b791557631f9b7171bf1a589959c588b.jpg',
                'https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_73652ba02cd17ce695d76316bfa3d37b.jpg',
                'https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_1ce225e3706866cb44e35481a2d88e1f.jpg',
                'https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_8cd6b529b52bffa6587d76a4b413c795.jpg',
                'https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_d30e8273c5684d7be46f9a75b04d3c1e.jpg',
                'https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_a63450af5ac270ba0e32dd2a5d8a440b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b969be5-acac-5468-bdca-45322a1bbcb3/8b969be5-acac-5468-bdca-45322a1bbcb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_b791557631f9b7171bf1a589959c588b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b969be5-acac-5468-bdca-45322a1bbcb3/8b969be5-acac-5468-bdca-45322a1bbcb3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_73652ba02cd17ce695d76316bfa3d37b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b969be5-acac-5468-bdca-45322a1bbcb3/8b969be5-acac-5468-bdca-45322a1bbcb3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_1ce225e3706866cb44e35481a2d88e1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b969be5-acac-5468-bdca-45322a1bbcb3/8b969be5-acac-5468-bdca-45322a1bbcb3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_8cd6b529b52bffa6587d76a4b413c795.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b969be5-acac-5468-bdca-45322a1bbcb3/8b969be5-acac-5468-bdca-45322a1bbcb3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_d30e8273c5684d7be46f9a75b04d3c1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b969be5-acac-5468-bdca-45322a1bbcb3/8b969be5-acac-5468-bdca-45322a1bbcb3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/7b/9f7bd0684910f75155791a1f9e7279b0/pa/TR19943_a63450af5ac270ba0e32dd2a5d8a440b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI Sport Rider',
 'transmission': 'manual',
 'trim': 'Sport Rider',
 'year': 2006}
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR19943%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [auto1.es] INFO: Saving data for TR19943: {'created_time': 1774706744.454469, 'last_price_update_time': 1774706744.454479, 'auction_closing_time': 1774883975.0}
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TR19943') HTTP/1.1" 204 0
2026-03-28 14:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_b0dd6b7cd1876366db27d3a88f65513a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_64391149c1e09d43e677abd83646e9a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_64391149c1e09d43e677abd83646e9a0.jpg not downloaded yet
2026-03-28 14:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5439fc8d-892f-54c6-a661-d2f48ada28f0 with identifier: UD30245
2026-03-28 14:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5439fc8d-892f-54c6-a661-d2f48ada28f0 with scrape type 1
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5439fc8d-892f-54c6-a661-d2f48ada28f0
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_fa2d1893df6213b8a3952ef07c398217.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_fa2d1893df6213b8a3952ef07c398217.jpg not downloaded yet
2026-03-28 14:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_6139fba56563fda34baf8bf3ced1790b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_951ff015903085b0080f9b36674f5958.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_7f377b0adc1b79da5308f3052ea871c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_7f377b0adc1b79da5308f3052ea871c0.jpg not downloaded yet
2026-03-28 14:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_cd81c9b5256edd052ebe54de362d3022.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_f76394b9b12828dc27ce234fc6c83d0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_f76394b9b12828dc27ce234fc6c83d0a.jpg not downloaded yet
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_d727da9b44fd8364cc50e42d76f411c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_d727da9b44fd8364cc50e42d76f411c7.jpg not downloaded yet
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b485410>
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_7dd2ad2925b4412ee83e2bd4e8449ede.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_7dd2ad2925b4412ee83e2bd4e8449ede.jpg saved to cache
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61
2026-03-28 14:05:44 [auto1.es] INFO: Channel: 24h | Page: 1 | totalHits: 2696 | hits on page: 40
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_c6620fd95928891005bdc85e3396f950.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_c6620fd95928891005bdc85e3396f950.jpg not downloaded yet
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 8c814f4f-0536-5068-912c-2577463fb071 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 091e10bb-bcc7-5ce5-818a-d21009fc472c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_94c4eb3113c06bcae37d69b2914ae51c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_94c4eb3113c06bcae37d69b2914ae51c.jpg not downloaded yet
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_6b0e869fcf75461a9a7b865968da42fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_6b0e869fcf75461a9a7b865968da42fc.jpg not downloaded yet
2026-03-28 14:05:44 [auto1.es] INFO: Found listing with ID: UE67433
2026-03-28 14:05:44 [auto1.es] INFO: Found listing with ID: TZ01977
2026-03-28 14:05:44 [auto1.es] INFO: Found listing with ID: GW37320
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW37320%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [auto1.es] INFO: Scrape type for GW37320: 0
2026-03-28 14:05:44 [auto1.es] INFO: Found listing with ID: GG74961
2026-03-28 14:05:44 [auto1.es] INFO: Found listing with ID: XW94395
2026-03-28 14:05:44 [auto1.es] INFO: Found listing with ID: PK32914
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK32914%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [auto1.es] INFO: Scrape type for PK32914: 0
2026-03-28 14:05:44 [auto1.es] INFO: Found listing with ID: GW88114
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW88114%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [auto1.es] INFO: Scrape type for GW88114: 0
2026-03-28 14:05:44 [auto1.es] INFO: Found listing with ID: RH91028
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b487650>
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_b0dd6b7cd1876366db27d3a88f65513a.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_b0dd6b7cd1876366db27d3a88f65513a.jpg saved to cache
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_b4f9b889290a1dc9c06ff18adba149c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_b4f9b889290a1dc9c06ff18adba149c4.jpg not downloaded yet
2026-03-28 14:05:44 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/RH91028/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5f7310>
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_6139fba56563fda34baf8bf3ced1790b.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_6139fba56563fda34baf8bf3ced1790b.jpg saved to cache
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 091e10bb-bcc7-5ce5-818a-d21009fc472c
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa3a3d0>
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_951ff015903085b0080f9b36674f5958.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_951ff015903085b0080f9b36674f5958.jpg saved to cache
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_c30698d9bd788f4c61a96d3ac9d42452.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_c30698d9bd788f4c61a96d3ac9d42452.jpg not downloaded yet
2026-03-28 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_5923889f3fab9f3166f1d8f1508e4853.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_5923889f3fab9f3166f1d8f1508e4853.jpg not downloaded yet
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: LZ33351
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ33351%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [auto1.es] INFO: Scrape type for LZ33351: 0
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: TR19943
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR19943%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [auto1.es] INFO: Scrape type for TR19943: 0
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: JS77996
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS77996%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [auto1.es] INFO: Scrape type for JS77996: 0
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: NH39190
2026-03-28 14:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_66e9ac3f75cad6bb67e0b11ae6556b2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_3318d23dcea2065ca9c378b0e853586d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_e0ff30f0130387c19b29ff27d572d391.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_d9e84b506772779cbf5fc27235f1c94e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_7ff6be2fc4c1a9c56c4108c8f353e3cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_63b70b9ab15d633b0a0ecff59327c443.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_63b70b9ab15d633b0a0ecff59327c443.jpg not downloaded yet
2026-03-28 14:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644139b090>
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_cd81c9b5256edd052ebe54de362d3022.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_cd81c9b5256edd052ebe54de362d3022.jpg saved to cache
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 091e10bb-bcc7-5ce5-818a-d21009fc472c
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_39c3d2effcada35ab3dabcead231e71a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_39c3d2effcada35ab3dabcead231e71a.jpg not downloaded yet
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: ZE40352
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_422293f367edfcc91927c4d4bdf55c0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_422293f367edfcc91927c4d4bdf55c0b.jpg not downloaded yet
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_455617e5affd1ede285e3a2ea0c70935.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_455617e5affd1ede285e3a2ea0c70935.jpg not downloaded yet
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: CC76703
2026-03-28 14:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY68249> (referer: https://www.auto1.com/v1/car-details-view/FY68249/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_48b23841a793dec181293bd075d20a7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_48b23841a793dec181293bd075d20a7e.jpg not downloaded yet
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: ES07988
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: HY65431
2026-03-28 14:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_fa2d1893df6213b8a3952ef07c398217.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3bdb10>
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_66e9ac3f75cad6bb67e0b11ae6556b2e.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_66e9ac3f75cad6bb67e0b11ae6556b2e.jpg saved to cache
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 091e10bb-bcc7-5ce5-818a-d21009fc472c
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa5d9d0>
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_3318d23dcea2065ca9c378b0e853586d.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_3318d23dcea2065ca9c378b0e853586d.jpg saved to cache
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3b1cd0>
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F37%252F1d3714393bcfc1cd7b32625acb723487%252Fpa%252FZE40352_e0ff30f0130387c19b29ff27d572d391.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_e0ff30f0130387c19b29ff27d572d391.jpg saved to cache
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c814f4f-0536-5068-912c-2577463fb071
2026-03-28 14:05:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c814f4f-0536-5068-912c-2577463fb071, skipping ID generation
2026-03-28 14:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c814f4f-0536-5068-912c-2577463fb071 with scrape type 1
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c814f4f-0536-5068-912c-2577463fb071 sending to next pipeline
2026-03-28 14:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8c814f4f-0536-5068-912c-2577463fb071, identifier: ZE40352
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aaccb90>
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_d9e84b506772779cbf5fc27235f1c94e.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_d9e84b506772779cbf5fc27235f1c94e.jpg saved to cache
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6442381e50>
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_7ff6be2fc4c1a9c56c4108c8f353e3cd.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_7ff6be2fc4c1a9c56c4108c8f353e3cd.jpg saved to cache
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00
2026-03-28 14:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_c6620fd95928891005bdc85e3396f950.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_053f0931480d793ac4992b70120b26d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_053f0931480d793ac4992b70120b26d2.jpg not downloaded yet
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: RB15615
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: VZ79262
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: HA87935
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA87935%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [auto1.es] INFO: Scrape type for HA87935: 0
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: XC96716
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: VC74313
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: RG03753
2026-03-28 14:05:45 [auto1.es] INFO: Found listing with ID: CN77625
2026-03-28 14:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8c814f4f-0536-5068-912c-2577463fb071 with identifier: ZE40352
2026-03-28 14:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8c814f4f-0536-5068-912c-2577463fb071 with identifier: ZE40352
2026-03-28 14:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8c814f4f-0536-5068-912c-2577463fb071 with identifier: ZE40352 to the API
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_e0ff30f0130387c19b29ff27d572d391.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:21Z',
 'fuel_type': 'petrol',
 'id': '8c814f4f-0536-5068-912c-2577463fb071',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE40352',
 'listing': 'auction',
 'location': 'ES, Málaga',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 124103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_e0ff30f0130387c19b29ff27d572d391.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_f413d357b7318f61425e0b2f8d92296f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_c9d1e877504a404fc76e7f03f61717b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_9ee1b0eb614caaac2a8457e8c5c9cb8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_50cb9a403c82edcb4291b546bd853954.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_ccc3615bf096c099f6dcdd9a4ba07989.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_6b953cab6c5ef88c8cbc2b9ddfe53e1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_54fa89d2615a6cfef9421e97568c8ca0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c814f4f-0536-5068-912c-2577463fb071/8c814f4f-0536-5068-912c-2577463fb071_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/37/1d3714393bcfc1cd7b32625acb723487/pa/ZE40352_6145b19b7e287acf8c4ec0f395a1bd69.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE40352%27 HTTP/1.1" 200 None
2026-03-28 14:05:45 [auto1.es] INFO: Saving data for ZE40352: {'created_time': 1774706745.972139, 'last_price_update_time': 1774706745.972148, 'auction_closing_time': 1774885041.0}
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZE40352') HTTP/1.1" 204 0
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_6b0e869fcf75461a9a7b865968da42fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_422293f367edfcc91927c4d4bdf55c0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_b4f9b889290a1dc9c06ff18adba149c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_94c4eb3113c06bcae37d69b2914ae51c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_5baaf90a40d566a1ef5b5977a5f0b804.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_5baaf90a40d566a1ef5b5977a5f0b804.jpg not downloaded yet
2026-03-28 14:05:46 [auto1.es] INFO: Found listing with ID: XD32564
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD32564%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [auto1.es] INFO: Scrape type for XD32564: 0
2026-03-28 14:05:46 [auto1.es] INFO: Found listing with ID: BB89966
2026-03-28 14:05:46 [auto1.es] INFO: Found listing with ID: EA80671
2026-03-28 14:05:46 [auto1.es] INFO: Found listing with ID: YK19704
2026-03-28 14:05:46 [auto1.es] INFO: Found listing with ID: AE50164
2026-03-28 14:05:46 [auto1.es] INFO: Found listing with ID: RK07615
2026-03-28 14:05:46 [auto1.es] INFO: Found listing with ID: UD30245
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX14033> (referer: https://www.auto1.com/v1/car-details-view/BX14033/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VD65621> (referer: https://www.auto1.com/v1/car-details-view/VD65621/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC96149> (referer: https://www.auto1.com/v1/car-details-view/KC96149/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17ac0978-549a-5b20-9d1d-f3052f0c8290 with identifier: FY68249
2026-03-28 14:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17ac0978-549a-5b20-9d1d-f3052f0c8290 with scrape type 1
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17ac0978-549a-5b20-9d1d-f3052f0c8290
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_40235558f7f788a278fe0748d4445012.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_40235558f7f788a278fe0748d4445012.jpg not downloaded yet
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a932290>
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_fa2d1893df6213b8a3952ef07c398217.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_fa2d1893df6213b8a3952ef07c398217.jpg saved to cache
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5439fc8d-892f-54c6-a661-d2f48ada28f0
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ31017> (referer: https://www.auto1.com/v1/car-details-view/HZ31017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 091e10bb-bcc7-5ce5-818a-d21009fc472c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_caa2e60e2e22a97444fc4487c4fc23d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_caa2e60e2e22a97444fc4487c4fc23d1.jpg not downloaded yet
2026-03-28 14:05:46 [auto1.es] INFO: Found listing with ID: BX14033
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_ef5ba102ab7a6ca4135753e62def9461.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_ef5ba102ab7a6ca4135753e62def9461.jpg not downloaded yet
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644025bd10>
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_c6620fd95928891005bdc85e3396f950.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_c6620fd95928891005bdc85e3396f950.jpg saved to cache
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 091e10bb-bcc7-5ce5-818a-d21009fc472c
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a950cd0>
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_6b0e869fcf75461a9a7b865968da42fc.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_6b0e869fcf75461a9a7b865968da42fc.jpg saved to cache
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5439fc8d-892f-54c6-a661-d2f48ada28f0
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f64415fbf10>
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_422293f367edfcc91927c4d4bdf55c0b.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_422293f367edfcc91927c4d4bdf55c0b.jpg saved to cache
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 091e10bb-bcc7-5ce5-818a-d21009fc472c
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4e2e50>
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_b4f9b889290a1dc9c06ff18adba149c4.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_b4f9b889290a1dc9c06ff18adba149c4.jpg saved to cache
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 091e10bb-bcc7-5ce5-818a-d21009fc472c
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f64413bb150>
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_94c4eb3113c06bcae37d69b2914ae51c.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_94c4eb3113c06bcae37d69b2914ae51c.jpg saved to cache
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61
2026-03-28 14:05:46 [auto1.es] INFO: Found listing with ID: FY68249
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_e040e9a97756fa65fa2c6aef8a9abf36.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_e040e9a97756fa65fa2c6aef8a9abf36.jpg not downloaded yet
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_455617e5affd1ede285e3a2ea0c70935.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b485adc-2451-540a-af82-13790129b8d7 with identifier: BX14033
2026-03-28 14:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b485adc-2451-540a-af82-13790129b8d7 with scrape type 1
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1b485adc-2451-540a-af82-13790129b8d7
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e853dfdc8efb8d9dd52c2440dd8f66%252Fpa%252FBX14033_66a799b78d74763ef01267ad667d4c70.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_66a799b78d74763ef01267ad667d4c70.jpg not downloaded yet
2026-03-28 14:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23f32f8-8fcc-5cde-86e6-723c847afb87 with identifier: VD65621
2026-03-28 14:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23f32f8-8fcc-5cde-86e6-723c847afb87 with scrape type 1
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f23f32f8-8fcc-5cde-86e6-723c847afb87
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc956556ad08241898da5bf8bb756c216%252Fpa%252FVD65621_f75fdc2433bc892f7d517aa75da44dbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_f75fdc2433bc892f7d517aa75da44dbe.jpg already downloaded
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc956556ad08241898da5bf8bb756c216%252Fpa%252FVD65621_0141d2fd3d23061345a7e663504ff961.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_0141d2fd3d23061345a7e663504ff961.jpg already downloaded
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc956556ad08241898da5bf8bb756c216%252Fpa%252FVD65621_75874a7ef03f4e6076330a9f4ebeed12.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_75874a7ef03f4e6076330a9f4ebeed12.jpg already downloaded
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc956556ad08241898da5bf8bb756c216%252Fpa%252FVD65621_4eec3dde4fcae592cc1079c4a028b8d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_4eec3dde4fcae592cc1079c4a028b8d1.jpg already downloaded
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc956556ad08241898da5bf8bb756c216%252Fpa%252FVD65621_15e9923563c20785adef7b31ca57563d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_15e9923563c20785adef7b31ca57563d.jpg already downloaded
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc956556ad08241898da5bf8bb756c216%252Fpa%252FVD65621_325dfb2bd9c5ad456468d09860bc4aee.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_325dfb2bd9c5ad456468d09860bc4aee.jpg already downloaded
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc956556ad08241898da5bf8bb756c216%252Fpa%252FVD65621_ad7502471df3b70a1f0e19cce85909cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_ad7502471df3b70a1f0e19cce85909cf.jpg already downloaded
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc956556ad08241898da5bf8bb756c216%252Fpa%252FVD65621_c803c82a1c3969960207fe84140f3e41.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_c803c82a1c3969960207fe84140f3e41.jpg already downloaded
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc956556ad08241898da5bf8bb756c216%252Fpa%252FVD65621_e12d6a3498f17af31553306b94d495d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_e12d6a3498f17af31553306b94d495d9.jpg already downloaded
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F56%252Fc956556ad08241898da5bf8bb756c216%252Fpa%252FVD65621_cbac84356a5a7e9a8063d66511876214.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_cbac84356a5a7e9a8063d66511876214.jpg already downloaded
2026-03-28 14:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f23f32f8-8fcc-5cde-86e6-723c847afb87, identifier: VD65621
2026-03-28 14:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b14aa6db-a6a9-51b1-b380-328edb67faa2 with identifier: KC96149
2026-03-28 14:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b14aa6db-a6a9-51b1-b380-328edb67faa2 with scrape type 1
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b14aa6db-a6a9-51b1-b380-328edb67faa2
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_ba47fc5ca48a9e4eb24042ff59b99a5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_ba47fc5ca48a9e4eb24042ff59b99a5a.jpg not downloaded yet
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_5923889f3fab9f3166f1d8f1508e4853.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_63b70b9ab15d633b0a0ecff59327c443.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_39c3d2effcada35ab3dabcead231e71a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_053f0931480d793ac4992b70120b26d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:46 [auto1.es] INFO: Found listing with ID: AA00980
2026-03-28 14:05:46 [auto1.es] INFO: Found listing with ID: HZ31017
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_e0be6b5c3f7ca069b946acfa3a4ffd86.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_e0be6b5c3f7ca069b946acfa3a4ffd86.jpg not downloaded yet
2026-03-28 14:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f23f32f8-8fcc-5cde-86e6-723c847afb87 with identifier: VD65621
2026-03-28 14:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f23f32f8-8fcc-5cde-86e6-723c847afb87 with identifier: VD65621
2026-03-28 14:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f23f32f8-8fcc-5cde-86e6-723c847afb87 with identifier: VD65621 to the API
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VD65621>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:44:16Z',
 'fuel_type': 'diesel',
 'id': 'f23f32f8-8fcc-5cde-86e6-723c847afb87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD65621',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_f75fdc2433bc892f7d517aa75da44dbe.jpg',
                'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_0141d2fd3d23061345a7e663504ff961.jpg',
                'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_75874a7ef03f4e6076330a9f4ebeed12.jpg',
                'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_4eec3dde4fcae592cc1079c4a028b8d1.jpg',
                'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_15e9923563c20785adef7b31ca57563d.jpg',
                'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_325dfb2bd9c5ad456468d09860bc4aee.jpg',
                'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_ad7502471df3b70a1f0e19cce85909cf.jpg',
                'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_c803c82a1c3969960207fe84140f3e41.jpg',
                'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_e12d6a3498f17af31553306b94d495d9.jpg',
                'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_cbac84356a5a7e9a8063d66511876214.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23f32f8-8fcc-5cde-86e6-723c847afb87/f23f32f8-8fcc-5cde-86e6-723c847afb87_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73348,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_f75fdc2433bc892f7d517aa75da44dbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23f32f8-8fcc-5cde-86e6-723c847afb87/f23f32f8-8fcc-5cde-86e6-723c847afb87_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73348,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_0141d2fd3d23061345a7e663504ff961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23f32f8-8fcc-5cde-86e6-723c847afb87/f23f32f8-8fcc-5cde-86e6-723c847afb87_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381491,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_75874a7ef03f4e6076330a9f4ebeed12.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23f32f8-8fcc-5cde-86e6-723c847afb87/f23f32f8-8fcc-5cde-86e6-723c847afb87_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308304,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_4eec3dde4fcae592cc1079c4a028b8d1.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23f32f8-8fcc-5cde-86e6-723c847afb87/f23f32f8-8fcc-5cde-86e6-723c847afb87_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278323,
             'Height': 1600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_15e9923563c20785adef7b31ca57563d.jpg',
             'Width': 900},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23f32f8-8fcc-5cde-86e6-723c847afb87/f23f32f8-8fcc-5cde-86e6-723c847afb87_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317958,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_325dfb2bd9c5ad456468d09860bc4aee.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23f32f8-8fcc-5cde-86e6-723c847afb87/f23f32f8-8fcc-5cde-86e6-723c847afb87_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156263,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_ad7502471df3b70a1f0e19cce85909cf.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23f32f8-8fcc-5cde-86e6-723c847afb87/f23f32f8-8fcc-5cde-86e6-723c847afb87_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369842,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_c803c82a1c3969960207fe84140f3e41.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23f32f8-8fcc-5cde-86e6-723c847afb87/f23f32f8-8fcc-5cde-86e6-723c847afb87_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331453,
             'Height': 1600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_e12d6a3498f17af31553306b94d495d9.jpg',
             'Width': 900},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23f32f8-8fcc-5cde-86e6-723c847afb87/f23f32f8-8fcc-5cde-86e6-723c847afb87_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/56/c956556ad08241898da5bf8bb756c216/pa/VD65621_cbac84356a5a7e9a8063d66511876214.jpg',
             'Width': 338}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2013}
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD65621%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [auto1.es] INFO: Saving data for VD65621: {'created_time': 1774706747.336107, 'last_price_update_time': 1774706747.336117, 'auction_closing_time': 1774885456.0}
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VD65621') HTTP/1.1" 204 0
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e853dfdc8efb8d9dd52c2440dd8f66%252Fpa%252FBX14033_9ecf5f05a84882651b83f68cfd8875ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_9ecf5f05a84882651b83f68cfd8875ea.jpg not downloaded yet
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_91d80a2285c70b86329702b511ebf6f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_91d80a2285c70b86329702b511ebf6f5.jpg not downloaded yet
2026-03-28 14:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f57197d-e7bc-5a95-b385-8c41ec56ce88 with identifier: HZ31017
2026-03-28 14:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88 with scrape type 1
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_22b5af321db96793df468769dcbd6828.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_22b5af321db96793df468769dcbd6828.jpg not downloaded yet
2026-03-28 14:05:47 [auto1.es] INFO: Found listing with ID: KC96149
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_a206e1baa510b8b94490b647f3870dbc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_a206e1baa510b8b94490b647f3870dbc.jpg not downloaded yet
2026-03-28 14:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_f76394b9b12828dc27ce234fc6c83d0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e853dfdc8efb8d9dd52c2440dd8f66%252Fpa%252FBX14033_c3148e713d8f1bf7b498caaa5f7c928f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_c3148e713d8f1bf7b498caaa5f7c928f.jpg not downloaded yet
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_3782ef621f0f5298f687293d435eca55.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_3782ef621f0f5298f687293d435eca55.jpg not downloaded yet
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_8248964675fd6cbc7d9cd77dd071cddc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_8248964675fd6cbc7d9cd77dd071cddc.jpg not downloaded yet
2026-03-28 14:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN77625/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6441333090>
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_455617e5affd1ede285e3a2ea0c70935.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_455617e5affd1ede285e3a2ea0c70935.jpg saved to cache
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5439fc8d-892f-54c6-a661-d2f48ada28f0
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aabf1d0>
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_5923889f3fab9f3166f1d8f1508e4853.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_5923889f3fab9f3166f1d8f1508e4853.jpg saved to cache
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5439fc8d-892f-54c6-a661-d2f48ada28f0
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a885750>
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_63b70b9ab15d633b0a0ecff59327c443.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_63b70b9ab15d633b0a0ecff59327c443.jpg saved to cache
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 091e10bb-bcc7-5ce5-818a-d21009fc472c
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b462b10>
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_39c3d2effcada35ab3dabcead231e71a.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_39c3d2effcada35ab3dabcead231e71a.jpg saved to cache
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5439fc8d-892f-54c6-a661-d2f48ada28f0
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a88c1d0>
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_053f0931480d793ac4992b70120b26d2.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_053f0931480d793ac4992b70120b26d2.jpg saved to cache
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5439fc8d-892f-54c6-a661-d2f48ada28f0
2026-03-28 14:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_40235558f7f788a278fe0748d4445012.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:47 [auto1.es] INFO: Found listing with ID: PJ13315
2026-03-28 14:05:47 [auto1.es] INFO: Found listing with ID: PL39404
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_f7d6f5b2a7231cacfb0157f3d2ffd030.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_f7d6f5b2a7231cacfb0157f3d2ffd030.jpg not downloaded yet
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 5439fc8d-892f-54c6-a661-d2f48ada28f0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e853dfdc8efb8d9dd52c2440dd8f66%252Fpa%252FBX14033_cdfc05d94f2a8b07657c962a94f98b82.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_cdfc05d94f2a8b07657c962a94f98b82.jpg not downloaded yet
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_241fbbfbc1a29310e94e0d81430d8d23.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_241fbbfbc1a29310e94e0d81430d8d23.jpg not downloaded yet
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_529c1acd0bd12c1ba5e1dc7d14bc4152.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_529c1acd0bd12c1ba5e1dc7d14bc4152.jpg not downloaded yet
2026-03-28 14:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_7f377b0adc1b79da5308f3052ea871c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_7901367f47109ec1abb2ab486baf7417.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_64391149c1e09d43e677abd83646e9a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:47 [auto1.es] INFO: Found listing with ID: VD65621
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD65621%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [auto1.es] INFO: Scrape type for VD65621: 0
2026-03-28 14:05:47 [auto1.es] INFO: Found listing with ID: HG29658
2026-03-28 14:05:47 [auto1.es] INFO: Found listing with ID: VM52348
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_f17b0337148803a23657940bf8fc175f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_f17b0337148803a23657940bf8fc175f.jpg not downloaded yet
2026-03-28 14:05:47 [auto1.es] INFO: Channel: 24h | Page: 2 | totalHits: 2696 | hits on page: 40
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9b7690>
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_f76394b9b12828dc27ce234fc6c83d0a.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_f76394b9b12828dc27ce234fc6c83d0a.jpg saved to cache
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e853dfdc8efb8d9dd52c2440dd8f66%252Fpa%252FBX14033_32380e34a5074ea54cf23cf0629630c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_32380e34a5074ea54cf23cf0629630c3.jpg not downloaded yet
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_1fd7fdc99840efa6b8e074811670f34c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_1fd7fdc99840efa6b8e074811670f34c.jpg not downloaded yet
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_a4df39bdc347be07898510b5336138e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_a4df39bdc347be07898510b5336138e9.jpg not downloaded yet
2026-03-28 14:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_e040e9a97756fa65fa2c6aef8a9abf36.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 5439fc8d-892f-54c6-a661-d2f48ada28f0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_ccc090423d7841b66a92d4039803a670.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_ccc090423d7841b66a92d4039803a670.jpg not downloaded yet
2026-03-28 14:05:47 [auto1.es] INFO: Found listing with ID: JZ79034
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ79034%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [auto1.es] INFO: Scrape type for JZ79034: 2
2026-03-28 14:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1f4eca3-5e3a-573e-add2-a9d34646be57 with identifier: JZ79034
2026-03-28 14:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1f4eca3-5e3a-573e-add2-a9d34646be57 with scrape type 2
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1f4eca3-5e3a-573e-add2-a9d34646be57 with scrape type 2
2026-03-28 14:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b1f4eca3-5e3a-573e-add2-a9d34646be57, identifier: JZ79034
2026-03-28 14:05:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e853dfdc8efb8d9dd52c2440dd8f66%252Fpa%252FBX14033_20e33c19845f90720b9fe0a00fc54757.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_20e33c19845f90720b9fe0a00fc54757.jpg not downloaded yet
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_b64e3d7ecdfd680484ddd52aca781f26.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_b64e3d7ecdfd680484ddd52aca781f26.jpg not downloaded yet
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_9d411b642042390c9b341824b4a99959.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_9d411b642042390c9b341824b4a99959.jpg not downloaded yet
2026-03-28 14:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b1f4eca3-5e3a-573e-add2-a9d34646be57 with identifier: JZ79034
2026-03-28 14:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b1f4eca3-5e3a-573e-add2-a9d34646be57 with identifier: JZ79034
2026-03-28 14:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b1f4eca3-5e3a-573e-add2-a9d34646be57 with identifier: JZ79034 to the API
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:54:18Z',
 'fuel_type': 'diesel',
 'id': 'b1f4eca3-5e3a-573e-add2-a9d34646be57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ79034',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Rexton',
 'odometer': 260301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-31',
 'seller_name': None,
 'title': 'Ssangyong Rexton RX 270 Xdi',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ79034%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [auto1.es] INFO: Saving data for JZ79034: {'auction_closing_time': 1774886058.0, 'created_time': 1774002037.986133, 'last_price_update_time': 1774706748.511101}
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JZ79034') HTTP/1.1" 204 0
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aae42d0>
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_40235558f7f788a278fe0748d4445012.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_40235558f7f788a278fe0748d4445012.jpg saved to cache
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17ac0978-549a-5b20-9d1d-f3052f0c8290
2026-03-28 14:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_9ecf5f05a84882651b83f68cfd8875ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_22b5af321db96793df468769dcbd6828.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_91d80a2285c70b86329702b511ebf6f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_caa2e60e2e22a97444fc4487c4fc23d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_d2303301434e0e792b956b3922868e24.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_d2303301434e0e792b956b3922868e24.jpg not downloaded yet
2026-03-28 14:05:48 [auto1.es] INFO: Found listing with ID: DD78517
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD78517%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [auto1.es] INFO: Scrape type for DD78517: 1
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_31c11688d1ce1c9cd44de56e1ca3c81d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_31c11688d1ce1c9cd44de56e1ca3c81d.jpg not downloaded yet
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_cc432788e6e81ce21a1dc7cfd9066c17.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_cc432788e6e81ce21a1dc7cfd9066c17.jpg not downloaded yet
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a98c450>
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F71%252F7e71f313fe4ce91abc29ad9a43b4c559%252Fpa%252FRH91028_7f377b0adc1b79da5308f3052ea871c0.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_7f377b0adc1b79da5308f3052ea871c0.jpg saved to cache
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 091e10bb-bcc7-5ce5-818a-d21009fc472c
2026-03-28 14:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 091e10bb-bcc7-5ce5-818a-d21009fc472c, skipping ID generation
2026-03-28 14:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 091e10bb-bcc7-5ce5-818a-d21009fc472c with scrape type 1
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 091e10bb-bcc7-5ce5-818a-d21009fc472c sending to next pipeline
2026-03-28 14:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 091e10bb-bcc7-5ce5-818a-d21009fc472c, identifier: RH91028
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa2dd50>
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_7901367f47109ec1abb2ab486baf7417.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_7901367f47109ec1abb2ab486baf7417.jpg saved to cache
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b391210>
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc0%252F2cc06938812648dabb41839a0a62a8ef%252Fpa%252FHY65431_64391149c1e09d43e677abd83646e9a0.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_64391149c1e09d43e677abd83646e9a0.jpg saved to cache
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61
2026-03-28 14:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35c72166-39d7-5cb3-b059-b63bd5ab0e61, skipping ID generation
2026-03-28 14:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61 with scrape type 1
2026-03-28 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35c72166-39d7-5cb3-b059-b63bd5ab0e61 sending to next pipeline
2026-03-28 14:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 35c72166-39d7-5cb3-b059-b63bd5ab0e61, identifier: HY65431
2026-03-28 14:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a957010>
2026-03-28 14:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_e040e9a97756fa65fa2c6aef8a9abf36.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_e040e9a97756fa65fa2c6aef8a9abf36.jpg saved to cache
2026-03-28 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17ac0978-549a-5b20-9d1d-f3052f0c8290
2026-03-28 14:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_a206e1baa510b8b94490b647f3870dbc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_e50ed29fd045e4a038fc1ef587d7131c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_e50ed29fd045e4a038fc1ef587d7131c.jpg not downloaded yet
2026-03-28 14:05:49 [auto1.es] INFO: Found listing with ID: BC82698
2026-03-28 14:05:49 [auto1.es] INFO: Found listing with ID: ZV53496
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV53496%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [auto1.es] INFO: Scrape type for ZV53496: 1
2026-03-28 14:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 091e10bb-bcc7-5ce5-818a-d21009fc472c with identifier: RH91028
2026-03-28 14:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 091e10bb-bcc7-5ce5-818a-d21009fc472c with identifier: RH91028
2026-03-28 14:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 091e10bb-bcc7-5ce5-818a-d21009fc472c with identifier: RH91028 to the API
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_7f377b0adc1b79da5308f3052ea871c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:47:02Z',
 'fuel_type': 'petrol',
 'id': '091e10bb-bcc7-5ce5-818a-d21009fc472c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH91028',
 'listing': 'auction',
 'location': 'ES, Churra (Murcia)',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 185726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_6139fba56563fda34baf8bf3ced1790b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_cd81c9b5256edd052ebe54de362d3022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_66e9ac3f75cad6bb67e0b11ae6556b2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_7f377b0adc1b79da5308f3052ea871c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_c6620fd95928891005bdc85e3396f950.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_b4f9b889290a1dc9c06ff18adba149c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_63b70b9ab15d633b0a0ecff59327c443.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_091e10bb-bcc7-5ce5-818a-d21009fc472c/091e10bb-bcc7-5ce5-818a-d21009fc472c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/71/7e71f313fe4ce91abc29ad9a43b4c559/pa/RH91028_422293f367edfcc91927c4d4bdf55c0b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH91028%27 HTTP/1.1" 200 None
2026-03-28 14:05:49 [auto1.es] INFO: Saving data for RH91028: {'created_time': 1774706749.540662, 'last_price_update_time': 1774706749.540673, 'auction_closing_time': 1774885622.0}
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RH91028') HTTP/1.1" 204 0
2026-03-28 14:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 35c72166-39d7-5cb3-b059-b63bd5ab0e61 with identifier: HY65431
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 14:05:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 35c72166-39d7-5cb3-b059-b63bd5ab0e61 with identifier: HY65431
2026-03-28 14:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 35c72166-39d7-5cb3-b059-b63bd5ab0e61 with identifier: HY65431 to the API
2026-03-28 14:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_64391149c1e09d43e677abd83646e9a0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:54:47Z',
 'fuel_type': 'petrol',
 'id': '35c72166-39d7-5cb3-b059-b63bd5ab0e61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY65431',
 'listing': 'auction',
 'location': 'ES, Valencia',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 100946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_7dd2ad2925b4412ee83e2bd4e8449ede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_b0dd6b7cd1876366db27d3a88f65513a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_951ff015903085b0080f9b36674f5958.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_d9e84b506772779cbf5fc27235f1c94e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_3318d23dcea2065ca9c378b0e853586d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_64391149c1e09d43e677abd83646e9a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_f76394b9b12828dc27ce234fc6c83d0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c72166-39d7-5cb3-b059-b63bd5ab0e61/35c72166-39d7-5cb3-b059-b63bd5ab0e61_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c0/2cc06938812648dabb41839a0a62a8ef/pa/HY65431_94c4eb3113c06bcae37d69b2914ae51c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY65431%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [auto1.es] INFO: Saving data for HY65431: {'created_time': 1774706750.143198, 'last_price_update_time': 1774706750.143206, 'auction_closing_time': 1774886087.0}
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HY65431') HTTP/1.1" 204 0
2026-03-28 14:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_74feeabd9a494784afe2d71cb5363bb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_74feeabd9a494784afe2d71cb5363bb6.jpg not downloaded yet
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_89ca576b39776ecb226e976612263e01.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_89ca576b39776ecb226e976612263e01.jpg not downloaded yet
2026-03-28 14:05:50 [auto1.es] INFO: Found listing with ID: ZX43091
2026-03-28 14:05:50 [auto1.es] INFO: Found listing with ID: UC73568
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC73568%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [auto1.es] INFO: Scrape type for UC73568: 1
2026-03-28 14:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL39404> (referer: https://www.auto1.com/v1/car-details-view/PL39404/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a800290>
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b485adc-2451-540a-af82-13790129b8d7/1b485adc-2451-540a-af82-13790129b8d7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e853dfdc8efb8d9dd52c2440dd8f66%252Fpa%252FBX14033_9ecf5f05a84882651b83f68cfd8875ea.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_9ecf5f05a84882651b83f68cfd8875ea.jpg saved to cache
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b485adc-2451-540a-af82-13790129b8d7
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a959390>
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_22b5af321db96793df468769dcbd6828.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_22b5af321db96793df468769dcbd6828.jpg saved to cache
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9f55d0>
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_91d80a2285c70b86329702b511ebf6f5.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_91d80a2285c70b86329702b511ebf6f5.jpg saved to cache
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b14aa6db-a6a9-51b1-b380-328edb67faa2
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a959790>
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ffa%252F14fa77c75d2d52d7cf58e7b8ba8fe581%252Fpa%252FUD30245_caa2e60e2e22a97444fc4487c4fc23d1.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_caa2e60e2e22a97444fc4487c4fc23d1.jpg saved to cache
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5439fc8d-892f-54c6-a661-d2f48ada28f0
2026-03-28 14:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_c3148e713d8f1bf7b498caaa5f7c928f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_f7d6f5b2a7231cacfb0157f3d2ffd030.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_3782ef621f0f5298f687293d435eca55.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_e0be6b5c3f7ca069b946acfa3a4ffd86.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_8248964675fd6cbc7d9cd77dd071cddc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_8ba54621c1466582cc1f80e0a2a6621a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_8ba54621c1466582cc1f80e0a2a6621a.jpg not downloaded yet
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_4ac5756f8d4ec178d4fe57f51ca52be6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_4ac5756f8d4ec178d4fe57f51ca52be6.jpg not downloaded yet
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 17ac0978-549a-5b20-9d1d-f3052f0c8290 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5439fc8d-892f-54c6-a661-d2f48ada28f0 with identifier: UD30245
2026-03-28 14:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5439fc8d-892f-54c6-a661-d2f48ada28f0 with identifier: UD30245
2026-03-28 14:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5439fc8d-892f-54c6-a661-d2f48ada28f0 with identifier: UD30245 to the API
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:50 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:43Z',
 'fuel_type': 'diesel',
 'id': '5439fc8d-892f-54c6-a661-d2f48ada28f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD30245',
 'listing': 'auction',
 'location': 'ES, Rivas-Vaciamadrid, Madrid',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 132814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_fa2d1893df6213b8a3952ef07c398217.jpg',
                'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_d727da9b44fd8364cc50e42d76f411c7.jpg',
                'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_6b0e869fcf75461a9a7b865968da42fc.jpg',
                'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_5923889f3fab9f3166f1d8f1508e4853.jpg',
                'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_39c3d2effcada35ab3dabcead231e71a.jpg',
                'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_455617e5affd1ede285e3a2ea0c70935.jpg',
                'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_48b23841a793dec181293bd075d20a7e.jpg',
                'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_053f0931480d793ac4992b70120b26d2.jpg',
                'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_5baaf90a40d566a1ef5b5977a5f0b804.jpg',
                'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_caa2e60e2e22a97444fc4487c4fc23d1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_fa2d1893df6213b8a3952ef07c398217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_6b0e869fcf75461a9a7b865968da42fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_5923889f3fab9f3166f1d8f1508e4853.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_39c3d2effcada35ab3dabcead231e71a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_455617e5affd1ede285e3a2ea0c70935.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_053f0931480d793ac4992b70120b26d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439fc8d-892f-54c6-a661-d2f48ada28f0/5439fc8d-892f-54c6-a661-d2f48ada28f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/fa/14fa77c75d2d52d7cf58e7b8ba8fe581/pa/UD30245_caa2e60e2e22a97444fc4487c4fc23d1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD30245%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [auto1.es] INFO: Saving data for UD30245: {'created_time': 1774706750.870956, 'last_price_update_time': 1774706750.870965, 'auction_closing_time': 1774884523.0}
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UD30245') HTTP/1.1" 204 0
2026-03-28 14:05:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:50 [auto1.es] INFO: Found listing with ID: LN12503
2026-03-28 14:05:50 [auto1.es] INFO: Found listing with ID: GV64854
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV64854%27 HTTP/1.1" 200 None
2026-03-28 14:05:50 [auto1.es] INFO: Scrape type for GV64854: 1
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8a7990>
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_a206e1baa510b8b94490b647f3870dbc.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_a206e1baa510b8b94490b647f3870dbc.jpg saved to cache
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17ac0978-549a-5b20-9d1d-f3052f0c8290
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 5439fc8d-892f-54c6-a661-d2f48ada28f0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_535102cf93ff46d74f64c33fd0a41164.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_535102cf93ff46d74f64c33fd0a41164.jpg not downloaded yet
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_7f5e90cd8449785cc0743d9f7669a8ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_7f5e90cd8449785cc0743d9f7669a8ff.jpg not downloaded yet
2026-03-28 14:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e with identifier: PL39404
2026-03-28 14:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e with scrape type 1
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_b4a15eae1c52665569c1688885bcb455.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_b4a15eae1c52665569c1688885bcb455.jpg not downloaded yet
2026-03-28 14:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_ccc090423d7841b66a92d4039803a670.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_e50ed29fd045e4a038fc1ef587d7131c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_cc432788e6e81ce21a1dc7cfd9066c17.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_20e33c19845f90720b9fe0a00fc54757.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:51 [auto1.es] INFO: Found listing with ID: KZ95264
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ95264%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [auto1.es] INFO: Scrape type for KZ95264: 1
2026-03-28 14:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_fbf860e7cccfb1e5e8212cb997214a5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_fbf860e7cccfb1e5e8212cb997214a5b.jpg not downloaded yet
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_27186c87d3a569e115dffe9fae3eadc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_27186c87d3a569e115dffe9fae3eadc9.jpg not downloaded yet
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5809d0>
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b485adc-2451-540a-af82-13790129b8d7/1b485adc-2451-540a-af82-13790129b8d7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e853dfdc8efb8d9dd52c2440dd8f66%252Fpa%252FBX14033_c3148e713d8f1bf7b498caaa5f7c928f.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_c3148e713d8f1bf7b498caaa5f7c928f.jpg saved to cache
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b485adc-2451-540a-af82-13790129b8d7
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3851d0>
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_f7d6f5b2a7231cacfb0157f3d2ffd030.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_f7d6f5b2a7231cacfb0157f3d2ffd030.jpg saved to cache
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17ac0978-549a-5b20-9d1d-f3052f0c8290
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9d4bd0>
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_3782ef621f0f5298f687293d435eca55.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_3782ef621f0f5298f687293d435eca55.jpg saved to cache
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b14aa6db-a6a9-51b1-b380-328edb67faa2
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aaf8410>
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_e0be6b5c3f7ca069b946acfa3a4ffd86.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_e0be6b5c3f7ca069b946acfa3a4ffd86.jpg saved to cache
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17ac0978-549a-5b20-9d1d-f3052f0c8290
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644137b590>
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_8248964675fd6cbc7d9cd77dd071cddc.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_8248964675fd6cbc7d9cd77dd071cddc.jpg saved to cache
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88
2026-03-28 14:05:51 [auto1.es] INFO: Found listing with ID: GY48827
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY48827%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [auto1.es] INFO: Scrape type for GY48827: 1
2026-03-28 14:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_89ca576b39776ecb226e976612263e01.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_183ed980d457de4c34e064bf166f46c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_183ed980d457de4c34e064bf166f46c1.jpg not downloaded yet
2026-03-28 14:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_a4df39bdc347be07898510b5336138e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_74feeabd9a494784afe2d71cb5363bb6.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_d2303301434e0e792b956b3922868e24.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:51 [auto1.es] INFO: Found listing with ID: DA78268
2026-03-28 14:05:51 [auto1.es] INFO: Found listing with ID: UM67436
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM67436%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [auto1.es] INFO: Scrape type for UM67436: 2
2026-03-28 14:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7c76119-b384-5f83-aabd-ae66fb68f55b with identifier: UM67436
2026-03-28 14:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7c76119-b384-5f83-aabd-ae66fb68f55b with scrape type 2
2026-03-28 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7c76119-b384-5f83-aabd-ae66fb68f55b with scrape type 2
2026-03-28 14:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f7c76119-b384-5f83-aabd-ae66fb68f55b, identifier: UM67436
2026-03-28 14:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f7c76119-b384-5f83-aabd-ae66fb68f55b with identifier: UM67436
2026-03-28 14:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f7c76119-b384-5f83-aabd-ae66fb68f55b with identifier: UM67436
2026-03-28 14:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f7c76119-b384-5f83-aabd-ae66fb68f55b with identifier: UM67436 to the API
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:00:11Z',
 'fuel_type': 'diesel',
 'id': 'f7c76119-b384-5f83-aabd-ae66fb68f55b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM67436',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 208559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-10',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM67436%27 HTTP/1.1" 200 None
2026-03-28 14:05:51 [auto1.es] INFO: Saving data for UM67436: {'auction_closing_time': 1774882811.0, 'created_time': 1774436848.924055, 'last_price_update_time': 1774706751.874235}
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UM67436') HTTP/1.1" 204 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_c97d9e8ecb47b4a58c812a56019f2035.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_c97d9e8ecb47b4a58c812a56019f2035.jpg not downloaded yet
2026-03-28 14:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_31c11688d1ce1c9cd44de56e1ca3c81d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:52 [auto1.es] INFO: Found listing with ID: PZ10001
2026-03-28 14:05:52 [auto1.es] INFO: Found listing with ID: DB51566
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB51566%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [auto1.es] INFO: Scrape type for DB51566: 1
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6441665150>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_ccc090423d7841b66a92d4039803a670.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_ccc090423d7841b66a92d4039803a670.jpg saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17ac0978-549a-5b20-9d1d-f3052f0c8290
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a800e50>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_e50ed29fd045e4a038fc1ef587d7131c.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_e50ed29fd045e4a038fc1ef587d7131c.jpg saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17ac0978-549a-5b20-9d1d-f3052f0c8290
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9797d0>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_cc432788e6e81ce21a1dc7cfd9066c17.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_cc432788e6e81ce21a1dc7cfd9066c17.jpg saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aae5ad0>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b485adc-2451-540a-af82-13790129b8d7/1b485adc-2451-540a-af82-13790129b8d7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e853dfdc8efb8d9dd52c2440dd8f66%252Fpa%252FBX14033_20e33c19845f90720b9fe0a00fc54757.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_20e33c19845f90720b9fe0a00fc54757.jpg saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b485adc-2451-540a-af82-13790129b8d7
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_034b9ff989cf3b0a9c28e35f0fa7c76f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_034b9ff989cf3b0a9c28e35f0fa7c76f.jpg not downloaded yet
2026-03-28 14:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_1fd7fdc99840efa6b8e074811670f34c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_8ba54621c1466582cc1f80e0a2a6621a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_27186c87d3a569e115dffe9fae3eadc9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_4ac5756f8d4ec178d4fe57f51ca52be6.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:52 [auto1.es] INFO: Found listing with ID: HE30029
2026-03-28 14:05:52 [auto1.es] INFO: Found listing with ID: MG60856
2026-03-28 14:05:52 [auto1.es] INFO: Found listing with ID: FC66995
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC66995%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [auto1.es] INFO: Scrape type for FC66995: 1
2026-03-28 14:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aaf9710>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_89ca576b39776ecb226e976612263e01.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_89ca576b39776ecb226e976612263e01.jpg saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8a1790>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_a4df39bdc347be07898510b5336138e9.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_a4df39bdc347be07898510b5336138e9.jpg saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a84fa50>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_74feeabd9a494784afe2d71cb5363bb6.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_74feeabd9a494784afe2d71cb5363bb6.jpg saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b14aa6db-a6a9-51b1-b380-328edb67faa2
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a89e050>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_d2303301434e0e792b956b3922868e24.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_d2303301434e0e792b956b3922868e24.jpg saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17ac0978-549a-5b20-9d1d-f3052f0c8290
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_02055f58f601732f108f027fc00330dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_02055f58f601732f108f027fc00330dc.jpg not downloaded yet
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item b14aa6db-a6a9-51b1-b380-328edb67faa2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item b14aa6db-a6a9-51b1-b380-328edb67faa2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:52 [auto1.es] INFO: Found listing with ID: BA40352
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA40352%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [auto1.es] INFO: Scrape type for BA40352: 2
2026-03-28 14:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0294e37-9a98-597b-b5d2-4b84e182b906 with identifier: BA40352
2026-03-28 14:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0294e37-9a98-597b-b5d2-4b84e182b906 with scrape type 2
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0294e37-9a98-597b-b5d2-4b84e182b906 with scrape type 2
2026-03-28 14:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a0294e37-9a98-597b-b5d2-4b84e182b906, identifier: BA40352
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a906e90>
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_31c11688d1ce1c9cd44de56e1ca3c81d.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_31c11688d1ce1c9cd44de56e1ca3c81d.jpg saved to cache
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b14aa6db-a6a9-51b1-b380-328edb67faa2
2026-03-28 14:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_fbf860e7cccfb1e5e8212cb997214a5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a0294e37-9a98-597b-b5d2-4b84e182b906 with identifier: BA40352
2026-03-28 14:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a0294e37-9a98-597b-b5d2-4b84e182b906 with identifier: BA40352
2026-03-28 14:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a0294e37-9a98-597b-b5d2-4b84e182b906 with identifier: BA40352 to the API
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:56:14Z',
 'fuel_type': 'diesel',
 'id': 'a0294e37-9a98-597b-b5d2-4b84e182b906',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA40352',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 62279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA40352%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [auto1.es] INFO: Saving data for BA40352: {'auction_closing_time': 1774886174.0, 'created_time': 1772752962.604961, 'last_price_update_time': 1774706752.962654}
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BA40352') HTTP/1.1" 204 0
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_71e0ea96aa5ce143af8a1bf7609efa84.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_71e0ea96aa5ce143af8a1bf7609efa84.jpg not downloaded yet
2026-03-28 14:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV53496/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b46b4d0>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_1fd7fdc99840efa6b8e074811670f34c.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_1fd7fdc99840efa6b8e074811670f34c.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b14aa6db-a6a9-51b1-b380-328edb67faa2
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a822010>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_8ba54621c1466582cc1f80e0a2a6621a.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_8ba54621c1466582cc1f80e0a2a6621a.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b14aa6db-a6a9-51b1-b380-328edb67faa2
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a82ced0>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_27186c87d3a569e115dffe9fae3eadc9.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_27186c87d3a569e115dffe9fae3eadc9.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9c2a90>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_4ac5756f8d4ec178d4fe57f51ca52be6.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_4ac5756f8d4ec178d4fe57f51ca52be6.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: AF24010
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF24010%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [auto1.es] INFO: Scrape type for AF24010: 1
2026-03-28 14:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_b4a15eae1c52665569c1688885bcb455.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_535102cf93ff46d74f64c33fd0a41164.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_c97d9e8ecb47b4a58c812a56019f2035.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_7f5e90cd8449785cc0743d9f7669a8ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_0fcfadce77ef416363b8310592d155be.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_0fcfadce77ef416363b8310592d155be.jpg not downloaded yet
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: SR31558
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: GG87039
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: KB02091
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB02091%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [auto1.es] INFO: Scrape type for KB02091: 1
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV64854/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC73568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4bf010>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_fbf860e7cccfb1e5e8212cb997214a5b.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_fbf860e7cccfb1e5e8212cb997214a5b.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_664863dd5e104bf2657633adabc7bfee.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_664863dd5e104bf2657633adabc7bfee.jpg not downloaded yet
2026-03-28 14:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: MW66330
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW66330%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [auto1.es] INFO: Scrape type for MW66330: 1
2026-03-28 14:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_02055f58f601732f108f027fc00330dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_e39a9e7639fa3374413a6d5aa50ec746.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_e39a9e7639fa3374413a6d5aa50ec746.jpg not downloaded yet
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: SP11090
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: VA34349
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: TW43134
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW43134%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [auto1.es] INFO: Scrape type for TW43134: 1
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a881650>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_b4a15eae1c52665569c1688885bcb455.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_b4a15eae1c52665569c1688885bcb455.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9c9790>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_535102cf93ff46d74f64c33fd0a41164.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_535102cf93ff46d74f64c33fd0a41164.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b14aa6db-a6a9-51b1-b380-328edb67faa2
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5e17d0>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_c97d9e8ecb47b4a58c812a56019f2035.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_c97d9e8ecb47b4a58c812a56019f2035.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5c70d0>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_7f5e90cd8449785cc0743d9f7669a8ff.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_7f5e90cd8449785cc0743d9f7669a8ff.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_71e0ea96aa5ce143af8a1bf7609efa84.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_034b9ff989cf3b0a9c28e35f0fa7c76f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: AH45728
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH45728%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [auto1.es] INFO: Scrape type for AH45728: 1
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_529c1acd0bd12c1ba5e1dc7d14bc4152.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_f17b0337148803a23657940bf8fc175f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5e2010>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_02055f58f601732f108f027fc00330dc.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_02055f58f601732f108f027fc00330dc.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: CE25443
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE25443%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [auto1.es] INFO: Scrape type for CE25443: 1
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: MP79118
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP79118%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [auto1.es] INFO: Scrape type for MP79118: 1
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: JM41258
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: GU18953
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: HX86510
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: MW71818
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: YA27330
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA27330%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [auto1.es] INFO: Scrape type for YA27330: 1
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aacca90>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_71e0ea96aa5ce143af8a1bf7609efa84.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_71e0ea96aa5ce143af8a1bf7609efa84.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4d4250>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_034b9ff989cf3b0a9c28e35f0fa7c76f.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_034b9ff989cf3b0a9c28e35f0fa7c76f.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_0fcfadce77ef416363b8310592d155be.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:53 [auto1.es] INFO: Found listing with ID: SX49726
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX49726%27 HTTP/1.1" 200 None
2026-03-28 14:05:53 [auto1.es] INFO: Scrape type for SX49726: 1
2026-03-28 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_e39a9e7639fa3374413a6d5aa50ec746.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b598d90>
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fcd%252F30cdd68ff7c74de0c0cbcabc6159598b%252Fpa%252FHZ31017_529c1acd0bd12c1ba5e1dc7d14bc4152.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_529c1acd0bd12c1ba5e1dc7d14bc4152.jpg saved to cache
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88
2026-03-28 14:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f57197d-e7bc-5a95-b385-8c41ec56ce88, skipping ID generation
2026-03-28 14:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88 with scrape type 1
2026-03-28 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f57197d-e7bc-5a95-b385-8c41ec56ce88 sending to next pipeline
2026-03-28 14:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5f57197d-e7bc-5a95-b385-8c41ec56ce88, identifier: HZ31017
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5d7a90>
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F89%252F4e89cbcf94a2dbb686f40448e97ee322%252Fpa%252FFY68249_f17b0337148803a23657940bf8fc175f.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_f17b0337148803a23657940bf8fc175f.jpg saved to cache
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17ac0978-549a-5b20-9d1d-f3052f0c8290
2026-03-28 14:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17ac0978-549a-5b20-9d1d-f3052f0c8290, skipping ID generation
2026-03-28 14:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17ac0978-549a-5b20-9d1d-f3052f0c8290 with scrape type 1
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17ac0978-549a-5b20-9d1d-f3052f0c8290 sending to next pipeline
2026-03-28 14:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 17ac0978-549a-5b20-9d1d-f3052f0c8290, identifier: FY68249
2026-03-28 14:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_664863dd5e104bf2657633adabc7bfee.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:54 [auto1.es] INFO: Found listing with ID: ZD82748
2026-03-28 14:05:54 [auto1.es] INFO: Found listing with ID: DM23337
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM23337%27 HTTP/1.1" 200 None
2026-03-28 14:05:54 [auto1.es] INFO: Scrape type for DM23337: 1
2026-03-28 14:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5f57197d-e7bc-5a95-b385-8c41ec56ce88 with identifier: HZ31017
2026-03-28 14:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5f57197d-e7bc-5a95-b385-8c41ec56ce88 with identifier: HZ31017
2026-03-28 14:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5f57197d-e7bc-5a95-b385-8c41ec56ce88 with identifier: HZ31017 to the API
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_529c1acd0bd12c1ba5e1dc7d14bc4152.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:35:15Z',
 'fuel_type': 'petrol',
 'id': '5f57197d-e7bc-5a95-b385-8c41ec56ce88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ31017',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 81338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_22b5af321db96793df468769dcbd6828.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_8248964675fd6cbc7d9cd77dd071cddc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_529c1acd0bd12c1ba5e1dc7d14bc4152.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_a4df39bdc347be07898510b5336138e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_cc432788e6e81ce21a1dc7cfd9066c17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_89ca576b39776ecb226e976612263e01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_4ac5756f8d4ec178d4fe57f51ca52be6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_7f5e90cd8449785cc0743d9f7669a8ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f57197d-e7bc-5a95-b385-8c41ec56ce88/5f57197d-e7bc-5a95-b385-8c41ec56ce88_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/cd/30cdd68ff7c74de0c0cbcabc6159598b/pa/HZ31017_fbf860e7cccfb1e5e8212cb997214a5b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2019}
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ31017%27 HTTP/1.1" 200 None
2026-03-28 14:05:54 [auto1.es] INFO: Saving data for HZ31017: {'created_time': 1774706754.614668, 'last_price_update_time': 1774706754.614677, 'auction_closing_time': 1774884915.0}
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HZ31017') HTTP/1.1" 204 0
2026-03-28 14:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 17ac0978-549a-5b20-9d1d-f3052f0c8290 with identifier: FY68249
2026-03-28 14:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 17ac0978-549a-5b20-9d1d-f3052f0c8290 with identifier: FY68249
2026-03-28 14:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 17ac0978-549a-5b20-9d1d-f3052f0c8290 with identifier: FY68249 to the API
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_f17b0337148803a23657940bf8fc175f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.9L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:58:05Z',
 'fuel_type': 'diesel',
 'id': '17ac0978-549a-5b20-9d1d-f3052f0c8290',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY68249',
 'listing': 'auction',
 'location': 'ES, San Juan de Aznalfarache, Sevilla',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_40235558f7f788a278fe0748d4445012.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_e040e9a97756fa65fa2c6aef8a9abf36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_e0be6b5c3f7ca069b946acfa3a4ffd86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_a206e1baa510b8b94490b647f3870dbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_f7d6f5b2a7231cacfb0157f3d2ffd030.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_f17b0337148803a23657940bf8fc175f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_ccc090423d7841b66a92d4039803a670.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_d2303301434e0e792b956b3922868e24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ac0978-549a-5b20-9d1d-f3052f0c8290/17ac0978-549a-5b20-9d1d-f3052f0c8290_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/89/4e89cbcf94a2dbb686f40448e97ee322/pa/FY68249_e50ed29fd045e4a038fc1ef587d7131c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 3.0d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY68249%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [auto1.es] INFO: Saving data for FY68249: {'created_time': 1774706755.10209, 'last_price_update_time': 1774706755.102099, 'auction_closing_time': 1774886285.0}
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FY68249') HTTP/1.1" 204 0
2026-03-28 14:05:55 [auto1.es] INFO: Found listing with ID: ZJ73246
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ73246%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [auto1.es] INFO: Scrape type for ZJ73246: 1
2026-03-28 14:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV53496> (referer: https://www.auto1.com/v1/car-details-view/ZV53496/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC66995/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY48827/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a984450>
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_0fcfadce77ef416363b8310592d155be.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_0fcfadce77ef416363b8310592d155be.jpg saved to cache
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b46a710>
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_e39a9e7639fa3374413a6d5aa50ec746.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_e39a9e7639fa3374413a6d5aa50ec746.jpg saved to cache
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e
2026-03-28 14:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD78517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ95264/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:55 [auto1.es] INFO: Found listing with ID: EA73564
2026-03-28 14:05:55 [auto1.es] INFO: Found listing with ID: ZM37535
2026-03-28 14:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4cf090>
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Ff6%252Faaf6b8a42c145b3a0c95dcd7c82a9ce4%252Fpa%252FPL39404_664863dd5e104bf2657633adabc7bfee.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_664863dd5e104bf2657633adabc7bfee.jpg saved to cache
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e
2026-03-28 14:05:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e, skipping ID generation
2026-03-28 14:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e with scrape type 1
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e sending to next pipeline
2026-03-28 14:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e, identifier: PL39404
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 1b485adc-2451-540a-af82-13790129b8d7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e with identifier: PL39404
2026-03-28 14:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e with identifier: PL39404
2026-03-28 14:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8f6dc4f5-ea9c-5da2-b231-57004a6ee66e with identifier: PL39404 to the API
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_664863dd5e104bf2657633adabc7bfee.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:51:50Z',
 'fuel_type': 'petrol',
 'id': '8f6dc4f5-ea9c-5da2-b231-57004a6ee66e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL39404',
 'listing': 'auction',
 'location': 'ES, Viladecans,Barcelona',
 'make': 'Mazda',
 'model': '3',
 'odometer': 208821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_b4a15eae1c52665569c1688885bcb455.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_27186c87d3a569e115dffe9fae3eadc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_c97d9e8ecb47b4a58c812a56019f2035.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_034b9ff989cf3b0a9c28e35f0fa7c76f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_02055f58f601732f108f027fc00330dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_71e0ea96aa5ce143af8a1bf7609efa84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_0fcfadce77ef416363b8310592d155be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_664863dd5e104bf2657633adabc7bfee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6dc4f5-ea9c-5da2-b231-57004a6ee66e/8f6dc4f5-ea9c-5da2-b231-57004a6ee66e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf6b8a42c145b3a0c95dcd7c82a9ce4/pa/PL39404_e39a9e7639fa3374413a6d5aa50ec746.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 1.6 VVT Active+',
 'transmission': 'manual',
 'trim': 'VVT Active+',
 'year': 2006}
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL39404%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [auto1.es] INFO: Saving data for PL39404: {'created_time': 1774706755.777643, 'last_price_update_time': 1774706755.777652, 'auction_closing_time': 1774885910.0}
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PL39404') HTTP/1.1" 204 0
2026-03-28 14:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53e2b045-f68f-5fe4-8689-10549b8f0546 with identifier: ZV53496
2026-03-28 14:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53e2b045-f68f-5fe4-8689-10549b8f0546 with scrape type 1
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53e2b045-f68f-5fe4-8689-10549b8f0546
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_e4e302eee199d83b7920d24c83f9eaac.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_e4e302eee199d83b7920d24c83f9eaac.jpg not downloaded yet
2026-03-28 14:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_606262f9ae2044229fd419f60bfeb1aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_606262f9ae2044229fd419f60bfeb1aa.jpg not downloaded yet
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_921090c7aaf716dba808435fc4c4f396.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_921090c7aaf716dba808435fc4c4f396.jpg not downloaded yet
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_467269771282a5c86d17fd99dc404a85.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_467269771282a5c86d17fd99dc404a85.jpg not downloaded yet
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_09ecea910c3dd3611790fe806fb1de2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_09ecea910c3dd3611790fe806fb1de2c.jpg not downloaded yet
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_c90718d2a73eaa8cb10b1c430fc24337.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_c90718d2a73eaa8cb10b1c430fc24337.jpg not downloaded yet
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_b0524fef9cfd2b3c5b2c8797ca6bfa93.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_b0524fef9cfd2b3c5b2c8797ca6bfa93.jpg not downloaded yet
2026-03-28 14:05:56 [auto1.es] INFO: Channel: 24h | Page: 3 | totalHits: 2696 | hits on page: 40
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_a09a797ba273e78c7714eb69a0191707.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_a09a797ba273e78c7714eb69a0191707.jpg not downloaded yet
2026-03-28 14:05:56 [auto1.es] INFO: Found listing with ID: PE94683
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE94683%27 HTTP/1.1" 200 None
2026-03-28 14:05:56 [auto1.es] INFO: Scrape type for PE94683: 1
2026-03-28 14:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_241fbbfbc1a29310e94e0d81430d8d23.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_bb307ba36d85fd8585ff507156110d8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_bb307ba36d85fd8585ff507156110d8a.jpg not downloaded yet
2026-03-28 14:05:56 [auto1.es] INFO: Found listing with ID: UD02034
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD02034%27 HTTP/1.1" 200 None
2026-03-28 14:05:56 [auto1.es] INFO: Scrape type for UD02034: 1
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_b32d92a542306fd8af1849a115d99bf1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_b32d92a542306fd8af1849a115d99bf1.jpg not downloaded yet
2026-03-28 14:05:56 [auto1.es] INFO: Found listing with ID: FK96312
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK96312%27 HTTP/1.1" 200 None
2026-03-28 14:05:56 [auto1.es] INFO: Scrape type for FK96312: 1
2026-03-28 14:05:56 [auto1.es] INFO: Found listing with ID: SL01045
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL01045%27 HTTP/1.1" 200 None
2026-03-28 14:05:56 [auto1.es] INFO: Scrape type for SL01045: 1
2026-03-28 14:05:56 [auto1.es] INFO: Found listing with ID: WA68428
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA68428%27 HTTP/1.1" 200 None
2026-03-28 14:05:56 [auto1.es] INFO: Scrape type for WA68428: 1
2026-03-28 14:05:56 [auto1.es] INFO: Found listing with ID: DK05159
2026-03-28 14:05:56 [auto1.es] INFO: Found listing with ID: VJ61216
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ61216%27 HTTP/1.1" 200 None
2026-03-28 14:05:56 [auto1.es] INFO: Scrape type for VJ61216: 2
2026-03-28 14:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f634a76d-a1eb-5240-916d-c3f15d849042 with identifier: VJ61216
2026-03-28 14:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f634a76d-a1eb-5240-916d-c3f15d849042 with scrape type 2
2026-03-28 14:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f634a76d-a1eb-5240-916d-c3f15d849042 with scrape type 2
2026-03-28 14:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f634a76d-a1eb-5240-916d-c3f15d849042, identifier: VJ61216
2026-03-28 14:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f634a76d-a1eb-5240-916d-c3f15d849042 with identifier: VJ61216
2026-03-28 14:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f634a76d-a1eb-5240-916d-c3f15d849042 with identifier: VJ61216
2026-03-28 14:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f634a76d-a1eb-5240-916d-c3f15d849042 with identifier: VJ61216 to the API
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:10:32Z',
 'fuel_type': 'diesel',
 'id': 'f634a76d-a1eb-5240-916d-c3f15d849042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ61216',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLE-Klasse',
 'odometer': 20862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-25',
 'seller_name': None,
 'title': 'Mercedes-Benz CLE-Klasse CLE 220 d Mild-Hybrid AMG Line Premium '
          'Plus',
 'transmission': 'automatic',
 'trim': 'AMG Line Premium Plus',
 'year': 2024}
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ61216%27 HTTP/1.1" 200 None
2026-03-28 14:05:56 [auto1.es] INFO: Saving data for VJ61216: {'auction_closing_time': 1774883432.0, 'created_time': 1772753550.374021, 'last_price_update_time': 1774706756.956277}
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VJ61216') HTTP/1.1" 204 0
2026-03-28 14:05:56 [auto1.es] INFO: Found listing with ID: KX75561
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX75561%27 HTTP/1.1" 200 None
2026-03-28 14:05:56 [auto1.es] INFO: Scrape type for KX75561: 1
2026-03-28 14:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a80c910>
2026-03-28 14:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fb7%252Ff9b7180d62916a36eafdf50922836fbb%252Fpa%252FKC96149_241fbbfbc1a29310e94e0d81430d8d23.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_241fbbfbc1a29310e94e0d81430d8d23.jpg saved to cache
2026-03-28 14:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b14aa6db-a6a9-51b1-b380-328edb67faa2
2026-03-28 14:05:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b14aa6db-a6a9-51b1-b380-328edb67faa2, skipping ID generation
2026-03-28 14:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b14aa6db-a6a9-51b1-b380-328edb67faa2 with scrape type 1
2026-03-28 14:05:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b14aa6db-a6a9-51b1-b380-328edb67faa2 sending to next pipeline
2026-03-28 14:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b14aa6db-a6a9-51b1-b380-328edb67faa2, identifier: KC96149
2026-03-28 14:05:57 [auto1.es] INFO: Found listing with ID: ZE38757
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE38757%27 HTTP/1.1" 200 None
2026-03-28 14:05:57 [auto1.es] INFO: Scrape type for ZE38757: 1
2026-03-28 14:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW43134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB02091/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW66330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA27330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE25443/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b14aa6db-a6a9-51b1-b380-328edb67faa2 with identifier: KC96149
2026-03-28 14:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b14aa6db-a6a9-51b1-b380-328edb67faa2 with identifier: KC96149
2026-03-28 14:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b14aa6db-a6a9-51b1-b380-328edb67faa2 with identifier: KC96149 to the API
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_241fbbfbc1a29310e94e0d81430d8d23.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:47:22Z',
 'fuel_type': 'diesel',
 'id': 'b14aa6db-a6a9-51b1-b380-328edb67faa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC96149',
 'listing': 'auction',
 'location': 'ES, Pamplona',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 221540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_91d80a2285c70b86329702b511ebf6f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_3782ef621f0f5298f687293d435eca55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_241fbbfbc1a29310e94e0d81430d8d23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_1fd7fdc99840efa6b8e074811670f34c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_31c11688d1ce1c9cd44de56e1ca3c81d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_74feeabd9a494784afe2d71cb5363bb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_8ba54621c1466582cc1f80e0a2a6621a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b14aa6db-a6a9-51b1-b380-328edb67faa2/b14aa6db-a6a9-51b1-b380-328edb67faa2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/b7/f9b7180d62916a36eafdf50922836fbb/pa/KC96149_535102cf93ff46d74f64c33fd0a41164.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 2.5 TDI R5 +Motion',
 'transmission': 'automatic',
 'trim': 'R5 +Motion',
 'year': 2007}
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC96149%27 HTTP/1.1" 200 None
2026-03-28 14:05:57 [auto1.es] INFO: Saving data for KC96149: {'created_time': 1774706757.543714, 'last_price_update_time': 1774706757.543723, 'auction_closing_time': 1774885642.0}
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KC96149') HTTP/1.1" 204 0
2026-03-28 14:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:57 [auto1.es] INFO: Found listing with ID: HX37636
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX37636%27 HTTP/1.1" 200 None
2026-03-28 14:05:57 [auto1.es] INFO: Scrape type for HX37636: 1
2026-03-28 14:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB51566/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:57 [auto1.es] INFO: Found listing with ID: GW51820
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW51820%27 HTTP/1.1" 200 None
2026-03-28 14:05:57 [auto1.es] INFO: Scrape type for GW51820: 2
2026-03-28 14:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c22fd51-6db5-5601-ade8-278ed11331bc with identifier: GW51820
2026-03-28 14:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c22fd51-6db5-5601-ade8-278ed11331bc with scrape type 2
2026-03-28 14:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c22fd51-6db5-5601-ade8-278ed11331bc with scrape type 2
2026-03-28 14:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9c22fd51-6db5-5601-ade8-278ed11331bc, identifier: GW51820
2026-03-28 14:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9c22fd51-6db5-5601-ade8-278ed11331bc with identifier: GW51820
2026-03-28 14:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9c22fd51-6db5-5601-ade8-278ed11331bc with identifier: GW51820
2026-03-28 14:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9c22fd51-6db5-5601-ade8-278ed11331bc with identifier: GW51820 to the API
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:02Z',
 'fuel_type': 'petrol',
 'id': '9c22fd51-6db5-5601-ade8-278ed11331bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW51820',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 249109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-28',
 'seller_name': None,
 'title': 'Audi A4 1.4 TFSI ACT Advanced edition',
 'transmission': 'manual',
 'trim': 'Advanced edition',
 'year': 2016}
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW51820%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Saving data for GW51820: {'auction_closing_time': 1774885142.0, 'created_time': 1774002392.310307, 'last_price_update_time': 1774706758.104904}
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GW51820') HTTP/1.1" 204 0
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: BT71977
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: TH94228
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH94228%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for TH94228: 1
2026-03-28 14:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_b32d92a542306fd8af1849a115d99bf1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: JK26154
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: EA32126
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: JE13816
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE13816%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for JE13816: 1
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: XP47447
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: YV42226
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV42226%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for YV42226: 1
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: GU66337
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU66337%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for GU66337: 1
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: NG71405
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG71405%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for NG71405: 1
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: CC89526
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: MY23078
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: PN58754
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: XM15498
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM15498%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for XM15498: 1
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: XL95591
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: DA49671
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA49671%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for DA49671: 1
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: GH57787
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH57787%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for GH57787: 1
2026-03-28 14:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa801d0>
2026-03-28 14:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_b32d92a542306fd8af1849a115d99bf1.jpg') HTTP/1.1" 204 0
2026-03-28 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_b32d92a542306fd8af1849a115d99bf1.jpg saved to cache
2026-03-28 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53e2b045-f68f-5fe4-8689-10549b8f0546
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: KC85026
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: BX27064
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX27064%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for BX27064: 1
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: AT82365
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: WK81773
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK81773%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for WK81773: 1
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: TS39016
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: TT65809
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: EH49664
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: EB66589
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB66589%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for EB66589: 1
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: PA52283
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: PG75974
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG75974%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for PG75974: 1
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: BE72749
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: ZK42012
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK42012%27 HTTP/1.1" 200 None
2026-03-28 14:05:58 [auto1.es] INFO: Scrape type for ZK42012: 1
2026-03-28 14:05:58 [auto1.es] INFO: Found listing with ID: PS53569
2026-03-28 14:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC73568> (referer: https://www.auto1.com/v1/car-details-view/UC73568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH45728/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f09326a8-60ff-5c6a-87da-581fc4029789 with identifier: UC73568
2026-03-28 14:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f09326a8-60ff-5c6a-87da-581fc4029789 with scrape type 1
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f09326a8-60ff-5c6a-87da-581fc4029789
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa0%252F6ca09b8b10344ad41b96be558ec44020%252Fpa%252FUC73568_8dd7fc8d71ceb90541a175c8e87fa938.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_8dd7fc8d71ceb90541a175c8e87fa938.jpg already downloaded
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa0%252F6ca09b8b10344ad41b96be558ec44020%252Fpa%252FUC73568_010b226af2b295a7870e6c80b11a163a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_010b226af2b295a7870e6c80b11a163a.jpg already downloaded
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa0%252F6ca09b8b10344ad41b96be558ec44020%252Fpa%252FUC73568_3cd662a645319f666172abf811dcee8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_3cd662a645319f666172abf811dcee8b.jpg already downloaded
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa0%252F6ca09b8b10344ad41b96be558ec44020%252Fpa%252FUC73568_a2d5c0f018325b0c038f1b951262bd78.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_a2d5c0f018325b0c038f1b951262bd78.jpg already downloaded
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa0%252F6ca09b8b10344ad41b96be558ec44020%252Fpa%252FUC73568_44459a7e9fe3b1961209980e524efc86.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_44459a7e9fe3b1961209980e524efc86.jpg already downloaded
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa0%252F6ca09b8b10344ad41b96be558ec44020%252Fpa%252FUC73568_57a551b855532787fd647fbd18643041.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_57a551b855532787fd647fbd18643041.jpg already downloaded
2026-03-28 14:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f09326a8-60ff-5c6a-87da-581fc4029789, identifier: UC73568
2026-03-28 14:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f09326a8-60ff-5c6a-87da-581fc4029789 with identifier: UC73568
2026-03-28 14:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f09326a8-60ff-5c6a-87da-581fc4029789 with identifier: UC73568
2026-03-28 14:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f09326a8-60ff-5c6a-87da-581fc4029789 with identifier: UC73568 to the API
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UC73568>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.7L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:43:22Z',
 'fuel_type': 'diesel',
 'id': 'f09326a8-60ff-5c6a-87da-581fc4029789',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC73568',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Ssangyong',
 'model': 'Rodius',
 'odometer': 159905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_8dd7fc8d71ceb90541a175c8e87fa938.jpg',
                'https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_010b226af2b295a7870e6c80b11a163a.jpg',
                'https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_3cd662a645319f666172abf811dcee8b.jpg',
                'https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_a2d5c0f018325b0c038f1b951262bd78.jpg',
                'https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_44459a7e9fe3b1961209980e524efc86.jpg',
                'https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_57a551b855532787fd647fbd18643041.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09326a8-60ff-5c6a-87da-581fc4029789/f09326a8-60ff-5c6a-87da-581fc4029789_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_8dd7fc8d71ceb90541a175c8e87fa938.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09326a8-60ff-5c6a-87da-581fc4029789/f09326a8-60ff-5c6a-87da-581fc4029789_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_010b226af2b295a7870e6c80b11a163a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09326a8-60ff-5c6a-87da-581fc4029789/f09326a8-60ff-5c6a-87da-581fc4029789_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_3cd662a645319f666172abf811dcee8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09326a8-60ff-5c6a-87da-581fc4029789/f09326a8-60ff-5c6a-87da-581fc4029789_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_a2d5c0f018325b0c038f1b951262bd78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09326a8-60ff-5c6a-87da-581fc4029789/f09326a8-60ff-5c6a-87da-581fc4029789_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_44459a7e9fe3b1961209980e524efc86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09326a8-60ff-5c6a-87da-581fc4029789/f09326a8-60ff-5c6a-87da-581fc4029789_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a0/6ca09b8b10344ad41b96be558ec44020/pa/UC73568_57a551b855532787fd647fbd18643041.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-06-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ssangyong Rodius 270 Xdi 4WD',
 'transmission': 'manual',
 'trim': '4WD',
 'year': 2005}
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC73568%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [auto1.es] INFO: Saving data for UC73568: {'created_time': 1774706759.733634, 'last_price_update_time': 1774706759.733644, 'auction_closing_time': 1774885402.0}
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UC73568') HTTP/1.1" 204 0
2026-03-28 14:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV64854> (referer: https://www.auto1.com/v1/car-details-view/GV64854/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ73246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM23337/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP79118/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f524ad3-88c0-55a4-92d1-abf5d9ed375d with identifier: GV64854
2026-03-28 14:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f524ad3-88c0-55a4-92d1-abf5d9ed375d with scrape type 1
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1f524ad3-88c0-55a4-92d1-abf5d9ed375d
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fdf%252F98df9871469f20aba5357b8b6df35c60%252Fpa%252FGV64854_c4994d80450ca398d07e131e3e7f0934.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_c4994d80450ca398d07e131e3e7f0934.jpg not downloaded yet
2026-03-28 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fdf%252F98df9871469f20aba5357b8b6df35c60%252Fpa%252FGV64854_d49566919138759fed7085102d13be54.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_d49566919138759fed7085102d13be54.jpg not downloaded yet
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fdf%252F98df9871469f20aba5357b8b6df35c60%252Fpa%252FGV64854_dcc4b642456f9c8df6e289ea2dbf4287.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_dcc4b642456f9c8df6e289ea2dbf4287.jpg not downloaded yet
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fdf%252F98df9871469f20aba5357b8b6df35c60%252Fpa%252FGV64854_1ef54458e17fe002124ee762c4341ade.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_1ef54458e17fe002124ee762c4341ade.jpg not downloaded yet
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fdf%252F98df9871469f20aba5357b8b6df35c60%252Fpa%252FGV64854_32c77bbf2d2fe52261ddc0f7d387fee0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_32c77bbf2d2fe52261ddc0f7d387fee0.jpg not downloaded yet
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fdf%252F98df9871469f20aba5357b8b6df35c60%252Fpa%252FGV64854_605330ae5a251dce2b160f2e6d7757d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_605330ae5a251dce2b160f2e6d7757d5.jpg not downloaded yet
2026-03-28 14:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL01045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX49726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN77625> (referer: https://www.auto1.com/v1/car-details-view/CN77625/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE94683/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50cb91a4-27f3-5026-a2e7-78b4a682f37b with identifier: CN77625
2026-03-28 14:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50cb91a4-27f3-5026-a2e7-78b4a682f37b with scrape type 1
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 50cb91a4-27f3-5026-a2e7-78b4a682f37b
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F63%252F59633156b5b69b6a8042551cfc74b3ec%252Fpa%252FCN77625_ffaa085e1f7988f21558827617c94689.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_ffaa085e1f7988f21558827617c94689.jpg already downloaded
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F63%252F59633156b5b69b6a8042551cfc74b3ec%252Fpa%252FCN77625_6b045a4dd69b03a6b566b0301e8cb8e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_6b045a4dd69b03a6b566b0301e8cb8e6.jpg already downloaded
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F63%252F59633156b5b69b6a8042551cfc74b3ec%252Fpa%252FCN77625_62f4598aba1201f3316f1978cf129755.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_62f4598aba1201f3316f1978cf129755.jpg already downloaded
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F63%252F59633156b5b69b6a8042551cfc74b3ec%252Fpa%252FCN77625_c486c6856eb88f23e59eac81e57eaeaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_c486c6856eb88f23e59eac81e57eaeaa.jpg already downloaded
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F63%252F59633156b5b69b6a8042551cfc74b3ec%252Fpa%252FCN77625_47afc895779f685830916f51c7f2ec50.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_47afc895779f685830916f51c7f2ec50.jpg already downloaded
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F63%252F59633156b5b69b6a8042551cfc74b3ec%252Fpa%252FCN77625_6bb503bad55731d671dd2bdbcedefa12.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_6bb503bad55731d671dd2bdbcedefa12.jpg already downloaded
2026-03-28 14:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50cb91a4-27f3-5026-a2e7-78b4a682f37b, identifier: CN77625
2026-03-28 14:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50cb91a4-27f3-5026-a2e7-78b4a682f37b with identifier: CN77625
2026-03-28 14:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50cb91a4-27f3-5026-a2e7-78b4a682f37b with identifier: CN77625
2026-03-28 14:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 50cb91a4-27f3-5026-a2e7-78b4a682f37b with identifier: CN77625 to the API
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN77625>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:46Z',
 'fuel_type': 'diesel',
 'id': '50cb91a4-27f3-5026-a2e7-78b4a682f37b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN77625',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 195027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_ffaa085e1f7988f21558827617c94689.jpg',
                'https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_6b045a4dd69b03a6b566b0301e8cb8e6.jpg',
                'https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_62f4598aba1201f3316f1978cf129755.jpg',
                'https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_c486c6856eb88f23e59eac81e57eaeaa.jpg',
                'https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_47afc895779f685830916f51c7f2ec50.jpg',
                'https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_6bb503bad55731d671dd2bdbcedefa12.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cb91a4-27f3-5026-a2e7-78b4a682f37b/50cb91a4-27f3-5026-a2e7-78b4a682f37b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_ffaa085e1f7988f21558827617c94689.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cb91a4-27f3-5026-a2e7-78b4a682f37b/50cb91a4-27f3-5026-a2e7-78b4a682f37b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_6b045a4dd69b03a6b566b0301e8cb8e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cb91a4-27f3-5026-a2e7-78b4a682f37b/50cb91a4-27f3-5026-a2e7-78b4a682f37b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_62f4598aba1201f3316f1978cf129755.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cb91a4-27f3-5026-a2e7-78b4a682f37b/50cb91a4-27f3-5026-a2e7-78b4a682f37b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_c486c6856eb88f23e59eac81e57eaeaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cb91a4-27f3-5026-a2e7-78b4a682f37b/50cb91a4-27f3-5026-a2e7-78b4a682f37b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_47afc895779f685830916f51c7f2ec50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cb91a4-27f3-5026-a2e7-78b4a682f37b/50cb91a4-27f3-5026-a2e7-78b4a682f37b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/63/59633156b5b69b6a8042551cfc74b3ec/pa/CN77625_6bb503bad55731d671dd2bdbcedefa12.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 HDi Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2011}
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN77625%27 HTTP/1.1" 200 None
2026-03-28 14:06:01 [auto1.es] INFO: Saving data for CN77625: {'created_time': 1774706761.38782, 'last_price_update_time': 1774706761.387828, 'auction_closing_time': 1774883266.0}
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CN77625') HTTP/1.1" 204 0
2026-03-28 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_32c77bbf2d2fe52261ddc0f7d387fee0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_605330ae5a251dce2b160f2e6d7757d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_1ef54458e17fe002124ee762c4341ade.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF24010/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK96312/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX75561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA68428/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a958190>
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f524ad3-88c0-55a4-92d1-abf5d9ed375d/1f524ad3-88c0-55a4-92d1-abf5d9ed375d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fdf%252F98df9871469f20aba5357b8b6df35c60%252Fpa%252FGV64854_32c77bbf2d2fe52261ddc0f7d387fee0.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_32c77bbf2d2fe52261ddc0f7d387fee0.jpg saved to cache
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f524ad3-88c0-55a4-92d1-abf5d9ed375d
2026-03-28 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_c4994d80450ca398d07e131e3e7f0934.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3aa950>
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f524ad3-88c0-55a4-92d1-abf5d9ed375d/1f524ad3-88c0-55a4-92d1-abf5d9ed375d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fdf%252F98df9871469f20aba5357b8b6df35c60%252Fpa%252FGV64854_605330ae5a251dce2b160f2e6d7757d5.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_605330ae5a251dce2b160f2e6d7757d5.jpg saved to cache
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f524ad3-88c0-55a4-92d1-abf5d9ed375d
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8322d0>
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f524ad3-88c0-55a4-92d1-abf5d9ed375d/1f524ad3-88c0-55a4-92d1-abf5d9ed375d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fdf%252F98df9871469f20aba5357b8b6df35c60%252Fpa%252FGV64854_1ef54458e17fe002124ee762c4341ade.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_1ef54458e17fe002124ee762c4341ade.jpg saved to cache
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f524ad3-88c0-55a4-92d1-abf5d9ed375d
2026-03-28 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_dcc4b642456f9c8df6e289ea2dbf4287.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_d49566919138759fed7085102d13be54.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a957dd0>
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f524ad3-88c0-55a4-92d1-abf5d9ed375d/1f524ad3-88c0-55a4-92d1-abf5d9ed375d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fdf%252F98df9871469f20aba5357b8b6df35c60%252Fpa%252FGV64854_c4994d80450ca398d07e131e3e7f0934.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_c4994d80450ca398d07e131e3e7f0934.jpg saved to cache
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f524ad3-88c0-55a4-92d1-abf5d9ed375d
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5e00d0>
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f524ad3-88c0-55a4-92d1-abf5d9ed375d/1f524ad3-88c0-55a4-92d1-abf5d9ed375d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fdf%252F98df9871469f20aba5357b8b6df35c60%252Fpa%252FGV64854_dcc4b642456f9c8df6e289ea2dbf4287.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_dcc4b642456f9c8df6e289ea2dbf4287.jpg saved to cache
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f524ad3-88c0-55a4-92d1-abf5d9ed375d
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a907490>
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f524ad3-88c0-55a4-92d1-abf5d9ed375d/1f524ad3-88c0-55a4-92d1-abf5d9ed375d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fdf%252F98df9871469f20aba5357b8b6df35c60%252Fpa%252FGV64854_d49566919138759fed7085102d13be54.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_d49566919138759fed7085102d13be54.jpg saved to cache
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f524ad3-88c0-55a4-92d1-abf5d9ed375d
2026-03-28 14:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f524ad3-88c0-55a4-92d1-abf5d9ed375d, skipping ID generation
2026-03-28 14:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f524ad3-88c0-55a4-92d1-abf5d9ed375d with scrape type 1
2026-03-28 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f524ad3-88c0-55a4-92d1-abf5d9ed375d sending to next pipeline
2026-03-28 14:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f524ad3-88c0-55a4-92d1-abf5d9ed375d, identifier: GV64854
2026-03-28 14:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f524ad3-88c0-55a4-92d1-abf5d9ed375d with identifier: GV64854
2026-03-28 14:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f524ad3-88c0-55a4-92d1-abf5d9ed375d with identifier: GV64854
2026-03-28 14:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1f524ad3-88c0-55a4-92d1-abf5d9ed375d with identifier: GV64854 to the API
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_d49566919138759fed7085102d13be54.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:25:39Z',
 'fuel_type': 'diesel',
 'id': '1f524ad3-88c0-55a4-92d1-abf5d9ed375d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV64854',
 'listing': 'auction',
 'location': 'ES, Girona',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 118115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f524ad3-88c0-55a4-92d1-abf5d9ed375d/1f524ad3-88c0-55a4-92d1-abf5d9ed375d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_c4994d80450ca398d07e131e3e7f0934.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f524ad3-88c0-55a4-92d1-abf5d9ed375d/1f524ad3-88c0-55a4-92d1-abf5d9ed375d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_d49566919138759fed7085102d13be54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f524ad3-88c0-55a4-92d1-abf5d9ed375d/1f524ad3-88c0-55a4-92d1-abf5d9ed375d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_dcc4b642456f9c8df6e289ea2dbf4287.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f524ad3-88c0-55a4-92d1-abf5d9ed375d/1f524ad3-88c0-55a4-92d1-abf5d9ed375d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_1ef54458e17fe002124ee762c4341ade.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f524ad3-88c0-55a4-92d1-abf5d9ed375d/1f524ad3-88c0-55a4-92d1-abf5d9ed375d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_32c77bbf2d2fe52261ddc0f7d387fee0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f524ad3-88c0-55a4-92d1-abf5d9ed375d/1f524ad3-88c0-55a4-92d1-abf5d9ed375d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/df/98df9871469f20aba5357b8b6df35c60/pa/GV64854_605330ae5a251dce2b160f2e6d7757d5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2005}
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV64854%27 HTTP/1.1" 200 None
2026-03-28 14:06:02 [auto1.es] INFO: Saving data for GV64854: {'created_time': 1774706762.367127, 'last_price_update_time': 1774706762.367138, 'auction_closing_time': 1774884339.0}
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GV64854') HTTP/1.1" 204 0
2026-03-28 14:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX27064/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK42012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX37636/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG75974/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH94228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH57787/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK81773/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB66589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM23337> (referer: https://www.auto1.com/v1/car-details-view/DM23337/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73793c72-1acd-5751-ae54-5a311a6628de with identifier: DM23337
2026-03-28 14:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73793c72-1acd-5751-ae54-5a311a6628de with scrape type 1
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 73793c72-1acd-5751-ae54-5a311a6628de
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff8%252Fc5f8c6c1084d6dca240d9b761ec7f2fe%252Fpa%252FDM23337_89f38ae17962b4637f9d5f20b4a782f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_89f38ae17962b4637f9d5f20b4a782f9.jpg not downloaded yet
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff8%252Fc5f8c6c1084d6dca240d9b761ec7f2fe%252Fpa%252FDM23337_4f6269988b5fa58d7bafb26160411b1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_4f6269988b5fa58d7bafb26160411b1d.jpg not downloaded yet
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff8%252Fc5f8c6c1084d6dca240d9b761ec7f2fe%252Fpa%252FDM23337_5b0518334dbaccc38c70dc64337e4300.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_5b0518334dbaccc38c70dc64337e4300.jpg not downloaded yet
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff8%252Fc5f8c6c1084d6dca240d9b761ec7f2fe%252Fpa%252FDM23337_d548bb1ebfb67547618f138c2c0a5474.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_d548bb1ebfb67547618f138c2c0a5474.jpg not downloaded yet
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff8%252Fc5f8c6c1084d6dca240d9b761ec7f2fe%252Fpa%252FDM23337_7052b5100d9ad62980f6ba118dd79818.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_7052b5100d9ad62980f6ba118dd79818.jpg not downloaded yet
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff8%252Fc5f8c6c1084d6dca240d9b761ec7f2fe%252Fpa%252FDM23337_4cdf35a2e3d16ebf3722559dc58d39a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_4cdf35a2e3d16ebf3722559dc58d39a4.jpg not downloaded yet
2026-03-28 14:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA68428> (referer: https://www.auto1.com/v1/car-details-view/WA68428/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ73246> (referer: https://www.auto1.com/v1/car-details-view/ZJ73246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE94683> (referer: https://www.auto1.com/v1/car-details-view/PE94683/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_4cdf35a2e3d16ebf3722559dc58d39a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_7052b5100d9ad62980f6ba118dd79818.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ece4fdf-4d75-58e2-a851-c05372824479 with identifier: WA68428
2026-03-28 14:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ece4fdf-4d75-58e2-a851-c05372824479 with scrape type 1
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ece4fdf-4d75-58e2-a851-c05372824479
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_3c77cef6e787544c0745c2e78cf969f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_3c77cef6e787544c0745c2e78cf969f7.jpg not downloaded yet
2026-03-28 14:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_d548bb1ebfb67547618f138c2c0a5474.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_33e5bc7ee75f90a2710f05800d24bbac.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_33e5bc7ee75f90a2710f05800d24bbac.jpg not downloaded yet
2026-03-28 14:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da269d41-96d1-56e1-8ef3-f7befbf94261 with identifier: ZJ73246
2026-03-28 14:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da269d41-96d1-56e1-8ef3-f7befbf94261 with scrape type 1
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da269d41-96d1-56e1-8ef3-f7befbf94261
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_1f4f9f81aa282e532c5d9933f1206e80.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_1f4f9f81aa282e532c5d9933f1206e80.jpg not downloaded yet
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_da079c52ebbd55e2eba33c088a338bc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_da079c52ebbd55e2eba33c088a338bc0.jpg not downloaded yet
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_f5af98e90cd796a8eb9bd50519e0e920.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_f5af98e90cd796a8eb9bd50519e0e920.jpg not downloaded yet
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_04bf37d66fc89aaec7831996c1930de3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_04bf37d66fc89aaec7831996c1930de3.jpg not downloaded yet
2026-03-28 14:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9a2cc76-0197-597d-89d7-e3293c90a2dc with identifier: PE94683
2026-03-28 14:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9a2cc76-0197-597d-89d7-e3293c90a2dc with scrape type 1
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9a2cc76-0197-597d-89d7-e3293c90a2dc
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F70%252F6670c36c7454edf742e8408f1d045152%252Fpa%252FPE94683_7f066352823156d879f131b44e9f6e86.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_7f066352823156d879f131b44e9f6e86.jpg already downloaded
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F70%252F6670c36c7454edf742e8408f1d045152%252Fpa%252FPE94683_1fbe8d16494029e20c0974d34238bcda.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_1fbe8d16494029e20c0974d34238bcda.jpg already downloaded
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F70%252F6670c36c7454edf742e8408f1d045152%252Fpa%252FPE94683_23b5584fb57e769acfc5f29457f7f9a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_23b5584fb57e769acfc5f29457f7f9a9.jpg already downloaded
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F70%252F6670c36c7454edf742e8408f1d045152%252Fpa%252FPE94683_6348ec9728086acf5af40db3c01af787.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_6348ec9728086acf5af40db3c01af787.jpg already downloaded
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F70%252F6670c36c7454edf742e8408f1d045152%252Fpa%252FPE94683_8a1bb0e5426d78b2daae06e2041fe8ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_8a1bb0e5426d78b2daae06e2041fe8ed.jpg already downloaded
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F70%252F6670c36c7454edf742e8408f1d045152%252Fpa%252FPE94683_018641628bceb7f206e27c70f1185798.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_018641628bceb7f206e27c70f1185798.jpg already downloaded
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F70%252F6670c36c7454edf742e8408f1d045152%252Fpa%252FPE94683_567857f96607c30e58c5df5622af0172.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_567857f96607c30e58c5df5622af0172.jpg already downloaded
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F70%252F6670c36c7454edf742e8408f1d045152%252Fpa%252FPE94683_2b129f1426780184563db256f25d7e63.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_2b129f1426780184563db256f25d7e63.jpg already downloaded
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F70%252F6670c36c7454edf742e8408f1d045152%252Fpa%252FPE94683_2b809b914a1785001c1b27f214ab9bd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_2b809b914a1785001c1b27f214ab9bd5.jpg already downloaded
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F70%252F6670c36c7454edf742e8408f1d045152%252Fpa%252FPE94683_4b1369f503ab5c1e50d02063bfec66e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_4b1369f503ab5c1e50d02063bfec66e1.jpg already downloaded
2026-03-28 14:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9a2cc76-0197-597d-89d7-e3293c90a2dc, identifier: PE94683
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_56d00e0a1b387061663f829fd0b6125f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_56d00e0a1b387061663f829fd0b6125f.jpg not downloaded yet
2026-03-28 14:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX49726> (referer: https://www.auto1.com/v1/car-details-view/SX49726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9a2cc76-0197-597d-89d7-e3293c90a2dc with identifier: PE94683
2026-03-28 14:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9a2cc76-0197-597d-89d7-e3293c90a2dc with identifier: PE94683
2026-03-28 14:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f9a2cc76-0197-597d-89d7-e3293c90a2dc with identifier: PE94683 to the API
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PE94683>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.9L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:28:51Z',
 'fuel_type': 'diesel',
 'id': 'f9a2cc76-0197-597d-89d7-e3293c90a2dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE94683',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 250336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_7f066352823156d879f131b44e9f6e86.jpg',
                'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_1fbe8d16494029e20c0974d34238bcda.jpg',
                'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_23b5584fb57e769acfc5f29457f7f9a9.jpg',
                'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_6348ec9728086acf5af40db3c01af787.jpg',
                'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_8a1bb0e5426d78b2daae06e2041fe8ed.jpg',
                'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_018641628bceb7f206e27c70f1185798.jpg',
                'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_567857f96607c30e58c5df5622af0172.jpg',
                'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_2b129f1426780184563db256f25d7e63.jpg',
                'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_2b809b914a1785001c1b27f214ab9bd5.jpg',
                'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_4b1369f503ab5c1e50d02063bfec66e1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9a2cc76-0197-597d-89d7-e3293c90a2dc/f9a2cc76-0197-597d-89d7-e3293c90a2dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_7f066352823156d879f131b44e9f6e86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9a2cc76-0197-597d-89d7-e3293c90a2dc/f9a2cc76-0197-597d-89d7-e3293c90a2dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_1fbe8d16494029e20c0974d34238bcda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9a2cc76-0197-597d-89d7-e3293c90a2dc/f9a2cc76-0197-597d-89d7-e3293c90a2dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_23b5584fb57e769acfc5f29457f7f9a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9a2cc76-0197-597d-89d7-e3293c90a2dc/f9a2cc76-0197-597d-89d7-e3293c90a2dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_6348ec9728086acf5af40db3c01af787.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9a2cc76-0197-597d-89d7-e3293c90a2dc/f9a2cc76-0197-597d-89d7-e3293c90a2dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_8a1bb0e5426d78b2daae06e2041fe8ed.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9a2cc76-0197-597d-89d7-e3293c90a2dc/f9a2cc76-0197-597d-89d7-e3293c90a2dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_018641628bceb7f206e27c70f1185798.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9a2cc76-0197-597d-89d7-e3293c90a2dc/f9a2cc76-0197-597d-89d7-e3293c90a2dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_567857f96607c30e58c5df5622af0172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9a2cc76-0197-597d-89d7-e3293c90a2dc/f9a2cc76-0197-597d-89d7-e3293c90a2dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_2b129f1426780184563db256f25d7e63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9a2cc76-0197-597d-89d7-e3293c90a2dc/f9a2cc76-0197-597d-89d7-e3293c90a2dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_2b809b914a1785001c1b27f214ab9bd5.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9a2cc76-0197-597d-89d7-e3293c90a2dc/f9a2cc76-0197-597d-89d7-e3293c90a2dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/70/6670c36c7454edf742e8408f1d045152/pa/PE94683_4b1369f503ab5c1e50d02063bfec66e1.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.9 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2010}
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE94683%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [auto1.es] INFO: Saving data for PE94683: {'created_time': 1774706764.443868, 'last_price_update_time': 1774706764.443876, 'auction_closing_time': 1774884531.0}
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PE94683') HTTP/1.1" 204 0
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_301a51c81b608d26e223315f603dae9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_301a51c81b608d26e223315f603dae9e.jpg not downloaded yet
2026-03-28 14:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa38fd0>
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73793c72-1acd-5751-ae54-5a311a6628de/73793c72-1acd-5751-ae54-5a311a6628de_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff8%252Fc5f8c6c1084d6dca240d9b761ec7f2fe%252Fpa%252FDM23337_4cdf35a2e3d16ebf3722559dc58d39a4.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_4cdf35a2e3d16ebf3722559dc58d39a4.jpg saved to cache
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73793c72-1acd-5751-ae54-5a311a6628de
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a97d9d0>
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73793c72-1acd-5751-ae54-5a311a6628de/73793c72-1acd-5751-ae54-5a311a6628de_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff8%252Fc5f8c6c1084d6dca240d9b761ec7f2fe%252Fpa%252FDM23337_7052b5100d9ad62980f6ba118dd79818.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_7052b5100d9ad62980f6ba118dd79818.jpg saved to cache
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73793c72-1acd-5751-ae54-5a311a6628de
2026-03-28 14:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_3c77cef6e787544c0745c2e78cf969f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_5b0518334dbaccc38c70dc64337e4300.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_4f6269988b5fa58d7bafb26160411b1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_89e94b005bf276258d2ebe607426f507.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_89e94b005bf276258d2ebe607426f507.jpg not downloaded yet
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_0cced74382a8a81cfed7a5881192def3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_0cced74382a8a81cfed7a5881192def3.jpg not downloaded yet
2026-03-28 14:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK96312> (referer: https://www.auto1.com/v1/car-details-view/FK96312/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a81ba50>
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73793c72-1acd-5751-ae54-5a311a6628de/73793c72-1acd-5751-ae54-5a311a6628de_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff8%252Fc5f8c6c1084d6dca240d9b761ec7f2fe%252Fpa%252FDM23337_d548bb1ebfb67547618f138c2c0a5474.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_d548bb1ebfb67547618f138c2c0a5474.jpg saved to cache
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73793c72-1acd-5751-ae54-5a311a6628de
2026-03-28 14:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c4191fa-4034-568c-b993-cbc532706ab7 with identifier: SX49726
2026-03-28 14:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c4191fa-4034-568c-b993-cbc532706ab7 with scrape type 1
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3c4191fa-4034-568c-b993-cbc532706ab7
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F98%252F0098ef10fb312b33b717ebb001df44be%252Fpa%252FSX49726_04a1f037b5aded81b1fdb76b0386b6bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_04a1f037b5aded81b1fdb76b0386b6bf.jpg already downloaded
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F98%252F0098ef10fb312b33b717ebb001df44be%252Fpa%252FSX49726_9c2a65cd6f9c6a6a88c16bf33d683920.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_9c2a65cd6f9c6a6a88c16bf33d683920.jpg already downloaded
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F98%252F0098ef10fb312b33b717ebb001df44be%252Fpa%252FSX49726_c1ab960128560ad449b94307f88e179e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_c1ab960128560ad449b94307f88e179e.jpg already downloaded
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F98%252F0098ef10fb312b33b717ebb001df44be%252Fpa%252FSX49726_96acb277eaec296ae67ea8fdc3acae65.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_96acb277eaec296ae67ea8fdc3acae65.jpg already downloaded
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F98%252F0098ef10fb312b33b717ebb001df44be%252Fpa%252FSX49726_a8ea77d7b0a815f17c785a7f3a568021.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_a8ea77d7b0a815f17c785a7f3a568021.jpg already downloaded
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F98%252F0098ef10fb312b33b717ebb001df44be%252Fpa%252FSX49726_69eacda94c3b945773681b91f1aaae8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_69eacda94c3b945773681b91f1aaae8d.jpg already downloaded
2026-03-28 14:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c4191fa-4034-568c-b993-cbc532706ab7, identifier: SX49726
2026-03-28 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_835ddd8f17c3c61bf45bde948cf431ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_835ddd8f17c3c61bf45bde948cf431ad.jpg not downloaded yet
2026-03-28 14:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX75561> (referer: https://www.auto1.com/v1/car-details-view/KX75561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c4191fa-4034-568c-b993-cbc532706ab7 with identifier: SX49726
2026-03-28 14:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c4191fa-4034-568c-b993-cbc532706ab7 with identifier: SX49726
2026-03-28 14:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3c4191fa-4034-568c-b993-cbc532706ab7 with identifier: SX49726 to the API
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SX49726>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 103,
 'expiration_date': '2026-03-30T15:05:27Z',
 'fuel_type': 'petrol',
 'id': '3c4191fa-4034-568c-b993-cbc532706ab7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX49726',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Hyundai',
 'model': 'Matrix',
 'odometer': 181363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_04a1f037b5aded81b1fdb76b0386b6bf.jpg',
                'https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_9c2a65cd6f9c6a6a88c16bf33d683920.jpg',
                'https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_c1ab960128560ad449b94307f88e179e.jpg',
                'https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_96acb277eaec296ae67ea8fdc3acae65.jpg',
                'https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_a8ea77d7b0a815f17c785a7f3a568021.jpg',
                'https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_69eacda94c3b945773681b91f1aaae8d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c4191fa-4034-568c-b993-cbc532706ab7/3c4191fa-4034-568c-b993-cbc532706ab7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_04a1f037b5aded81b1fdb76b0386b6bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c4191fa-4034-568c-b993-cbc532706ab7/3c4191fa-4034-568c-b993-cbc532706ab7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_9c2a65cd6f9c6a6a88c16bf33d683920.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c4191fa-4034-568c-b993-cbc532706ab7/3c4191fa-4034-568c-b993-cbc532706ab7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_c1ab960128560ad449b94307f88e179e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c4191fa-4034-568c-b993-cbc532706ab7/3c4191fa-4034-568c-b993-cbc532706ab7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_96acb277eaec296ae67ea8fdc3acae65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c4191fa-4034-568c-b993-cbc532706ab7/3c4191fa-4034-568c-b993-cbc532706ab7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_a8ea77d7b0a815f17c785a7f3a568021.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c4191fa-4034-568c-b993-cbc532706ab7/3c4191fa-4034-568c-b993-cbc532706ab7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/98/0098ef10fb312b33b717ebb001df44be/pa/SX49726_69eacda94c3b945773681b91f1aaae8d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Matrix 1.6 GLS Full',
 'transmission': 'manual',
 'trim': 'GLS Full',
 'year': 2006}
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX49726%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [auto1.es] INFO: Saving data for SX49726: {'created_time': 1774706765.342932, 'last_price_update_time': 1774706765.342943, 'auction_closing_time': 1774883127.0}
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SX49726') HTTP/1.1" 204 0
2026-03-28 14:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_04bf37d66fc89aaec7831996c1930de3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_a3a0424dd7b8b53b2731e26f32679768.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_a3a0424dd7b8b53b2731e26f32679768.jpg not downloaded yet
2026-03-28 14:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP79118> (referer: https://www.auto1.com/v1/car-details-view/MP79118/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_157ac8c9048a40446764da2b9e449344.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_157ac8c9048a40446764da2b9e449344.jpg not downloaded yet
2026-03-28 14:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a897690>
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_3c77cef6e787544c0745c2e78cf969f7.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_3c77cef6e787544c0745c2e78cf969f7.jpg saved to cache
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ece4fdf-4d75-58e2-a851-c05372824479
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aaac090>
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73793c72-1acd-5751-ae54-5a311a6628de/73793c72-1acd-5751-ae54-5a311a6628de_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff8%252Fc5f8c6c1084d6dca240d9b761ec7f2fe%252Fpa%252FDM23337_5b0518334dbaccc38c70dc64337e4300.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_5b0518334dbaccc38c70dc64337e4300.jpg saved to cache
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73793c72-1acd-5751-ae54-5a311a6628de
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aae4210>
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73793c72-1acd-5751-ae54-5a311a6628de/73793c72-1acd-5751-ae54-5a311a6628de_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff8%252Fc5f8c6c1084d6dca240d9b761ec7f2fe%252Fpa%252FDM23337_4f6269988b5fa58d7bafb26160411b1d.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_4f6269988b5fa58d7bafb26160411b1d.jpg saved to cache
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73793c72-1acd-5751-ae54-5a311a6628de
2026-03-28 14:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1 with identifier: FK96312
2026-03-28 14:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1 with scrape type 1
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_6518097b3602c8262e4215ecb98be9ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_6518097b3602c8262e4215ecb98be9ad.jpg not downloaded yet
2026-03-28 14:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_f5af98e90cd796a8eb9bd50519e0e920.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_56d00e0a1b387061663f829fd0b6125f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_da079c52ebbd55e2eba33c088a338bc0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_ba56ee0019e4b438f12a180cf94f34e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_ba56ee0019e4b438f12a180cf94f34e3.jpg not downloaded yet
2026-03-28 14:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0159037-2b9c-59f3-b57e-db6447fd147b with identifier: KX75561
2026-03-28 14:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0159037-2b9c-59f3-b57e-db6447fd147b with scrape type 1
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0159037-2b9c-59f3-b57e-db6447fd147b
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fb9%252F15b9b0d6e517b15dff7a3ef15eeb4067%252Fpa%252FKX75561_64a886077315e4ee0777a2a7d7e211f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_64a886077315e4ee0777a2a7d7e211f3.jpg already downloaded
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fb9%252F15b9b0d6e517b15dff7a3ef15eeb4067%252Fpa%252FKX75561_bca5194b261c5ebac3df31189538235b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_bca5194b261c5ebac3df31189538235b.jpg already downloaded
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fb9%252F15b9b0d6e517b15dff7a3ef15eeb4067%252Fpa%252FKX75561_1515f6f2f6bbc66316cb2af5c1c4a5e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_1515f6f2f6bbc66316cb2af5c1c4a5e8.jpg already downloaded
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fb9%252F15b9b0d6e517b15dff7a3ef15eeb4067%252Fpa%252FKX75561_3d19f7b7d5a9ab796603f2654aabfb8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_3d19f7b7d5a9ab796603f2654aabfb8c.jpg already downloaded
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fb9%252F15b9b0d6e517b15dff7a3ef15eeb4067%252Fpa%252FKX75561_80d3677cb827bc61eae31572c6fa8eb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_80d3677cb827bc61eae31572c6fa8eb1.jpg already downloaded
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fb9%252F15b9b0d6e517b15dff7a3ef15eeb4067%252Fpa%252FKX75561_ce59f85a90079d5e4f8908e8ace532a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_ce59f85a90079d5e4f8908e8ace532a5.jpg already downloaded
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fb9%252F15b9b0d6e517b15dff7a3ef15eeb4067%252Fpa%252FKX75561_2a459e23db4b6fe3dfc0005f6893be82.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_2a459e23db4b6fe3dfc0005f6893be82.jpg already downloaded
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fb9%252F15b9b0d6e517b15dff7a3ef15eeb4067%252Fpa%252FKX75561_69acff4232bd2dbc8e412449da18314c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_69acff4232bd2dbc8e412449da18314c.jpg already downloaded
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fb9%252F15b9b0d6e517b15dff7a3ef15eeb4067%252Fpa%252FKX75561_bed7f2a342f559b232194c9de1f50ddc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_bed7f2a342f559b232194c9de1f50ddc.jpg already downloaded
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fb9%252F15b9b0d6e517b15dff7a3ef15eeb4067%252Fpa%252FKX75561_11f690c435f9e9fe87be063a415f998a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_11f690c435f9e9fe87be063a415f998a.jpg already downloaded
2026-03-28 14:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e0159037-2b9c-59f3-b57e-db6447fd147b, identifier: KX75561
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_38ba07a2ad3ecbfd047b30ab3da17a09.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_38ba07a2ad3ecbfd047b30ab3da17a09.jpg not downloaded yet
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_1bcbbe9e843af66553dc077c5beb4726.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_1bcbbe9e843af66553dc077c5beb4726.jpg not downloaded yet
2026-03-28 14:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e0159037-2b9c-59f3-b57e-db6447fd147b with identifier: KX75561
2026-03-28 14:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e0159037-2b9c-59f3-b57e-db6447fd147b with identifier: KX75561
2026-03-28 14:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e0159037-2b9c-59f3-b57e-db6447fd147b with identifier: KX75561 to the API
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KX75561>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:37Z',
 'fuel_type': 'diesel',
 'id': 'e0159037-2b9c-59f3-b57e-db6447fd147b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX75561',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 141407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_64a886077315e4ee0777a2a7d7e211f3.jpg',
                'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_bca5194b261c5ebac3df31189538235b.jpg',
                'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_1515f6f2f6bbc66316cb2af5c1c4a5e8.jpg',
                'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_3d19f7b7d5a9ab796603f2654aabfb8c.jpg',
                'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_80d3677cb827bc61eae31572c6fa8eb1.jpg',
                'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_ce59f85a90079d5e4f8908e8ace532a5.jpg',
                'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_2a459e23db4b6fe3dfc0005f6893be82.jpg',
                'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_69acff4232bd2dbc8e412449da18314c.jpg',
                'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_bed7f2a342f559b232194c9de1f50ddc.jpg',
                'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_11f690c435f9e9fe87be063a415f998a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0159037-2b9c-59f3-b57e-db6447fd147b/e0159037-2b9c-59f3-b57e-db6447fd147b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_64a886077315e4ee0777a2a7d7e211f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0159037-2b9c-59f3-b57e-db6447fd147b/e0159037-2b9c-59f3-b57e-db6447fd147b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_bca5194b261c5ebac3df31189538235b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0159037-2b9c-59f3-b57e-db6447fd147b/e0159037-2b9c-59f3-b57e-db6447fd147b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_1515f6f2f6bbc66316cb2af5c1c4a5e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0159037-2b9c-59f3-b57e-db6447fd147b/e0159037-2b9c-59f3-b57e-db6447fd147b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_3d19f7b7d5a9ab796603f2654aabfb8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0159037-2b9c-59f3-b57e-db6447fd147b/e0159037-2b9c-59f3-b57e-db6447fd147b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_80d3677cb827bc61eae31572c6fa8eb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0159037-2b9c-59f3-b57e-db6447fd147b/e0159037-2b9c-59f3-b57e-db6447fd147b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_ce59f85a90079d5e4f8908e8ace532a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0159037-2b9c-59f3-b57e-db6447fd147b/e0159037-2b9c-59f3-b57e-db6447fd147b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_2a459e23db4b6fe3dfc0005f6893be82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0159037-2b9c-59f3-b57e-db6447fd147b/e0159037-2b9c-59f3-b57e-db6447fd147b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_69acff4232bd2dbc8e412449da18314c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0159037-2b9c-59f3-b57e-db6447fd147b/e0159037-2b9c-59f3-b57e-db6447fd147b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_bed7f2a342f559b232194c9de1f50ddc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0159037-2b9c-59f3-b57e-db6447fd147b/e0159037-2b9c-59f3-b57e-db6447fd147b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/b9/15b9b0d6e517b15dff7a3ef15eeb4067/pa/KX75561_11f690c435f9e9fe87be063a415f998a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2014}
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX75561%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [auto1.es] INFO: Saving data for KX75561: {'created_time': 1774706766.274286, 'last_price_update_time': 1774706766.274296, 'auction_closing_time': 1774883197.0}
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KX75561') HTTP/1.1" 204 0
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_0cced74382a8a81cfed7a5881192def3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_89e94b005bf276258d2ebe607426f507.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_c7b373c1f8646b76904b1ff572b4e5a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_c7b373c1f8646b76904b1ff572b4e5a4.jpg not downloaded yet
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH45728> (referer: https://www.auto1.com/v1/car-details-view/AH45728/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA49671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b586f50>
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_04bf37d66fc89aaec7831996c1930de3.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_04bf37d66fc89aaec7831996c1930de3.jpg saved to cache
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ece4fdf-4d75-58e2-a851-c05372824479
2026-03-28 14:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23fae7d9-e4f0-5b33-a730-5a56b247e24a with identifier: MP79118
2026-03-28 14:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23fae7d9-e4f0-5b33-a730-5a56b247e24a with scrape type 1
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 23fae7d9-e4f0-5b33-a730-5a56b247e24a
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F44%252Fed445842469d6ed01ad8c6311893dc0e%252Fpa%252FMP79118_38a141e885a41fc4c817fa2b41410e19.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_38a141e885a41fc4c817fa2b41410e19.jpg not downloaded yet
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_f79d3e96afd00a9ab158b3446918caba.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_f79d3e96afd00a9ab158b3446918caba.jpg not downloaded yet
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_09db5d70a54fcc43b264b55df83b72ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_09db5d70a54fcc43b264b55df83b72ef.jpg not downloaded yet
2026-03-28 14:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF24010> (referer: https://www.auto1.com/v1/car-details-view/AF24010/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3ad490>
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_f5af98e90cd796a8eb9bd50519e0e920.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_f5af98e90cd796a8eb9bd50519e0e920.jpg saved to cache
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da269d41-96d1-56e1-8ef3-f7befbf94261
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa9a0d0>
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_56d00e0a1b387061663f829fd0b6125f.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_56d00e0a1b387061663f829fd0b6125f.jpg saved to cache
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da269d41-96d1-56e1-8ef3-f7befbf94261
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b576d90>
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_da079c52ebbd55e2eba33c088a338bc0.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_da079c52ebbd55e2eba33c088a338bc0.jpg saved to cache
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ece4fdf-4d75-58e2-a851-c05372824479
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_84e97f4e5d0a3622ed98e445953bed0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_84e97f4e5d0a3622ed98e445953bed0a.jpg not downloaded yet
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F44%252Fed445842469d6ed01ad8c6311893dc0e%252Fpa%252FMP79118_bde7ab15ff274fcb6a7e5c4232ea3c5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_bde7ab15ff274fcb6a7e5c4232ea3c5e.jpg not downloaded yet
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_a3a0424dd7b8b53b2731e26f32679768.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_33e5bc7ee75f90a2710f05800d24bbac.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_1f4f9f81aa282e532c5d9933f1206e80.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_f736db56044554d8910f19d444ce9ac0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_f736db56044554d8910f19d444ce9ac0.jpg not downloaded yet
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_caf8c8fd8b94b0ae4344ad3e6dd083fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_caf8c8fd8b94b0ae4344ad3e6dd083fe.jpg not downloaded yet
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F44%252Fed445842469d6ed01ad8c6311893dc0e%252Fpa%252FMP79118_85daefac617f32bb2b4959a609d5e6e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_85daefac617f32bb2b4959a609d5e6e7.jpg not downloaded yet
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9d1fd0>
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_0cced74382a8a81cfed7a5881192def3.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_0cced74382a8a81cfed7a5881192def3.jpg saved to cache
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ece4fdf-4d75-58e2-a851-c05372824479
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a955110>
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_89e94b005bf276258d2ebe607426f507.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_89e94b005bf276258d2ebe607426f507.jpg saved to cache
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da269d41-96d1-56e1-8ef3-f7befbf94261
2026-03-28 14:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eaa2514-e09e-5d98-aef7-b2322c9a86d5 with identifier: AH45728
2026-03-28 14:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eaa2514-e09e-5d98-aef7-b2322c9a86d5 with scrape type 1
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2eaa2514-e09e-5d98-aef7-b2322c9a86d5
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F4c%252F484c2e2a627cd35066986c298d6b2e2d%252Fpa%252FAH45728_df330ec5fabc0c20d0168fae71106548.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_df330ec5fabc0c20d0168fae71106548.jpg not downloaded yet
2026-03-28 14:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43d48408-6288-514a-b497-fede76199c4f with identifier: AF24010
2026-03-28 14:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43d48408-6288-514a-b497-fede76199c4f with scrape type 1
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 43d48408-6288-514a-b497-fede76199c4f
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F87%252F8387a3290dc5e8597bdfbd746c83497d%252Fpa%252FAF24010_4f8145e00308b604b300787ea09c4fa0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_4f8145e00308b604b300787ea09c4fa0.jpg not downloaded yet
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_6518097b3602c8262e4215ecb98be9ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_346cc7ffa29418f84c9cf272fb25f3d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_346cc7ffa29418f84c9cf272fb25f3d7.jpg not downloaded yet
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_74b6600bba6972c94cc001616d5d737c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_74b6600bba6972c94cc001616d5d737c.jpg not downloaded yet
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F44%252Fed445842469d6ed01ad8c6311893dc0e%252Fpa%252FMP79118_1aad60cda06d75c7c74a7aed7419adb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_1aad60cda06d75c7c74a7aed7419adb6.jpg not downloaded yet
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F4c%252F484c2e2a627cd35066986c298d6b2e2d%252Fpa%252FAH45728_d32c7ddd34c778c5dd8da3bc64a6e1d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_d32c7ddd34c778c5dd8da3bc64a6e1d2.jpg not downloaded yet
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F87%252F8387a3290dc5e8597bdfbd746c83497d%252Fpa%252FAF24010_2288dfb6003c74c8ba4167ab6b492cac.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_2288dfb6003c74c8ba4167ab6b492cac.jpg not downloaded yet
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_38a141e885a41fc4c817fa2b41410e19.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_38ba07a2ad3ecbfd047b30ab3da17a09.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_ba56ee0019e4b438f12a180cf94f34e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_164771e87296d594dd62d5fe8cf1a3d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_164771e87296d594dd62d5fe8cf1a3d2.jpg not downloaded yet
2026-03-28 14:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL01045> (referer: https://www.auto1.com/v1/car-details-view/SL01045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F44%252Fed445842469d6ed01ad8c6311893dc0e%252Fpa%252FMP79118_327199faa6280d4f110611a017903b7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_327199faa6280d4f110611a017903b7e.jpg not downloaded yet
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F4c%252F484c2e2a627cd35066986c298d6b2e2d%252Fpa%252FAH45728_317619d315f65ea8486664dc8a98cb23.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_317619d315f65ea8486664dc8a98cb23.jpg not downloaded yet
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F87%252F8387a3290dc5e8597bdfbd746c83497d%252Fpa%252FAF24010_27ae6cca38038c8d125c5908212b9f14.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_27ae6cca38038c8d125c5908212b9f14.jpg not downloaded yet
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8222d0>
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_a3a0424dd7b8b53b2731e26f32679768.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_a3a0424dd7b8b53b2731e26f32679768.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ece4fdf-4d75-58e2-a851-c05372824479
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa77450>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_33e5bc7ee75f90a2710f05800d24bbac.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_33e5bc7ee75f90a2710f05800d24bbac.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ece4fdf-4d75-58e2-a851-c05372824479
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b46a610>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_1f4f9f81aa282e532c5d9933f1206e80.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_1f4f9f81aa282e532c5d9933f1206e80.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da269d41-96d1-56e1-8ef3-f7befbf94261
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_09db5d70a54fcc43b264b55df83b72ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_1901ad555958902615353b15d75295eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_1901ad555958902615353b15d75295eb.jpg not downloaded yet
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa77bd0>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_6518097b3602c8262e4215ecb98be9ad.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_6518097b3602c8262e4215ecb98be9ad.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F44%252Fed445842469d6ed01ad8c6311893dc0e%252Fpa%252FMP79118_4a00554968765636abef268d57b63881.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_4a00554968765636abef268d57b63881.jpg not downloaded yet
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F4c%252F484c2e2a627cd35066986c298d6b2e2d%252Fpa%252FAH45728_fa2fdba96335245ae702278674efb16a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_fa2fdba96335245ae702278674efb16a.jpg not downloaded yet
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F87%252F8387a3290dc5e8597bdfbd746c83497d%252Fpa%252FAF24010_723ccab53b723e7ee9222e14194d98fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_723ccab53b723e7ee9222e14194d98fe.jpg not downloaded yet
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_c7b373c1f8646b76904b1ff572b4e5a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_4f8145e00308b604b300787ea09c4fa0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_f79d3e96afd00a9ab158b3446918caba.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_7c742c46a4df50165a177cb8954a54e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_7c742c46a4df50165a177cb8954a54e6.jpg not downloaded yet
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM15498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b599990>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fae7d9-e4f0-5b33-a730-5a56b247e24a/23fae7d9-e4f0-5b33-a730-5a56b247e24a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F44%252Fed445842469d6ed01ad8c6311893dc0e%252Fpa%252FMP79118_38a141e885a41fc4c817fa2b41410e19.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_38a141e885a41fc4c817fa2b41410e19.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23fae7d9-e4f0-5b33-a730-5a56b247e24a
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a955110>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_38ba07a2ad3ecbfd047b30ab3da17a09.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_38ba07a2ad3ecbfd047b30ab3da17a09.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da269d41-96d1-56e1-8ef3-f7befbf94261
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a954410>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_ba56ee0019e4b438f12a180cf94f34e3.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_ba56ee0019e4b438f12a180cf94f34e3.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ece4fdf-4d75-58e2-a851-c05372824479
2026-03-28 14:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f981199-523a-56b4-9cfd-e12194eb8559 with identifier: SL01045
2026-03-28 14:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f981199-523a-56b4-9cfd-e12194eb8559 with scrape type 1
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f981199-523a-56b4-9cfd-e12194eb8559
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_4c691bf8114b269eddea53d5f556ad7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_4c691bf8114b269eddea53d5f556ad7f.jpg not downloaded yet
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_74b6600bba6972c94cc001616d5d737c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F4c%252F484c2e2a627cd35066986c298d6b2e2d%252Fpa%252FAH45728_910dccca7dfd90385812995c3f36ecd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_910dccca7dfd90385812995c3f36ecd2.jpg not downloaded yet
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F87%252F8387a3290dc5e8597bdfbd746c83497d%252Fpa%252FAF24010_b2dd77e1b55494042692c5795d7cbd51.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_b2dd77e1b55494042692c5795d7cbd51.jpg not downloaded yet
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG75974> (referer: https://www.auto1.com/v1/car-details-view/PG75974/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_346cc7ffa29418f84c9cf272fb25f3d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_d9d22a5d3e67b2feef369e15311b5518.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_d9d22a5d3e67b2feef369e15311b5518.jpg not downloaded yet
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_d90e3095732f0ae259a6c70297a026f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_d90e3095732f0ae259a6c70297a026f0.jpg not downloaded yet
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F4c%252F484c2e2a627cd35066986c298d6b2e2d%252Fpa%252FAH45728_7eb2c2a4ed156ba407babd712156a801.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_7eb2c2a4ed156ba407babd712156a801.jpg not downloaded yet
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F87%252F8387a3290dc5e8597bdfbd746c83497d%252Fpa%252FAF24010_a1746b8b73264af212b30a80c2887013.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_a1746b8b73264af212b30a80c2887013.jpg not downloaded yet
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX37636> (referer: https://www.auto1.com/v1/car-details-view/HX37636/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b469bd0>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_09db5d70a54fcc43b264b55df83b72ef.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_09db5d70a54fcc43b264b55df83b72ef.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa9a210>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_c7b373c1f8646b76904b1ff572b4e5a4.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_c7b373c1f8646b76904b1ff572b4e5a4.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ece4fdf-4d75-58e2-a851-c05372824479
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3c6a50>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43d48408-6288-514a-b497-fede76199c4f/43d48408-6288-514a-b497-fede76199c4f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F87%252F8387a3290dc5e8597bdfbd746c83497d%252Fpa%252FAF24010_4f8145e00308b604b300787ea09c4fa0.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_4f8145e00308b604b300787ea09c4fa0.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43d48408-6288-514a-b497-fede76199c4f
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6441dbed10>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_f79d3e96afd00a9ab158b3446918caba.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_f79d3e96afd00a9ab158b3446918caba.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da269d41-96d1-56e1-8ef3-f7befbf94261
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_164771e87296d594dd62d5fe8cf1a3d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_cb47f80aa1cd94594d9e78307b1f31b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_cb47f80aa1cd94594d9e78307b1f31b3.jpg not downloaded yet
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_15bd631c6ba3b3e3c0c53bc8e186f581.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_15bd631c6ba3b3e3c0c53bc8e186f581.jpg not downloaded yet
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_27ae6cca38038c8d125c5908212b9f14.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 0ece4fdf-4d75-58e2-a851-c05372824479 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item da269d41-96d1-56e1-8ef3-f7befbf94261 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_fa2fdba96335245ae702278674efb16a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_2288dfb6003c74c8ba4167ab6b492cac.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_1901ad555958902615353b15d75295eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_e3d33805725e3b4d5a7b903865180f86.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_e3d33805725e3b4d5a7b903865180f86.jpg not downloaded yet
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4ead10>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_74b6600bba6972c94cc001616d5d737c.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_74b6600bba6972c94cc001616d5d737c.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1
2026-03-28 14:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd48de7-08ae-54a3-95ac-9e0298268f10 with identifier: PG75974
2026-03-28 14:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd48de7-08ae-54a3-95ac-9e0298268f10 with scrape type 1
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6cd48de7-08ae-54a3-95ac-9e0298268f10
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd6%252F3cd6a6dc273d20065c81034d6da4f8ce%252Fpa%252FPG75974_eb311f270c0d28c000c7e519110f1a06.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_eb311f270c0d28c000c7e519110f1a06.jpg not downloaded yet
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f64413da550>
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_346cc7ffa29418f84c9cf272fb25f3d7.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_346cc7ffa29418f84c9cf272fb25f3d7.jpg saved to cache
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da269d41-96d1-56e1-8ef3-f7befbf94261
2026-03-28 14:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2f9ece0-6080-5402-a4bc-4816d030809d with identifier: HX37636
2026-03-28 14:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f9ece0-6080-5402-a4bc-4816d030809d with scrape type 1
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a2f9ece0-6080-5402-a4bc-4816d030809d
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa2%252F0ca23a5dd26a0a78281d47027bc8d60b%252Fpa%252FHX37636_ef6250c125c04d064faeede282831ada.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_ef6250c125c04d064faeede282831ada.jpg not downloaded yet
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK42012> (referer: https://www.auto1.com/v1/car-details-view/ZK42012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB66589> (referer: https://www.auto1.com/v1/car-details-view/EB66589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_910dccca7dfd90385812995c3f36ecd2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_5c08f43976e286eaf2cb96fe08623b1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_5c08f43976e286eaf2cb96fe08623b1e.jpg not downloaded yet
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd6%252F3cd6a6dc273d20065c81034d6da4f8ce%252Fpa%252FPG75974_245253408afd4e368096dd92c976f088.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_245253408afd4e368096dd92c976f088.jpg not downloaded yet
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa2%252F0ca23a5dd26a0a78281d47027bc8d60b%252Fpa%252FHX37636_325d90558ae68f1677560239a617739b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_325d90558ae68f1677560239a617739b.jpg not downloaded yet
2026-03-28 14:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_b2dd77e1b55494042692c5795d7cbd51.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_3b68b69ba61554e2247beafdcbc47b61.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_3b68b69ba61554e2247beafdcbc47b61.jpg not downloaded yet
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd6%252F3cd6a6dc273d20065c81034d6da4f8ce%252Fpa%252FPG75974_21b0aff8a57b2d3039b322601cb4fdf9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_21b0aff8a57b2d3039b322601cb4fdf9.jpg not downloaded yet
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa2%252F0ca23a5dd26a0a78281d47027bc8d60b%252Fpa%252FHX37636_fcc1728a5a04fc0fd3ba4fbb00694d43.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_fcc1728a5a04fc0fd3ba4fbb00694d43.jpg not downloaded yet
2026-03-28 14:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_4c691bf8114b269eddea53d5f556ad7f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a999790>
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_164771e87296d594dd62d5fe8cf1a3d2.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_164771e87296d594dd62d5fe8cf1a3d2.jpg saved to cache
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a84f290>
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43d48408-6288-514a-b497-fede76199c4f/43d48408-6288-514a-b497-fede76199c4f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F87%252F8387a3290dc5e8597bdfbd746c83497d%252Fpa%252FAF24010_27ae6cca38038c8d125c5908212b9f14.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_27ae6cca38038c8d125c5908212b9f14.jpg saved to cache
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43d48408-6288-514a-b497-fede76199c4f
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a82c990>
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eaa2514-e09e-5d98-aef7-b2322c9a86d5/2eaa2514-e09e-5d98-aef7-b2322c9a86d5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F4c%252F484c2e2a627cd35066986c298d6b2e2d%252Fpa%252FAH45728_fa2fdba96335245ae702278674efb16a.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_fa2fdba96335245ae702278674efb16a.jpg saved to cache
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2eaa2514-e09e-5d98-aef7-b2322c9a86d5
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa99b10>
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43d48408-6288-514a-b497-fede76199c4f/43d48408-6288-514a-b497-fede76199c4f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F87%252F8387a3290dc5e8597bdfbd746c83497d%252Fpa%252FAF24010_2288dfb6003c74c8ba4167ab6b492cac.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_2288dfb6003c74c8ba4167ab6b492cac.jpg saved to cache
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43d48408-6288-514a-b497-fede76199c4f
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a82c510>
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_1901ad555958902615353b15d75295eb.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_1901ad555958902615353b15d75295eb.jpg saved to cache
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_12c8fd66e60399d8496e2f0e933277ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_12c8fd66e60399d8496e2f0e933277ca.jpg not downloaded yet
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd6%252F3cd6a6dc273d20065c81034d6da4f8ce%252Fpa%252FPG75974_46fd8ba8998b54b95ce861854d265b53.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_46fd8ba8998b54b95ce861854d265b53.jpg not downloaded yet
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa2%252F0ca23a5dd26a0a78281d47027bc8d60b%252Fpa%252FHX37636_21317d58c637e06123f61b7cfa5bd91e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_21317d58c637e06123f61b7cfa5bd91e.jpg not downloaded yet
2026-03-28 14:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_15bd631c6ba3b3e3c0c53bc8e186f581.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_cb47f80aa1cd94594d9e78307b1f31b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_7c742c46a4df50165a177cb8954a54e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_d90e3095732f0ae259a6c70297a026f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_e00208941036525cbc4f0a961bbf9d9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_e00208941036525cbc4f0a961bbf9d9c.jpg not downloaded yet
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd6%252F3cd6a6dc273d20065c81034d6da4f8ce%252Fpa%252FPG75974_7802156a725af8e7737933ae24fbd655.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_7802156a725af8e7737933ae24fbd655.jpg not downloaded yet
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa2%252F0ca23a5dd26a0a78281d47027bc8d60b%252Fpa%252FHX37636_56b73c30a92b738b7ce72e6301bb541c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_56b73c30a92b738b7ce72e6301bb541c.jpg not downloaded yet
2026-03-28 14:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16f40dd9-f338-53dc-a570-18783f81aae3 with identifier: ZK42012
2026-03-28 14:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16f40dd9-f338-53dc-a570-18783f81aae3 with scrape type 1
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16f40dd9-f338-53dc-a570-18783f81aae3
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F70%252F73707ca9e02ac4a5e9b3902dbfd4575c%252Fpa%252FZK42012_64abd0a772ad94d9282ceebeed1b02b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_64abd0a772ad94d9282ceebeed1b02b3.jpg already downloaded
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F70%252F73707ca9e02ac4a5e9b3902dbfd4575c%252Fpa%252FZK42012_c0e67b2256ea0e8721fe42fe4f9f989e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_c0e67b2256ea0e8721fe42fe4f9f989e.jpg already downloaded
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F70%252F73707ca9e02ac4a5e9b3902dbfd4575c%252Fpa%252FZK42012_f6cd721851005fad5991e9673ef5004f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f6cd721851005fad5991e9673ef5004f.jpg already downloaded
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F70%252F73707ca9e02ac4a5e9b3902dbfd4575c%252Fpa%252FZK42012_e5d69e808d39a5cd85487e0a71d316cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_e5d69e808d39a5cd85487e0a71d316cd.jpg already downloaded
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F70%252F73707ca9e02ac4a5e9b3902dbfd4575c%252Fpa%252FZK42012_d558fb934abecb63fbc3368ed652d6ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_d558fb934abecb63fbc3368ed652d6ce.jpg already downloaded
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F70%252F73707ca9e02ac4a5e9b3902dbfd4575c%252Fpa%252FZK42012_4d1ebac0b821c8dd30e0a341a700213b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_4d1ebac0b821c8dd30e0a341a700213b.jpg already downloaded
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F70%252F73707ca9e02ac4a5e9b3902dbfd4575c%252Fpa%252FZK42012_ea62e948fab604e2c6c960c43086b68a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_ea62e948fab604e2c6c960c43086b68a.jpg already downloaded
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F70%252F73707ca9e02ac4a5e9b3902dbfd4575c%252Fpa%252FZK42012_166ba6b473a8e4ab73c8a1d17a49927c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_166ba6b473a8e4ab73c8a1d17a49927c.jpg already downloaded
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F70%252F73707ca9e02ac4a5e9b3902dbfd4575c%252Fpa%252FZK42012_f440e1edc87d00e49770243fe4145d9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f440e1edc87d00e49770243fe4145d9b.jpg already downloaded
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F70%252F73707ca9e02ac4a5e9b3902dbfd4575c%252Fpa%252FZK42012_0cbde3e1651321da1fb3cb2c4cbfc06e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_0cbde3e1651321da1fb3cb2c4cbfc06e.jpg already downloaded
2026-03-28 14:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 16f40dd9-f338-53dc-a570-18783f81aae3, identifier: ZK42012
2026-03-28 14:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2 with identifier: EB66589
2026-03-28 14:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2 with scrape type 1
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_62d709d2e4fc2c7a3177ac00b3050ca0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_62d709d2e4fc2c7a3177ac00b3050ca0.jpg not downloaded yet
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aae4ad0>
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eaa2514-e09e-5d98-aef7-b2322c9a86d5/2eaa2514-e09e-5d98-aef7-b2322c9a86d5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F4c%252F484c2e2a627cd35066986c298d6b2e2d%252Fpa%252FAH45728_910dccca7dfd90385812995c3f36ecd2.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_910dccca7dfd90385812995c3f36ecd2.jpg saved to cache
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2eaa2514-e09e-5d98-aef7-b2322c9a86d5
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa9c6d0>
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43d48408-6288-514a-b497-fede76199c4f/43d48408-6288-514a-b497-fede76199c4f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F87%252F8387a3290dc5e8597bdfbd746c83497d%252Fpa%252FAF24010_b2dd77e1b55494042692c5795d7cbd51.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_b2dd77e1b55494042692c5795d7cbd51.jpg saved to cache
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43d48408-6288-514a-b497-fede76199c4f
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa81790>
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_4c691bf8114b269eddea53d5f556ad7f.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_4c691bf8114b269eddea53d5f556ad7f.jpg saved to cache
2026-03-28 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f981199-523a-56b4-9cfd-e12194eb8559
2026-03-28 14:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 16f40dd9-f338-53dc-a570-18783f81aae3 with identifier: ZK42012
2026-03-28 14:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 16f40dd9-f338-53dc-a570-18783f81aae3 with identifier: ZK42012
2026-03-28 14:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 16f40dd9-f338-53dc-a570-18783f81aae3 with identifier: ZK42012 to the API
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK42012>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:39:38Z',
 'fuel_type': 'diesel',
 'id': '16f40dd9-f338-53dc-a570-18783f81aae3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK42012',
 'listing': 'auction',
 'location': 'ES, Colloto, Oviedo',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 361695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_64abd0a772ad94d9282ceebeed1b02b3.jpg',
                'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_c0e67b2256ea0e8721fe42fe4f9f989e.jpg',
                'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f6cd721851005fad5991e9673ef5004f.jpg',
                'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_e5d69e808d39a5cd85487e0a71d316cd.jpg',
                'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_d558fb934abecb63fbc3368ed652d6ce.jpg',
                'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_4d1ebac0b821c8dd30e0a341a700213b.jpg',
                'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_ea62e948fab604e2c6c960c43086b68a.jpg',
                'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_166ba6b473a8e4ab73c8a1d17a49927c.jpg',
                'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f440e1edc87d00e49770243fe4145d9b.jpg',
                'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_0cbde3e1651321da1fb3cb2c4cbfc06e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_64abd0a772ad94d9282ceebeed1b02b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_c0e67b2256ea0e8721fe42fe4f9f989e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f6cd721851005fad5991e9673ef5004f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_e5d69e808d39a5cd85487e0a71d316cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_d558fb934abecb63fbc3368ed652d6ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_4d1ebac0b821c8dd30e0a341a700213b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_ea62e948fab604e2c6c960c43086b68a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_166ba6b473a8e4ab73c8a1d17a49927c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_f440e1edc87d00e49770243fe4145d9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f40dd9-f338-53dc-a570-18783f81aae3/16f40dd9-f338-53dc-a570-18783f81aae3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/70/73707ca9e02ac4a5e9b3902dbfd4575c/pa/ZK42012_0cbde3e1651321da1fb3cb2c4cbfc06e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK42012%27 HTTP/1.1" 200 None
2026-03-28 14:06:09 [auto1.es] INFO: Saving data for ZK42012: {'created_time': 1774706769.967837, 'last_price_update_time': 1774706769.967848, 'auction_closing_time': 1774885178.0}
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZK42012') HTTP/1.1" 204 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_60fc92878c522d26e51a6dd7087ffc42.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_60fc92878c522d26e51a6dd7087ffc42.jpg not downloaded yet
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd6%252F3cd6a6dc273d20065c81034d6da4f8ce%252Fpa%252FPG75974_ad3365204fec526de10904869c0212dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_ad3365204fec526de10904869c0212dd.jpg not downloaded yet
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa2%252F0ca23a5dd26a0a78281d47027bc8d60b%252Fpa%252FHX37636_efb7a188133dd9d1a4472d8759bcada3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_efb7a188133dd9d1a4472d8759bcada3.jpg not downloaded yet
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_975d44a377a96d728ac089e68e946d51.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_975d44a377a96d728ac089e68e946d51.jpg not downloaded yet
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_a1746b8b73264af212b30a80c2887013.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM15498> (referer: https://www.auto1.com/v1/car-details-view/XM15498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_ef6250c125c04d064faeede282831ada.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_eb311f270c0d28c000c7e519110f1a06.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_7eb2c2a4ed156ba407babd712156a801.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_e3d33805725e3b4d5a7b903865180f86.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_88c43cc49bfae485926d90323b5592f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_88c43cc49bfae485926d90323b5592f3.jpg not downloaded yet
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_11dbaf6c744ebb10f9a944d6156fe60c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_11dbaf6c744ebb10f9a944d6156fe60c.jpg not downloaded yet
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b468810>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_15bd631c6ba3b3e3c0c53bc8e186f581.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_15bd631c6ba3b3e3c0c53bc8e186f581.jpg saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f981199-523a-56b4-9cfd-e12194eb8559
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8e4910>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_cb47f80aa1cd94594d9e78307b1f31b3.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_cb47f80aa1cd94594d9e78307b1f31b3.jpg saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a927890>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_7c742c46a4df50165a177cb8954a54e6.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_7c742c46a4df50165a177cb8954a54e6.jpg saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a89c2d0>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_d90e3095732f0ae259a6c70297a026f0.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_d90e3095732f0ae259a6c70297a026f0.jpg saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f981199-523a-56b4-9cfd-e12194eb8559
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 43d48408-6288-514a-b497-fede76199c4f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 2eaa2514-e09e-5d98-aef7-b2322c9a86d5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:10 [scrapy.extensions.logstats] INFO: Crawled 99 pages (at 99 pages/min), scraped 29 items (at 29 items/min)
2026-03-28 14:06:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_f976c1351b36195b1607ef29fc4d9ec2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_f976c1351b36195b1607ef29fc4d9ec2.jpg not downloaded yet
2026-03-28 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_46fd8ba8998b54b95ce861854d265b53.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_b2cca31adf1b462edeb3dd368744cb0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_b2cca31adf1b462edeb3dd368744cb0b.jpg not downloaded yet
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3aa9d0>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43d48408-6288-514a-b497-fede76199c4f/43d48408-6288-514a-b497-fede76199c4f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F87%252F8387a3290dc5e8597bdfbd746c83497d%252Fpa%252FAF24010_a1746b8b73264af212b30a80c2887013.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_a1746b8b73264af212b30a80c2887013.jpg saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43d48408-6288-514a-b497-fede76199c4f
2026-03-28 14:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43d48408-6288-514a-b497-fede76199c4f, skipping ID generation
2026-03-28 14:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43d48408-6288-514a-b497-fede76199c4f with scrape type 1
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43d48408-6288-514a-b497-fede76199c4f sending to next pipeline
2026-03-28 14:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 43d48408-6288-514a-b497-fede76199c4f, identifier: AF24010
2026-03-28 14:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b6f9684-143b-5b44-953b-04fcabc753da with identifier: XM15498
2026-03-28 14:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6f9684-143b-5b44-953b-04fcabc753da with scrape type 1
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6b6f9684-143b-5b44-953b-04fcabc753da
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F77%252Fd377d46cbca0b0f31b195bc0b71d448b%252Fpa%252FXM15498_cc01a2a058c326e484569dcb9b9aefca.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_cc01a2a058c326e484569dcb9b9aefca.jpg not downloaded yet
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a999a10>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f9ece0-6080-5402-a4bc-4816d030809d/a2f9ece0-6080-5402-a4bc-4816d030809d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa2%252F0ca23a5dd26a0a78281d47027bc8d60b%252Fpa%252FHX37636_ef6250c125c04d064faeede282831ada.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_ef6250c125c04d064faeede282831ada.jpg saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2f9ece0-6080-5402-a4bc-4816d030809d
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a81fa90>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd48de7-08ae-54a3-95ac-9e0298268f10/6cd48de7-08ae-54a3-95ac-9e0298268f10_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd6%252F3cd6a6dc273d20065c81034d6da4f8ce%252Fpa%252FPG75974_eb311f270c0d28c000c7e519110f1a06.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_eb311f270c0d28c000c7e519110f1a06.jpg saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cd48de7-08ae-54a3-95ac-9e0298268f10
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6440269610>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eaa2514-e09e-5d98-aef7-b2322c9a86d5/2eaa2514-e09e-5d98-aef7-b2322c9a86d5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F4c%252F484c2e2a627cd35066986c298d6b2e2d%252Fpa%252FAH45728_7eb2c2a4ed156ba407babd712156a801.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_7eb2c2a4ed156ba407babd712156a801.jpg saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2eaa2514-e09e-5d98-aef7-b2322c9a86d5
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b584310>
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_e3d33805725e3b4d5a7b903865180f86.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_e3d33805725e3b4d5a7b903865180f86.jpg saved to cache
2026-03-28 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f981199-523a-56b4-9cfd-e12194eb8559
2026-03-28 14:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 43d48408-6288-514a-b497-fede76199c4f with identifier: AF24010
2026-03-28 14:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 43d48408-6288-514a-b497-fede76199c4f with identifier: AF24010
2026-03-28 14:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 43d48408-6288-514a-b497-fede76199c4f with identifier: AF24010 to the API
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_a1746b8b73264af212b30a80c2887013.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:37:52Z',
 'fuel_type': 'diesel',
 'id': '43d48408-6288-514a-b497-fede76199c4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF24010',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 268618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43d48408-6288-514a-b497-fede76199c4f/43d48408-6288-514a-b497-fede76199c4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_4f8145e00308b604b300787ea09c4fa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43d48408-6288-514a-b497-fede76199c4f/43d48408-6288-514a-b497-fede76199c4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_2288dfb6003c74c8ba4167ab6b492cac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43d48408-6288-514a-b497-fede76199c4f/43d48408-6288-514a-b497-fede76199c4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_27ae6cca38038c8d125c5908212b9f14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43d48408-6288-514a-b497-fede76199c4f/43d48408-6288-514a-b497-fede76199c4f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_b2dd77e1b55494042692c5795d7cbd51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43d48408-6288-514a-b497-fede76199c4f/43d48408-6288-514a-b497-fede76199c4f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/87/8387a3290dc5e8597bdfbd746c83497d/pa/AF24010_a1746b8b73264af212b30a80c2887013.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF24010%27 HTTP/1.1" 200 None
2026-03-28 14:06:11 [auto1.es] INFO: Saving data for AF24010: {'created_time': 1774706771.102054, 'last_price_update_time': 1774706771.102065, 'auction_closing_time': 1774885072.0}
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AF24010') HTTP/1.1" 204 0
2026-03-28 14:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_56b73c30a92b738b7ce72e6301bb541c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_62d709d2e4fc2c7a3177ac00b3050ca0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_da611e3bb5ce2a5263c9a9a265512d59.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_da611e3bb5ce2a5263c9a9a265512d59.jpg not downloaded yet
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F77%252Fd377d46cbca0b0f31b195bc0b71d448b%252Fpa%252FXM15498_c349e6b6caed92a127ce7b9f41f7f547.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_c349e6b6caed92a127ce7b9f41f7f547.jpg not downloaded yet
2026-03-28 14:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_12c8fd66e60399d8496e2f0e933277ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_fcc1728a5a04fc0fd3ba4fbb00694d43.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_7802156a725af8e7737933ae24fbd655.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a930fd0>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd48de7-08ae-54a3-95ac-9e0298268f10/6cd48de7-08ae-54a3-95ac-9e0298268f10_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd6%252F3cd6a6dc273d20065c81034d6da4f8ce%252Fpa%252FPG75974_46fd8ba8998b54b95ce861854d265b53.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_46fd8ba8998b54b95ce861854d265b53.jpg saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cd48de7-08ae-54a3-95ac-9e0298268f10
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_6ed857e00493478a50ad44a47b256a18.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_6ed857e00493478a50ad44a47b256a18.jpg not downloaded yet
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F77%252Fd377d46cbca0b0f31b195bc0b71d448b%252Fpa%252FXM15498_495964c84211d0a892526a62ef9d6d35.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_495964c84211d0a892526a62ef9d6d35.jpg not downloaded yet
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_22e0e27acf8d8932a158428ceb4d6d0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_22e0e27acf8d8932a158428ceb4d6d0b.jpg not downloaded yet
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F77%252Fd377d46cbca0b0f31b195bc0b71d448b%252Fpa%252FXM15498_fe71999fd0c5a01d90bd0ba345e9fc74.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_fe71999fd0c5a01d90bd0ba345e9fc74.jpg not downloaded yet
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_142eb330def5c2c8bda2efbb7dc2c64e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_142eb330def5c2c8bda2efbb7dc2c64e.jpg not downloaded yet
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F77%252Fd377d46cbca0b0f31b195bc0b71d448b%252Fpa%252FXM15498_b0d15ff69cc30bd5e69db35dfc574438.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_b0d15ff69cc30bd5e69db35dfc574438.jpg not downloaded yet
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a835210>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f9ece0-6080-5402-a4bc-4816d030809d/a2f9ece0-6080-5402-a4bc-4816d030809d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa2%252F0ca23a5dd26a0a78281d47027bc8d60b%252Fpa%252FHX37636_56b73c30a92b738b7ce72e6301bb541c.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_56b73c30a92b738b7ce72e6301bb541c.jpg saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2f9ece0-6080-5402-a4bc-4816d030809d
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aae1790>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_62d709d2e4fc2c7a3177ac00b3050ca0.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_62d709d2e4fc2c7a3177ac00b3050ca0.jpg saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2
2026-03-28 14:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_ad3365204fec526de10904869c0212dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_60fc92878c522d26e51a6dd7087ffc42.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 23fae7d9-e4f0-5b33-a730-5a56b247e24a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item a2f9ece0-6080-5402-a4bc-4816d030809d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item a2f9ece0-6080-5402-a4bc-4816d030809d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_efb7a188133dd9d1a4472d8759bcada3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_cfb53830682dd825d8815d5165b6c209.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_cfb53830682dd825d8815d5165b6c209.jpg not downloaded yet
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F77%252Fd377d46cbca0b0f31b195bc0b71d448b%252Fpa%252FXM15498_0159e1e6442a0788eaedc8defe2885c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_0159e1e6442a0788eaedc8defe2885c8.jpg not downloaded yet
2026-03-28 14:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_975d44a377a96d728ac089e68e946d51.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b579950>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_12c8fd66e60399d8496e2f0e933277ca.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_12c8fd66e60399d8496e2f0e933277ca.jpg saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f981199-523a-56b4-9cfd-e12194eb8559
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a94cc10>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f9ece0-6080-5402-a4bc-4816d030809d/a2f9ece0-6080-5402-a4bc-4816d030809d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa2%252F0ca23a5dd26a0a78281d47027bc8d60b%252Fpa%252FHX37636_fcc1728a5a04fc0fd3ba4fbb00694d43.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_fcc1728a5a04fc0fd3ba4fbb00694d43.jpg saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2f9ece0-6080-5402-a4bc-4816d030809d
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a95bc10>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd48de7-08ae-54a3-95ac-9e0298268f10/6cd48de7-08ae-54a3-95ac-9e0298268f10_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd6%252F3cd6a6dc273d20065c81034d6da4f8ce%252Fpa%252FPG75974_7802156a725af8e7737933ae24fbd655.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_7802156a725af8e7737933ae24fbd655.jpg saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cd48de7-08ae-54a3-95ac-9e0298268f10
2026-03-28 14:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_e00208941036525cbc4f0a961bbf9d9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_f976c1351b36195b1607ef29fc4d9ec2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a95b590>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd48de7-08ae-54a3-95ac-9e0298268f10/6cd48de7-08ae-54a3-95ac-9e0298268f10_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd6%252F3cd6a6dc273d20065c81034d6da4f8ce%252Fpa%252FPG75974_ad3365204fec526de10904869c0212dd.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_ad3365204fec526de10904869c0212dd.jpg saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cd48de7-08ae-54a3-95ac-9e0298268f10
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b306590>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_60fc92878c522d26e51a6dd7087ffc42.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_60fc92878c522d26e51a6dd7087ffc42.jpg saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f981199-523a-56b4-9cfd-e12194eb8559
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b394890>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f9ece0-6080-5402-a4bc-4816d030809d/a2f9ece0-6080-5402-a4bc-4816d030809d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa2%252F0ca23a5dd26a0a78281d47027bc8d60b%252Fpa%252FHX37636_efb7a188133dd9d1a4472d8759bcada3.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_efb7a188133dd9d1a4472d8759bcada3.jpg saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2f9ece0-6080-5402-a4bc-4816d030809d
2026-03-28 14:06:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2f9ece0-6080-5402-a4bc-4816d030809d, skipping ID generation
2026-03-28 14:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f9ece0-6080-5402-a4bc-4816d030809d with scrape type 1
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2f9ece0-6080-5402-a4bc-4816d030809d sending to next pipeline
2026-03-28 14:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a2f9ece0-6080-5402-a4bc-4816d030809d, identifier: HX37636
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a835b10>
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_975d44a377a96d728ac089e68e946d51.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_975d44a377a96d728ac089e68e946d51.jpg saved to cache
2026-03-28 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2
2026-03-28 14:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a2f9ece0-6080-5402-a4bc-4816d030809d with identifier: HX37636
2026-03-28 14:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a2f9ece0-6080-5402-a4bc-4816d030809d with identifier: HX37636
2026-03-28 14:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a2f9ece0-6080-5402-a4bc-4816d030809d with identifier: HX37636 to the API
2026-03-28 14:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_efb7a188133dd9d1a4472d8759bcada3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.9L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:07:17Z',
 'fuel_type': 'diesel',
 'id': 'a2f9ece0-6080-5402-a4bc-4816d030809d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX37636',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 287538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f9ece0-6080-5402-a4bc-4816d030809d/a2f9ece0-6080-5402-a4bc-4816d030809d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_ef6250c125c04d064faeede282831ada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f9ece0-6080-5402-a4bc-4816d030809d/a2f9ece0-6080-5402-a4bc-4816d030809d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_fcc1728a5a04fc0fd3ba4fbb00694d43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f9ece0-6080-5402-a4bc-4816d030809d/a2f9ece0-6080-5402-a4bc-4816d030809d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_56b73c30a92b738b7ce72e6301bb541c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2f9ece0-6080-5402-a4bc-4816d030809d/a2f9ece0-6080-5402-a4bc-4816d030809d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a2/0ca23a5dd26a0a78281d47027bc8d60b/pa/HX37636_efb7a188133dd9d1a4472d8759bcada3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.9 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2000}
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX37636%27 HTTP/1.1" 200 None
2026-03-28 14:06:12 [auto1.es] INFO: Saving data for HX37636: {'created_time': 1774706772.29241, 'last_price_update_time': 1774706772.29242, 'auction_closing_time': 1774883237.0}
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HX37636') HTTP/1.1" 204 0
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_b2cca31adf1b462edeb3dd368744cb0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_88c43cc49bfae485926d90323b5592f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_245253408afd4e368096dd92c976f088.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_3b68b69ba61554e2247beafdcbc47b61.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA49671> (referer: https://www.auto1.com/v1/car-details-view/DA49671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_5c08f43976e286eaf2cb96fe08623b1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4bf590>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_e00208941036525cbc4f0a961bbf9d9c.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_e00208941036525cbc4f0a961bbf9d9c.jpg saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f981199-523a-56b4-9cfd-e12194eb8559
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aaaad50>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_f976c1351b36195b1607ef29fc4d9ec2.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_f976c1351b36195b1607ef29fc4d9ec2.jpg saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644137e010>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_b2cca31adf1b462edeb3dd368744cb0b.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_b2cca31adf1b462edeb3dd368744cb0b.jpg saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 6cd48de7-08ae-54a3-95ac-9e0298268f10 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 6b6f9684-143b-5b44-953b-04fcabc753da due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9dfa90>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_88c43cc49bfae485926d90323b5592f3.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_88c43cc49bfae485926d90323b5592f3.jpg saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f981199-523a-56b4-9cfd-e12194eb8559
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa38c50>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd48de7-08ae-54a3-95ac-9e0298268f10/6cd48de7-08ae-54a3-95ac-9e0298268f10_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd6%252F3cd6a6dc273d20065c81034d6da4f8ce%252Fpa%252FPG75974_245253408afd4e368096dd92c976f088.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_245253408afd4e368096dd92c976f088.jpg saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cd48de7-08ae-54a3-95ac-9e0298268f10
2026-03-28 14:06:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cd48de7-08ae-54a3-95ac-9e0298268f10, skipping ID generation
2026-03-28 14:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd48de7-08ae-54a3-95ac-9e0298268f10 with scrape type 1
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cd48de7-08ae-54a3-95ac-9e0298268f10 sending to next pipeline
2026-03-28 14:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6cd48de7-08ae-54a3-95ac-9e0298268f10, identifier: PG75974
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aaa8b10>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_3b68b69ba61554e2247beafdcbc47b61.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_3b68b69ba61554e2247beafdcbc47b61.jpg saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f981199-523a-56b4-9cfd-e12194eb8559
2026-03-28 14:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c82b7467-3c2f-563b-86b7-de177edb1469 with identifier: DA49671
2026-03-28 14:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82b7467-3c2f-563b-86b7-de177edb1469 with scrape type 1
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c82b7467-3c2f-563b-86b7-de177edb1469
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_cd771abf730e1369654ef45e8e1a70ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_cd771abf730e1369654ef45e8e1a70ad.jpg not downloaded yet
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b440b90>
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fcc%252F59ccab4a6c75a349a501f525d4f93c3e%252Fpa%252FSL01045_5c08f43976e286eaf2cb96fe08623b1e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_5c08f43976e286eaf2cb96fe08623b1e.jpg saved to cache
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f981199-523a-56b4-9cfd-e12194eb8559
2026-03-28 14:06:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f981199-523a-56b4-9cfd-e12194eb8559, skipping ID generation
2026-03-28 14:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f981199-523a-56b4-9cfd-e12194eb8559 with scrape type 1
2026-03-28 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f981199-523a-56b4-9cfd-e12194eb8559 sending to next pipeline
2026-03-28 14:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5f981199-523a-56b4-9cfd-e12194eb8559, identifier: SL01045
2026-03-28 14:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6cd48de7-08ae-54a3-95ac-9e0298268f10 with identifier: PG75974
2026-03-28 14:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6cd48de7-08ae-54a3-95ac-9e0298268f10 with identifier: PG75974
2026-03-28 14:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6cd48de7-08ae-54a3-95ac-9e0298268f10 with identifier: PG75974 to the API
2026-03-28 14:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_245253408afd4e368096dd92c976f088.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '3.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:08:25Z',
 'fuel_type': 'diesel',
 'id': '6cd48de7-08ae-54a3-95ac-9e0298268f10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG75974',
 'listing': 'auction',
 'location': 'ES, Leganés',
 'make': 'Saab',
 'model': '9-5',
 'odometer': 216014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd48de7-08ae-54a3-95ac-9e0298268f10/6cd48de7-08ae-54a3-95ac-9e0298268f10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_eb311f270c0d28c000c7e519110f1a06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd48de7-08ae-54a3-95ac-9e0298268f10/6cd48de7-08ae-54a3-95ac-9e0298268f10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_245253408afd4e368096dd92c976f088.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd48de7-08ae-54a3-95ac-9e0298268f10/6cd48de7-08ae-54a3-95ac-9e0298268f10_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_46fd8ba8998b54b95ce861854d265b53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd48de7-08ae-54a3-95ac-9e0298268f10/6cd48de7-08ae-54a3-95ac-9e0298268f10_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_7802156a725af8e7737933ae24fbd655.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd48de7-08ae-54a3-95ac-9e0298268f10/6cd48de7-08ae-54a3-95ac-9e0298268f10_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d6/3cd6a6dc273d20065c81034d6da4f8ce/pa/PG75974_ad3365204fec526de10904869c0212dd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Saab 9-5 3.0 V6 TiD Vector',
 'transmission': 'manual',
 'trim': 'Vector',
 'year': 2002}
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG75974%27 HTTP/1.1" 200 None
2026-03-28 14:06:13 [auto1.es] INFO: Saving data for PG75974: {'created_time': 1774706773.216843, 'last_price_update_time': 1774706773.216851, 'auction_closing_time': 1774883305.0}
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PG75974') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5f981199-523a-56b4-9cfd-e12194eb8559 with identifier: SL01045
2026-03-28 14:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5f981199-523a-56b4-9cfd-e12194eb8559 with identifier: SL01045
2026-03-28 14:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5f981199-523a-56b4-9cfd-e12194eb8559 with identifier: SL01045 to the API
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_5c08f43976e286eaf2cb96fe08623b1e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:16:29Z',
 'fuel_type': 'petrol',
 'id': '5f981199-523a-56b4-9cfd-e12194eb8559',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL01045',
 'listing': 'auction',
 'location': 'ES, Alicante',
 'make': 'BMW',
 'model': '1er',
 'odometer': 107646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_4c691bf8114b269eddea53d5f556ad7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_d90e3095732f0ae259a6c70297a026f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_15bd631c6ba3b3e3c0c53bc8e186f581.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_e3d33805725e3b4d5a7b903865180f86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_5c08f43976e286eaf2cb96fe08623b1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_3b68b69ba61554e2247beafdcbc47b61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_12c8fd66e60399d8496e2f0e933277ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_e00208941036525cbc4f0a961bbf9d9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_60fc92878c522d26e51a6dd7087ffc42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f981199-523a-56b4-9cfd-e12194eb8559/5f981199-523a-56b4-9cfd-e12194eb8559_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/cc/59ccab4a6c75a349a501f525d4f93c3e/pa/SL01045_88c43cc49bfae485926d90323b5592f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL01045%27 HTTP/1.1" 200 None
2026-03-28 14:06:13 [auto1.es] INFO: Saving data for SL01045: {'created_time': 1774706773.559744, 'last_price_update_time': 1774706773.559753, 'auction_closing_time': 1774883789.0}
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SL01045') HTTP/1.1" 204 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_02f67095e86d2f4da6259977b06ac417.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_02f67095e86d2f4da6259977b06ac417.jpg not downloaded yet
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_142eb330def5c2c8bda2efbb7dc2c64e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_327199faa6280d4f110611a017903b7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_cfb53830682dd825d8815d5165b6c209.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_0159e1e6442a0788eaedc8defe2885c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_495964c84211d0a892526a62ef9d6d35.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_4d763b2e7ab2da216edc75038c0dc71d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_4d763b2e7ab2da216edc75038c0dc71d.jpg not downloaded yet
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_9c8d332ef48b6b8f56e6b13363cd7d2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_9c8d332ef48b6b8f56e6b13363cd7d2e.jpg not downloaded yet
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_35fd4e03e4ea05b86975873bb6763a4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_35fd4e03e4ea05b86975873bb6763a4b.jpg not downloaded yet
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_df330ec5fabc0c20d0168fae71106548.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_caf8c8fd8b94b0ae4344ad3e6dd083fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_3142e500ad57e7799a9cfedb7560fe55.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_3142e500ad57e7799a9cfedb7560fe55.jpg not downloaded yet
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 6b6f9684-143b-5b44-953b-04fcabc753da due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 6b6f9684-143b-5b44-953b-04fcabc753da due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_258c3c1af8410ef81bc9e22eaf749ba3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_258c3c1af8410ef81bc9e22eaf749ba3.jpg not downloaded yet
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_cd771abf730e1369654ef45e8e1a70ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_1aad60cda06d75c7c74a7aed7419adb6.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_d1fc915f36116db48b0851e4941bf133.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_d1fc915f36116db48b0851e4941bf133.jpg not downloaded yet
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b31a610>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_142eb330def5c2c8bda2efbb7dc2c64e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_142eb330def5c2c8bda2efbb7dc2c64e.jpg saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8ead10>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fae7d9-e4f0-5b33-a730-5a56b247e24a/23fae7d9-e4f0-5b33-a730-5a56b247e24a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F44%252Fed445842469d6ed01ad8c6311893dc0e%252Fpa%252FMP79118_327199faa6280d4f110611a017903b7e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_327199faa6280d4f110611a017903b7e.jpg saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23fae7d9-e4f0-5b33-a730-5a56b247e24a
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5b9b10>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_cfb53830682dd825d8815d5165b6c209.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_cfb53830682dd825d8815d5165b6c209.jpg saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5c5b10>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6f9684-143b-5b44-953b-04fcabc753da/6b6f9684-143b-5b44-953b-04fcabc753da_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F77%252Fd377d46cbca0b0f31b195bc0b71d448b%252Fpa%252FXM15498_0159e1e6442a0788eaedc8defe2885c8.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_0159e1e6442a0788eaedc8defe2885c8.jpg saved to cache
2026-03-28 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b6f9684-143b-5b44-953b-04fcabc753da
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6441666b90>
2026-03-28 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6f9684-143b-5b44-953b-04fcabc753da/6b6f9684-143b-5b44-953b-04fcabc753da_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F77%252Fd377d46cbca0b0f31b195bc0b71d448b%252Fpa%252FXM15498_495964c84211d0a892526a62ef9d6d35.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_495964c84211d0a892526a62ef9d6d35.jpg saved to cache
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b6f9684-143b-5b44-953b-04fcabc753da
2026-03-28 14:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_6ed857e00493478a50ad44a47b256a18.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_f736db56044554d8910f19d444ce9ac0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_85daefac617f32bb2b4959a609d5e6e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_d4383d08fad76e02479ac9026b303f27.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_d4383d08fad76e02479ac9026b303f27.jpg not downloaded yet
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9f58d0>
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eaa2514-e09e-5d98-aef7-b2322c9a86d5/2eaa2514-e09e-5d98-aef7-b2322c9a86d5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F4c%252F484c2e2a627cd35066986c298d6b2e2d%252Fpa%252FAH45728_df330ec5fabc0c20d0168fae71106548.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_df330ec5fabc0c20d0168fae71106548.jpg saved to cache
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2eaa2514-e09e-5d98-aef7-b2322c9a86d5
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b49dc50>
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fc8%252Fafc8f8e40190a1ec5b4985d9f11386f4%252Fpa%252FFK96312_caf8c8fd8b94b0ae4344ad3e6dd083fe.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_caf8c8fd8b94b0ae4344ad3e6dd083fe.jpg saved to cache
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1
2026-03-28 14:06:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1, skipping ID generation
2026-03-28 14:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1 with scrape type 1
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1 sending to next pipeline
2026-03-28 14:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1, identifier: FK96312
2026-03-28 14:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1 with identifier: FK96312
2026-03-28 14:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1 with identifier: FK96312
2026-03-28 14:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 46c4024d-5ff2-52c8-ab17-4aed3f8a77a1 with identifier: FK96312 to the API
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_caf8c8fd8b94b0ae4344ad3e6dd083fe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:16:05Z',
 'fuel_type': 'diesel',
 'id': '46c4024d-5ff2-52c8-ab17-4aed3f8a77a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK96312',
 'listing': 'auction',
 'location': 'ES, Girona',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 201447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_6518097b3602c8262e4215ecb98be9ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_09db5d70a54fcc43b264b55df83b72ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_caf8c8fd8b94b0ae4344ad3e6dd083fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_74b6600bba6972c94cc001616d5d737c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_164771e87296d594dd62d5fe8cf1a3d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_1901ad555958902615353b15d75295eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_7c742c46a4df50165a177cb8954a54e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46c4024d-5ff2-52c8-ab17-4aed3f8a77a1/46c4024d-5ff2-52c8-ab17-4aed3f8a77a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/c8/afc8f8e40190a1ec5b4985d9f11386f4/pa/FK96312_cb47f80aa1cd94594d9e78307b1f31b3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK96312%27 HTTP/1.1" 200 None
2026-03-28 14:06:14 [auto1.es] INFO: Saving data for FK96312: {'created_time': 1774706774.710577, 'last_price_update_time': 1774706774.710585, 'auction_closing_time': 1774883765.0}
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FK96312') HTTP/1.1" 204 0
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_2bba7eeda6de0baff71f63de0457d829.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_2bba7eeda6de0baff71f63de0457d829.jpg not downloaded yet
2026-03-28 14:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_35fd4e03e4ea05b86975873bb6763a4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_bde7ab15ff274fcb6a7e5c4232ea3c5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_84e97f4e5d0a3622ed98e445953bed0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3a8c10>
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_cd771abf730e1369654ef45e8e1a70ad.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_cd771abf730e1369654ef45e8e1a70ad.jpg saved to cache
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c82b7467-3c2f-563b-86b7-de177edb1469
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5c6990>
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fae7d9-e4f0-5b33-a730-5a56b247e24a/23fae7d9-e4f0-5b33-a730-5a56b247e24a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F44%252Fed445842469d6ed01ad8c6311893dc0e%252Fpa%252FMP79118_1aad60cda06d75c7c74a7aed7419adb6.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_1aad60cda06d75c7c74a7aed7419adb6.jpg saved to cache
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23fae7d9-e4f0-5b33-a730-5a56b247e24a
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa77650>
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F35%252Fa13564b04c723858494a65f25602af89%252Fpa%252FEB66589_6ed857e00493478a50ad44a47b256a18.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_6ed857e00493478a50ad44a47b256a18.jpg saved to cache
2026-03-28 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa74950>
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_f736db56044554d8910f19d444ce9ac0.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_f736db56044554d8910f19d444ce9ac0.jpg saved to cache
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da269d41-96d1-56e1-8ef3-f7befbf94261
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b577450>
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fae7d9-e4f0-5b33-a730-5a56b247e24a/23fae7d9-e4f0-5b33-a730-5a56b247e24a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F44%252Fed445842469d6ed01ad8c6311893dc0e%252Fpa%252FMP79118_85daefac617f32bb2b4959a609d5e6e7.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_85daefac617f32bb2b4959a609d5e6e7.jpg saved to cache
2026-03-28 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23fae7d9-e4f0-5b33-a730-5a56b247e24a
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_157ac8c9048a40446764da2b9e449344.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_89f38ae17962b4637f9d5f20b4a782f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2 with identifier: EB66589
2026-03-28 14:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2 with identifier: EB66589
2026-03-28 14:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2 with identifier: EB66589 to the API
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:15 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:30:06Z',
 'fuel_type': 'diesel',
 'id': '0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB66589',
 'listing': 'auction',
 'location': 'ES, Xirivella, Valencia.',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 124340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_62d709d2e4fc2c7a3177ac00b3050ca0.jpg',
                'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_975d44a377a96d728ac089e68e946d51.jpg',
                'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_11dbaf6c744ebb10f9a944d6156fe60c.jpg',
                'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_f976c1351b36195b1607ef29fc4d9ec2.jpg',
                'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_b2cca31adf1b462edeb3dd368744cb0b.jpg',
                'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_da611e3bb5ce2a5263c9a9a265512d59.jpg',
                'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_6ed857e00493478a50ad44a47b256a18.jpg',
                'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_22e0e27acf8d8932a158428ceb4d6d0b.jpg',
                'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_142eb330def5c2c8bda2efbb7dc2c64e.jpg',
                'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_cfb53830682dd825d8815d5165b6c209.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_62d709d2e4fc2c7a3177ac00b3050ca0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_975d44a377a96d728ac089e68e946d51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_f976c1351b36195b1607ef29fc4d9ec2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_b2cca31adf1b462edeb3dd368744cb0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_6ed857e00493478a50ad44a47b256a18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_142eb330def5c2c8bda2efbb7dc2c64e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2/0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/35/a13564b04c723858494a65f25602af89/pa/EB66589_cfb53830682dd825d8815d5165b6c209.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB66589%27 HTTP/1.1" 200 None
2026-03-28 14:06:15 [auto1.es] INFO: Saving data for EB66589: {'created_time': 1774706775.476957, 'last_price_update_time': 1774706775.476965, 'auction_closing_time': 1774884606.0}
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EB66589') HTTP/1.1" 204 0
2026-03-28 14:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2eaa2514-e09e-5d98-aef7-b2322c9a86d5 with identifier: AH45728
2026-03-28 14:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2eaa2514-e09e-5d98-aef7-b2322c9a86d5 with identifier: AH45728
2026-03-28 14:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2eaa2514-e09e-5d98-aef7-b2322c9a86d5 with identifier: AH45728 to the API
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:15 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:01Z',
 'fuel_type': 'petrol',
 'id': '2eaa2514-e09e-5d98-aef7-b2322c9a86d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH45728',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Subaru',
 'model': 'Impreza',
 'odometer': 335238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_df330ec5fabc0c20d0168fae71106548.jpg',
                'https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_d32c7ddd34c778c5dd8da3bc64a6e1d2.jpg',
                'https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_317619d315f65ea8486664dc8a98cb23.jpg',
                'https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_fa2fdba96335245ae702278674efb16a.jpg',
                'https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_910dccca7dfd90385812995c3f36ecd2.jpg',
                'https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_7eb2c2a4ed156ba407babd712156a801.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eaa2514-e09e-5d98-aef7-b2322c9a86d5/2eaa2514-e09e-5d98-aef7-b2322c9a86d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_df330ec5fabc0c20d0168fae71106548.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eaa2514-e09e-5d98-aef7-b2322c9a86d5/2eaa2514-e09e-5d98-aef7-b2322c9a86d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_fa2fdba96335245ae702278674efb16a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eaa2514-e09e-5d98-aef7-b2322c9a86d5/2eaa2514-e09e-5d98-aef7-b2322c9a86d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_910dccca7dfd90385812995c3f36ecd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eaa2514-e09e-5d98-aef7-b2322c9a86d5/2eaa2514-e09e-5d98-aef7-b2322c9a86d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/4c/484c2e2a627cd35066986c298d6b2e2d/pa/AH45728_7eb2c2a4ed156ba407babd712156a801.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru Impreza 2.0 Limited Plus',
 'transmission': 'manual',
 'trim': 'Limited Plus',
 'year': 2008}
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH45728%27 HTTP/1.1" 200 None
2026-03-28 14:06:15 [auto1.es] INFO: Saving data for AH45728: {'created_time': 1774706775.885684, 'last_price_update_time': 1774706775.885692, 'auction_closing_time': 1774884661.0}
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AH45728') HTTP/1.1" 204 0
2026-03-28 14:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b6f9684-143b-5b44-953b-04fcabc753da with identifier: XM15498
2026-03-28 14:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b6f9684-143b-5b44-953b-04fcabc753da with identifier: XM15498
2026-03-28 14:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b6f9684-143b-5b44-953b-04fcabc753da with identifier: XM15498 to the API
2026-03-28 14:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:16 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:09:27Z',
 'fuel_type': 'petrol',
 'id': '6b6f9684-143b-5b44-953b-04fcabc753da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM15498',
 'listing': 'auction',
 'location': 'ES, Collado Villalba, Madrid',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 136759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_cc01a2a058c326e484569dcb9b9aefca.jpg',
                'https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_c349e6b6caed92a127ce7b9f41f7f547.jpg',
                'https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_495964c84211d0a892526a62ef9d6d35.jpg',
                'https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_fe71999fd0c5a01d90bd0ba345e9fc74.jpg',
                'https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_b0d15ff69cc30bd5e69db35dfc574438.jpg',
                'https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_0159e1e6442a0788eaedc8defe2885c8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6f9684-143b-5b44-953b-04fcabc753da/6b6f9684-143b-5b44-953b-04fcabc753da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_495964c84211d0a892526a62ef9d6d35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6f9684-143b-5b44-953b-04fcabc753da/6b6f9684-143b-5b44-953b-04fcabc753da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/77/d377d46cbca0b0f31b195bc0b71d448b/pa/XM15498_0159e1e6442a0788eaedc8defe2885c8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM15498%27 HTTP/1.1" 200 None
2026-03-28 14:06:16 [auto1.es] INFO: Saving data for XM15498: {'created_time': 1774706776.295871, 'last_price_update_time': 1774706776.29588, 'auction_closing_time': 1774883367.0}
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XM15498') HTTP/1.1" 204 0
2026-03-28 14:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_d4383d08fad76e02479ac9026b303f27.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_02f67095e86d2f4da6259977b06ac417.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_4d763b2e7ab2da216edc75038c0dc71d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_9c8d332ef48b6b8f56e6b13363cd7d2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 0c7f9f45-aaed-5949-b1c6-9c8eaf647bf2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 2eaa2514-e09e-5d98-aef7-b2322c9a86d5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 6b6f9684-143b-5b44-953b-04fcabc753da due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a897690>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_35fd4e03e4ea05b86975873bb6763a4b.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_35fd4e03e4ea05b86975873bb6763a4b.jpg saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c82b7467-3c2f-563b-86b7-de177edb1469
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a84e2d0>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23fae7d9-e4f0-5b33-a730-5a56b247e24a/23fae7d9-e4f0-5b33-a730-5a56b247e24a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F44%252Fed445842469d6ed01ad8c6311893dc0e%252Fpa%252FMP79118_bde7ab15ff274fcb6a7e5c4232ea3c5e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_bde7ab15ff274fcb6a7e5c4232ea3c5e.jpg saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23fae7d9-e4f0-5b33-a730-5a56b247e24a
2026-03-28 14:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23fae7d9-e4f0-5b33-a730-5a56b247e24a, skipping ID generation
2026-03-28 14:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23fae7d9-e4f0-5b33-a730-5a56b247e24a with scrape type 1
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23fae7d9-e4f0-5b33-a730-5a56b247e24a sending to next pipeline
2026-03-28 14:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 23fae7d9-e4f0-5b33-a730-5a56b247e24a, identifier: MP79118
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a84ed90>
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fca%252F3dcae7ec11c6407bcec20adfb3a5473e%252Fpa%252FWA68428_84e97f4e5d0a3622ed98e445953bed0a.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_84e97f4e5d0a3622ed98e445953bed0a.jpg saved to cache
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ece4fdf-4d75-58e2-a851-c05372824479
2026-03-28 14:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ece4fdf-4d75-58e2-a851-c05372824479, skipping ID generation
2026-03-28 14:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ece4fdf-4d75-58e2-a851-c05372824479 with scrape type 1
2026-03-28 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ece4fdf-4d75-58e2-a851-c05372824479 sending to next pipeline
2026-03-28 14:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0ece4fdf-4d75-58e2-a851-c05372824479, identifier: WA68428
2026-03-28 14:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK81773> (referer: https://www.auto1.com/v1/car-details-view/WK81773/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH57787> (referer: https://www.auto1.com/v1/car-details-view/GH57787/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 23fae7d9-e4f0-5b33-a730-5a56b247e24a with identifier: MP79118
2026-03-28 14:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 23fae7d9-e4f0-5b33-a730-5a56b247e24a with identifier: MP79118
2026-03-28 14:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 23fae7d9-e4f0-5b33-a730-5a56b247e24a with identifier: MP79118 to the API
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_bde7ab15ff274fcb6a7e5c4232ea3c5e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:55:14Z',
 'fuel_type': 'petrol',
 'id': '23fae7d9-e4f0-5b33-a730-5a56b247e24a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP79118',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Lancia',
 'model': 'Lancia Y',
 'odometer': 132951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fae7d9-e4f0-5b33-a730-5a56b247e24a/23fae7d9-e4f0-5b33-a730-5a56b247e24a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_38a141e885a41fc4c817fa2b41410e19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fae7d9-e4f0-5b33-a730-5a56b247e24a/23fae7d9-e4f0-5b33-a730-5a56b247e24a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_bde7ab15ff274fcb6a7e5c4232ea3c5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fae7d9-e4f0-5b33-a730-5a56b247e24a/23fae7d9-e4f0-5b33-a730-5a56b247e24a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_85daefac617f32bb2b4959a609d5e6e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fae7d9-e4f0-5b33-a730-5a56b247e24a/23fae7d9-e4f0-5b33-a730-5a56b247e24a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_1aad60cda06d75c7c74a7aed7419adb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23fae7d9-e4f0-5b33-a730-5a56b247e24a/23fae7d9-e4f0-5b33-a730-5a56b247e24a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/44/ed445842469d6ed01ad8c6311893dc0e/pa/MP79118_327199faa6280d4f110611a017903b7e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Lancia Y 1.2 Elefantino Blu',
 'transmission': 'manual',
 'trim': 'Elefantino Blu',
 'year': 2002}
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP79118%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [auto1.es] INFO: Saving data for MP79118: {'created_time': 1774706777.012778, 'last_price_update_time': 1774706777.012787, 'auction_closing_time': 1774886114.0}
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MP79118') HTTP/1.1" 204 0
2026-03-28 14:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0ece4fdf-4d75-58e2-a851-c05372824479 with identifier: WA68428
2026-03-28 14:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0ece4fdf-4d75-58e2-a851-c05372824479 with identifier: WA68428
2026-03-28 14:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0ece4fdf-4d75-58e2-a851-c05372824479 with identifier: WA68428 to the API
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_84e97f4e5d0a3622ed98e445953bed0a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:01:40Z',
 'fuel_type': 'diesel',
 'id': '0ece4fdf-4d75-58e2-a851-c05372824479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA68428',
 'listing': 'auction',
 'location': 'ES, Viladecans,Barcelona',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 224991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_3c77cef6e787544c0745c2e78cf969f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_33e5bc7ee75f90a2710f05800d24bbac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_da079c52ebbd55e2eba33c088a338bc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_04bf37d66fc89aaec7831996c1930de3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_0cced74382a8a81cfed7a5881192def3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_a3a0424dd7b8b53b2731e26f32679768.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_ba56ee0019e4b438f12a180cf94f34e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_c7b373c1f8646b76904b1ff572b4e5a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ece4fdf-4d75-58e2-a851-c05372824479/0ece4fdf-4d75-58e2-a851-c05372824479_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/ca/3dcae7ec11c6407bcec20adfb3a5473e/pa/WA68428_84e97f4e5d0a3622ed98e445953bed0a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA68428%27 HTTP/1.1" 200 None
2026-03-28 14:06:17 [auto1.es] INFO: Saving data for WA68428: {'created_time': 1774706777.516631, 'last_price_update_time': 1774706777.51664, 'auction_closing_time': 1774882900.0}
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WA68428') HTTP/1.1" 204 0
2026-03-28 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_2bba7eeda6de0baff71f63de0457d829.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9ec590>
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F1c%252F011c737effd00e49c3a1f71a3eaaf90e%252Fpa%252FZJ73246_157ac8c9048a40446764da2b9e449344.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_157ac8c9048a40446764da2b9e449344.jpg saved to cache
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da269d41-96d1-56e1-8ef3-f7befbf94261
2026-03-28 14:06:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da269d41-96d1-56e1-8ef3-f7befbf94261, skipping ID generation
2026-03-28 14:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da269d41-96d1-56e1-8ef3-f7befbf94261 with scrape type 1
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da269d41-96d1-56e1-8ef3-f7befbf94261 sending to next pipeline
2026-03-28 14:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: da269d41-96d1-56e1-8ef3-f7befbf94261, identifier: ZJ73246
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8da590>
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73793c72-1acd-5751-ae54-5a311a6628de/73793c72-1acd-5751-ae54-5a311a6628de_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff8%252Fc5f8c6c1084d6dca240d9b761ec7f2fe%252Fpa%252FDM23337_89f38ae17962b4637f9d5f20b4a782f9.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_89f38ae17962b4637f9d5f20b4a782f9.jpg saved to cache
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73793c72-1acd-5751-ae54-5a311a6628de
2026-03-28 14:06:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73793c72-1acd-5751-ae54-5a311a6628de, skipping ID generation
2026-03-28 14:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73793c72-1acd-5751-ae54-5a311a6628de with scrape type 1
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73793c72-1acd-5751-ae54-5a311a6628de sending to next pipeline
2026-03-28 14:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73793c72-1acd-5751-ae54-5a311a6628de, identifier: DM23337
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa3b490>
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_d4383d08fad76e02479ac9026b303f27.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_d4383d08fad76e02479ac9026b303f27.jpg saved to cache
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c82b7467-3c2f-563b-86b7-de177edb1469
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa20650>
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_02f67095e86d2f4da6259977b06ac417.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_02f67095e86d2f4da6259977b06ac417.jpg saved to cache
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c82b7467-3c2f-563b-86b7-de177edb1469
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3b3a90>
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_4d763b2e7ab2da216edc75038c0dc71d.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_4d763b2e7ab2da216edc75038c0dc71d.jpg saved to cache
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c82b7467-3c2f-563b-86b7-de177edb1469
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644135bb10>
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_9c8d332ef48b6b8f56e6b13363cd7d2e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_9c8d332ef48b6b8f56e6b13363cd7d2e.jpg saved to cache
2026-03-28 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c82b7467-3c2f-563b-86b7-de177edb1469
2026-03-28 14:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: da269d41-96d1-56e1-8ef3-f7befbf94261 with identifier: ZJ73246
2026-03-28 14:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: da269d41-96d1-56e1-8ef3-f7befbf94261 with identifier: ZJ73246
2026-03-28 14:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: da269d41-96d1-56e1-8ef3-f7befbf94261 with identifier: ZJ73246 to the API
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_157ac8c9048a40446764da2b9e449344.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:33:07Z',
 'fuel_type': 'diesel',
 'id': 'da269d41-96d1-56e1-8ef3-f7befbf94261',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ73246',
 'listing': 'auction',
 'location': 'ES, Oiartzun',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 202455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_1f4f9f81aa282e532c5d9933f1206e80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_f5af98e90cd796a8eb9bd50519e0e920.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_56d00e0a1b387061663f829fd0b6125f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_89e94b005bf276258d2ebe607426f507.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_157ac8c9048a40446764da2b9e449344.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_38ba07a2ad3ecbfd047b30ab3da17a09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_f79d3e96afd00a9ab158b3446918caba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_f736db56044554d8910f19d444ce9ac0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da269d41-96d1-56e1-8ef3-f7befbf94261/da269d41-96d1-56e1-8ef3-f7befbf94261_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/1c/011c737effd00e49c3a1f71a3eaaf90e/pa/ZJ73246_346cc7ffa29418f84c9cf272fb25f3d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTD BlueMotion Tech',
 'year': 2014}
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ73246%27 HTTP/1.1" 200 None
2026-03-28 14:06:18 [auto1.es] INFO: Saving data for ZJ73246: {'created_time': 1774706778.311978, 'last_price_update_time': 1774706778.311989, 'auction_closing_time': 1774884787.0}
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZJ73246') HTTP/1.1" 204 0
2026-03-28 14:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73793c72-1acd-5751-ae54-5a311a6628de with identifier: DM23337
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 14:06:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73793c72-1acd-5751-ae54-5a311a6628de with identifier: DM23337
2026-03-28 14:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73793c72-1acd-5751-ae54-5a311a6628de with identifier: DM23337 to the API
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_89f38ae17962b4637f9d5f20b4a782f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '2.2L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:38:01Z',
 'fuel_type': 'diesel',
 'id': '73793c72-1acd-5751-ae54-5a311a6628de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM23337',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Nissan',
 'model': 'Almera',
 'odometer': 118948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73793c72-1acd-5751-ae54-5a311a6628de/73793c72-1acd-5751-ae54-5a311a6628de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_89f38ae17962b4637f9d5f20b4a782f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73793c72-1acd-5751-ae54-5a311a6628de/73793c72-1acd-5751-ae54-5a311a6628de_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_4f6269988b5fa58d7bafb26160411b1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73793c72-1acd-5751-ae54-5a311a6628de/73793c72-1acd-5751-ae54-5a311a6628de_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_5b0518334dbaccc38c70dc64337e4300.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73793c72-1acd-5751-ae54-5a311a6628de/73793c72-1acd-5751-ae54-5a311a6628de_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_d548bb1ebfb67547618f138c2c0a5474.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73793c72-1acd-5751-ae54-5a311a6628de/73793c72-1acd-5751-ae54-5a311a6628de_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_7052b5100d9ad62980f6ba118dd79818.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73793c72-1acd-5751-ae54-5a311a6628de/73793c72-1acd-5751-ae54-5a311a6628de_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f8/c5f8c6c1084d6dca240d9b761ec7f2fe/pa/DM23337_4cdf35a2e3d16ebf3722559dc58d39a4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Almera 2.2 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2004}
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM23337%27 HTTP/1.1" 200 None
2026-03-28 14:06:18 [auto1.es] INFO: Saving data for DM23337: {'created_time': 1774706778.842496, 'last_price_update_time': 1774706778.842508, 'auction_closing_time': 1774885081.0}
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DM23337') HTTP/1.1" 204 0
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item c82b7467-3c2f-563b-86b7-de177edb1469 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item c82b7467-3c2f-563b-86b7-de177edb1469 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item c82b7467-3c2f-563b-86b7-de177edb1469 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e with identifier: WK81773
2026-03-28 14:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e with scrape type 1
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_c88aeccd400b4280bbbafb78faea089e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_c88aeccd400b4280bbbafb78faea089e.jpg not downloaded yet
2026-03-28 14:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d with identifier: GH57787
2026-03-28 14:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d with scrape type 1
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_fde17b7d4b94e68e6d3c9018165c9a79.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_fde17b7d4b94e68e6d3c9018165c9a79.jpg not downloaded yet
2026-03-28 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH94228> (referer: https://www.auto1.com/v1/car-details-view/TH94228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG71405/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX27064> (referer: https://www.auto1.com/v1/car-details-view/BX27064/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV42226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB51566> (referer: https://www.auto1.com/v1/car-details-view/DB51566/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b572d10>
2026-03-28 14:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F39%252F3039843ac476a5da8a0450e82f29709c%252Fpa%252FDA49671_2bba7eeda6de0baff71f63de0457d829.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_2bba7eeda6de0baff71f63de0457d829.jpg saved to cache
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c82b7467-3c2f-563b-86b7-de177edb1469
2026-03-28 14:06:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c82b7467-3c2f-563b-86b7-de177edb1469, skipping ID generation
2026-03-28 14:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82b7467-3c2f-563b-86b7-de177edb1469 with scrape type 1
2026-03-28 14:06:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c82b7467-3c2f-563b-86b7-de177edb1469 sending to next pipeline
2026-03-28 14:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c82b7467-3c2f-563b-86b7-de177edb1469, identifier: DA49671
2026-03-28 14:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_d59a2e7950810d13a375989c2e8363f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_d59a2e7950810d13a375989c2e8363f4.jpg not downloaded yet
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_9235863f01e136a24f540e5e485b0b3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_9235863f01e136a24f540e5e485b0b3a.jpg not downloaded yet
2026-03-28 14:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c82b7467-3c2f-563b-86b7-de177edb1469 with identifier: DA49671
2026-03-28 14:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c82b7467-3c2f-563b-86b7-de177edb1469 with identifier: DA49671
2026-03-28 14:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c82b7467-3c2f-563b-86b7-de177edb1469 with identifier: DA49671 to the API
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_2bba7eeda6de0baff71f63de0457d829.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 103,
 'expiration_date': '2026-03-30T15:26:30Z',
 'fuel_type': 'diesel',
 'id': 'c82b7467-3c2f-563b-86b7-de177edb1469',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA49671',
 'listing': 'auction',
 'location': 'ES, Cornellà de Llobregat',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 70710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59317,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_cd771abf730e1369654ef45e8e1a70ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55768,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_02f67095e86d2f4da6259977b06ac417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56348,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_4d763b2e7ab2da216edc75038c0dc71d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55925,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_9c8d332ef48b6b8f56e6b13363cd7d2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50062,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_35fd4e03e4ea05b86975873bb6763a4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54908,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_d4383d08fad76e02479ac9026b303f27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82b7467-3c2f-563b-86b7-de177edb1469/c82b7467-3c2f-563b-86b7-de177edb1469_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/39/3039843ac476a5da8a0450e82f29709c/pa/DA49671_2bba7eeda6de0baff71f63de0457d829.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Confort Dynamique',
 'transmission': 'manual',
 'trim': 'Confort Dynamique',
 'year': 2008}
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA49671%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [auto1.es] INFO: Saving data for DA49671: {'created_time': 1774706779.492233, 'last_price_update_time': 1774706779.492242, 'auction_closing_time': 1774884390.0}
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DA49671') HTTP/1.1" 204 0
2026-03-28 14:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_bb307ba36d85fd8585ff507156110d8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_a09a797ba273e78c7714eb69a0191707.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_f2a057a1c0b08694c25ac19c27079d6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_f2a057a1c0b08694c25ac19c27079d6c.jpg not downloaded yet
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_607f4e0bde0ddf859bfa8735b20e7a0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_607f4e0bde0ddf859bfa8735b20e7a0c.jpg not downloaded yet
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_ce896afaf48890f044daded311357865.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_ce896afaf48890f044daded311357865.jpg not downloaded yet
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_161f8c878b2c5ab1029ac0a126dcf45e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_161f8c878b2c5ab1029ac0a126dcf45e.jpg not downloaded yet
2026-03-28 14:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667b72e0-138a-5cab-a097-2dc55ca52e89 with identifier: TH94228
2026-03-28 14:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667b72e0-138a-5cab-a097-2dc55ca52e89 with scrape type 1
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 667b72e0-138a-5cab-a097-2dc55ca52e89
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa2928b334a759d57639545bc76b5b5%252Fpa%252FTH94228_0c04a012919ecfcf38072eee61111afc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_0c04a012919ecfcf38072eee61111afc.jpg not downloaded yet
2026-03-28 14:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 508912fa-4d34-5727-afb5-2d6561316dcf with identifier: BX27064
2026-03-28 14:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 508912fa-4d34-5727-afb5-2d6561316dcf with scrape type 1
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 508912fa-4d34-5727-afb5-2d6561316dcf
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F3106db1a23bc3e54adf31e05a87c5114%252Fpa%252FBX27064_dab3b6dc9385190c97aee7635578aef2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_dab3b6dc9385190c97aee7635578aef2.jpg not downloaded yet
2026-03-28 14:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bf8d8be-0161-5a79-9163-550011ebadd8 with identifier: DB51566
2026-03-28 14:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bf8d8be-0161-5a79-9163-550011ebadd8 with scrape type 1
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5bf8d8be-0161-5a79-9163-550011ebadd8
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F34%252F6934b827aee173313c6822c49b350831%252Fpa%252FDB51566_6e285f1d590561a94bb04c622f2b5cee.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_6e285f1d590561a94bb04c622f2b5cee.jpg already downloaded
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F34%252F6934b827aee173313c6822c49b350831%252Fpa%252FDB51566_ab3d51eddaff67d29bdc5f0be50797fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_ab3d51eddaff67d29bdc5f0be50797fc.jpg already downloaded
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F34%252F6934b827aee173313c6822c49b350831%252Fpa%252FDB51566_50bb8fba3a4ec0ee684f36af9ea23c31.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_50bb8fba3a4ec0ee684f36af9ea23c31.jpg already downloaded
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F34%252F6934b827aee173313c6822c49b350831%252Fpa%252FDB51566_6a395d990748cde2c136edc96d18daa0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_6a395d990748cde2c136edc96d18daa0.jpg already downloaded
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F34%252F6934b827aee173313c6822c49b350831%252Fpa%252FDB51566_a0825108f762bacf024dde88ff45b78a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_a0825108f762bacf024dde88ff45b78a.jpg already downloaded
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F34%252F6934b827aee173313c6822c49b350831%252Fpa%252FDB51566_41f9ffba335eec894257e028da6644df.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_41f9ffba335eec894257e028da6644df.jpg already downloaded
2026-03-28 14:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5bf8d8be-0161-5a79-9163-550011ebadd8, identifier: DB51566
2026-03-28 14:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5bf8d8be-0161-5a79-9163-550011ebadd8 with identifier: DB51566
2026-03-28 14:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5bf8d8be-0161-5a79-9163-550011ebadd8 with identifier: DB51566
2026-03-28 14:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5bf8d8be-0161-5a79-9163-550011ebadd8 with identifier: DB51566 to the API
2026-03-28 14:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DB51566>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:40:30Z',
 'fuel_type': 'diesel',
 'id': '5bf8d8be-0161-5a79-9163-550011ebadd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB51566',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 201005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_6e285f1d590561a94bb04c622f2b5cee.jpg',
                'https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_ab3d51eddaff67d29bdc5f0be50797fc.jpg',
                'https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_50bb8fba3a4ec0ee684f36af9ea23c31.jpg',
                'https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_6a395d990748cde2c136edc96d18daa0.jpg',
                'https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_a0825108f762bacf024dde88ff45b78a.jpg',
                'https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_41f9ffba335eec894257e028da6644df.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf8d8be-0161-5a79-9163-550011ebadd8/5bf8d8be-0161-5a79-9163-550011ebadd8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_6e285f1d590561a94bb04c622f2b5cee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf8d8be-0161-5a79-9163-550011ebadd8/5bf8d8be-0161-5a79-9163-550011ebadd8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_ab3d51eddaff67d29bdc5f0be50797fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf8d8be-0161-5a79-9163-550011ebadd8/5bf8d8be-0161-5a79-9163-550011ebadd8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_50bb8fba3a4ec0ee684f36af9ea23c31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf8d8be-0161-5a79-9163-550011ebadd8/5bf8d8be-0161-5a79-9163-550011ebadd8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_6a395d990748cde2c136edc96d18daa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf8d8be-0161-5a79-9163-550011ebadd8/5bf8d8be-0161-5a79-9163-550011ebadd8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_a0825108f762bacf024dde88ff45b78a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf8d8be-0161-5a79-9163-550011ebadd8/5bf8d8be-0161-5a79-9163-550011ebadd8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/34/6934b827aee173313c6822c49b350831/pa/DB51566_41f9ffba335eec894257e028da6644df.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.2 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2005}
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB51566%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [auto1.es] INFO: Saving data for DB51566: {'created_time': 1774706780.183254, 'last_price_update_time': 1774706780.183265, 'auction_closing_time': 1774885230.0}
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DB51566') HTTP/1.1" 204 0
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_460594c7c400dff6093ce569dd54f7a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_460594c7c400dff6093ce569dd54f7a4.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_e81293a5d222d792081d7a368169d03b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_e81293a5d222d792081d7a368169d03b.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa2928b334a759d57639545bc76b5b5%252Fpa%252FTH94228_b4fa0aaa9d2cb4c2534712baeeb43f44.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_b4fa0aaa9d2cb4c2534712baeeb43f44.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F3106db1a23bc3e54adf31e05a87c5114%252Fpa%252FBX27064_62c66619b0dcf1277f9ab5c0b58a875c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_62c66619b0dcf1277f9ab5c0b58a875c.jpg not downloaded yet
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_c88aeccd400b4280bbbafb78faea089e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_09ecea910c3dd3611790fe806fb1de2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_c90718d2a73eaa8cb10b1c430fc24337.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_fde17b7d4b94e68e6d3c9018165c9a79.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_b0524fef9cfd2b3c5b2c8797ca6bfa93.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_1243d2a3a9452110030516f39f744f83.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_1243d2a3a9452110030516f39f744f83.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_341983434ba1cd48ed6985ed45bec1c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_341983434ba1cd48ed6985ed45bec1c7.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa2928b334a759d57639545bc76b5b5%252Fpa%252FTH94228_52b175cc5aee6ea4be446f27ef034cee.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_52b175cc5aee6ea4be446f27ef034cee.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F3106db1a23bc3e54adf31e05a87c5114%252Fpa%252FBX27064_7182b81f6b96d43d2a085b3b16a57edb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_7182b81f6b96d43d2a085b3b16a57edb.jpg not downloaded yet
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a89be50>
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_bb307ba36d85fd8585ff507156110d8a.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_bb307ba36d85fd8585ff507156110d8a.jpg saved to cache
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53e2b045-f68f-5fe4-8689-10549b8f0546
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a980350>
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_a09a797ba273e78c7714eb69a0191707.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_a09a797ba273e78c7714eb69a0191707.jpg saved to cache
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53e2b045-f68f-5fe4-8689-10549b8f0546
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_a72e345fe2f55ebbc267fd61d4fc1be3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_a72e345fe2f55ebbc267fd61d4fc1be3.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_0646feaea376541f1e21dcdc246a8116.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_0646feaea376541f1e21dcdc246a8116.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa2928b334a759d57639545bc76b5b5%252Fpa%252FTH94228_934fc2051c5242f6896968398f79687e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_934fc2051c5242f6896968398f79687e.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F3106db1a23bc3e54adf31e05a87c5114%252Fpa%252FBX27064_12764edfed67a996ac8f8cf734a87f74.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_12764edfed67a996ac8f8cf734a87f74.jpg not downloaded yet
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE13816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE25443> (referer: https://www.auto1.com/v1/car-details-view/CE25443/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b587c50>
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_c88aeccd400b4280bbbafb78faea089e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_c88aeccd400b4280bbbafb78faea089e.jpg saved to cache
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a899d10>
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_09ecea910c3dd3611790fe806fb1de2c.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_09ecea910c3dd3611790fe806fb1de2c.jpg saved to cache
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53e2b045-f68f-5fe4-8689-10549b8f0546
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a958410>
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_c90718d2a73eaa8cb10b1c430fc24337.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_c90718d2a73eaa8cb10b1c430fc24337.jpg saved to cache
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53e2b045-f68f-5fe4-8689-10549b8f0546
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8154d0>
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_fde17b7d4b94e68e6d3c9018165c9a79.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_fde17b7d4b94e68e6d3c9018165c9a79.jpg saved to cache
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b424510>
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_b0524fef9cfd2b3c5b2c8797ca6bfa93.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_b0524fef9cfd2b3c5b2c8797ca6bfa93.jpg saved to cache
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53e2b045-f68f-5fe4-8689-10549b8f0546
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_460594c7c400dff6093ce569dd54f7a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_69f547a84a866945272c8710c31669c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_69f547a84a866945272c8710c31669c1.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_06da0a65fd21eaacbac11124a0f0b0ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_06da0a65fd21eaacbac11124a0f0b0ed.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa2928b334a759d57639545bc76b5b5%252Fpa%252FTH94228_d4a361b2e732b133c67d24600ed55b5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_d4a361b2e732b133c67d24600ed55b5d.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F3106db1a23bc3e54adf31e05a87c5114%252Fpa%252FBX27064_862855d0de18a08f12c51bc0b05ca812.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_862855d0de18a08f12c51bc0b05ca812.jpg not downloaded yet
2026-03-28 14:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_e81293a5d222d792081d7a368169d03b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_62c66619b0dcf1277f9ab5c0b58a875c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_b4fa0aaa9d2cb4c2534712baeeb43f44.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_326c81077e5c6e5d75f71e2fee555b3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_326c81077e5c6e5d75f71e2fee555b3a.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_d140bb00abc7a77bdb603ef3ee6cf50c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_d140bb00abc7a77bdb603ef3ee6cf50c.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa2928b334a759d57639545bc76b5b5%252Fpa%252FTH94228_daeadb28f83cfb90669ae7fe3244f706.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_daeadb28f83cfb90669ae7fe3244f706.jpg not downloaded yet
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F3106db1a23bc3e54adf31e05a87c5114%252Fpa%252FBX27064_644e964b0aee7fb0e4c8419b045d2548.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_644e964b0aee7fb0e4c8419b045d2548.jpg not downloaded yet
2026-03-28 14:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5fb6797-d8e0-5fb0-825f-e9e3b87504b4 with identifier: CE25443
2026-03-28 14:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4 with scrape type 1
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_904846b5667f882bcf3d7b417489a5cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_904846b5667f882bcf3d7b417489a5cb.jpg not downloaded yet
2026-03-28 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_12764edfed67a996ac8f8cf734a87f74.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_f829242a09d048b5f0eae98978f2e4cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_f829242a09d048b5f0eae98978f2e4cb.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_881c41d980312cbc98c7e6b8031e4ecb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_881c41d980312cbc98c7e6b8031e4ecb.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_d5955a5ec18e3d38d037bc6290dd1e7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_d5955a5ec18e3d38d037bc6290dd1e7e.jpg not downloaded yet
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a81ecd0>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_460594c7c400dff6093ce569dd54f7a4.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_460594c7c400dff6093ce569dd54f7a4.jpg saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9da3d0>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_e81293a5d222d792081d7a368169d03b.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_e81293a5d222d792081d7a368169d03b.jpg saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 53e2b045-f68f-5fe4-8689-10549b8f0546 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_268d46034486cda219eb38a639de53fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_268d46034486cda219eb38a639de53fe.jpg not downloaded yet
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB02091> (referer: https://www.auto1.com/v1/car-details-view/KB02091/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW66330> (referer: https://www.auto1.com/v1/car-details-view/MW66330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW43134> (referer: https://www.auto1.com/v1/car-details-view/TW43134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE38757/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA27330> (referer: https://www.auto1.com/v1/car-details-view/YA27330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a84ed10>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_508912fa-4d34-5727-afb5-2d6561316dcf/508912fa-4d34-5727-afb5-2d6561316dcf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F3106db1a23bc3e54adf31e05a87c5114%252Fpa%252FBX27064_62c66619b0dcf1277f9ab5c0b58a875c.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_62c66619b0dcf1277f9ab5c0b58a875c.jpg saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 508912fa-4d34-5727-afb5-2d6561316dcf
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b30a590>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667b72e0-138a-5cab-a097-2dc55ca52e89/667b72e0-138a-5cab-a097-2dc55ca52e89_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa2928b334a759d57639545bc76b5b5%252Fpa%252FTH94228_b4fa0aaa9d2cb4c2534712baeeb43f44.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_b4fa0aaa9d2cb4c2534712baeeb43f44.jpg saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 667b72e0-138a-5cab-a097-2dc55ca52e89
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_a72e345fe2f55ebbc267fd61d4fc1be3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_934fc2051c5242f6896968398f79687e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_db649ba61dc9bf7243e48d9139a7265f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_db649ba61dc9bf7243e48d9139a7265f.jpg not downloaded yet
2026-03-28 14:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6442f5e450>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_508912fa-4d34-5727-afb5-2d6561316dcf/508912fa-4d34-5727-afb5-2d6561316dcf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F3106db1a23bc3e54adf31e05a87c5114%252Fpa%252FBX27064_12764edfed67a996ac8f8cf734a87f74.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_12764edfed67a996ac8f8cf734a87f74.jpg saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 508912fa-4d34-5727-afb5-2d6561316dcf
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_862855d0de18a08f12c51bc0b05ca812.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_d4a361b2e732b133c67d24600ed55b5d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_904846b5667f882bcf3d7b417489a5cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_d92ac25c152b901404124c16099bc557.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_d92ac25c152b901404124c16099bc557.jpg not downloaded yet
2026-03-28 14:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a86939b3-f580-59a3-a47f-16a7bd6b1138 with identifier: KB02091
2026-03-28 14:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86939b3-f580-59a3-a47f-16a7bd6b1138 with scrape type 1
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a86939b3-f580-59a3-a47f-16a7bd6b1138
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_933ec7f75ae4aca9a516d20ad789b885.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_933ec7f75ae4aca9a516d20ad789b885.jpg not downloaded yet
2026-03-28 14:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99944ff7-2ab3-5c36-bcd5-43b9057384e4 with identifier: MW66330
2026-03-28 14:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99944ff7-2ab3-5c36-bcd5-43b9057384e4 with scrape type 1
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 99944ff7-2ab3-5c36-bcd5-43b9057384e4
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F70%252F7b707fa5443046ec828cb2fd94bab5da%252Fpa%252FMW66330_eb3c5baa473cbbe3bc240c4adc4ffa9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_eb3c5baa473cbbe3bc240c4adc4ffa9b.jpg not downloaded yet
2026-03-28 14:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ed4367c-e5a9-551a-9588-f3afeb941a02 with identifier: TW43134
2026-03-28 14:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ed4367c-e5a9-551a-9588-f3afeb941a02 with scrape type 1
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6ed4367c-e5a9-551a-9588-f3afeb941a02
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62f68590490ab7f141c20c08dc7912%252Fpa%252FTW43134_256a93e736eb058910ff62dec607a641.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_256a93e736eb058910ff62dec607a641.jpg not downloaded yet
2026-03-28 14:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bed05125-30e8-54d6-b09f-1f189d46d070 with identifier: YA27330
2026-03-28 14:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bed05125-30e8-54d6-b09f-1f189d46d070 with scrape type 1
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item bed05125-30e8-54d6-b09f-1f189d46d070
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ffa%252Ffdfa407189054c24a35a2d8a15b38cb2%252Fpa%252FYA27330_b5126192ac318d7db4c0672bcde784d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_b5126192ac318d7db4c0672bcde784d8.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_e8839507ddb602c6af1318f6ab3c0c60.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_e8839507ddb602c6af1318f6ab3c0c60.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_dc3a7b880c22db4210ccc47c5468572e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_dc3a7b880c22db4210ccc47c5468572e.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F70%252F7b707fa5443046ec828cb2fd94bab5da%252Fpa%252FMW66330_3c228065a317384d516a5d0106310e89.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_3c228065a317384d516a5d0106310e89.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62f68590490ab7f141c20c08dc7912%252Fpa%252FTW43134_a9e8ca4eabf7b026d9156c4a377efb44.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_a9e8ca4eabf7b026d9156c4a377efb44.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ffa%252Ffdfa407189054c24a35a2d8a15b38cb2%252Fpa%252FYA27330_6e55df6cb1f1e96ab1c19faf3bc83f4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_6e55df6cb1f1e96ab1c19faf3bc83f4a.jpg not downloaded yet
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_d5955a5ec18e3d38d037bc6290dd1e7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_268d46034486cda219eb38a639de53fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_49f6998618897bf5e778b3def64819f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_49f6998618897bf5e778b3def64819f5.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_8e21d3f10c758c7128b9244042fae5c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_8e21d3f10c758c7128b9244042fae5c4.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F70%252F7b707fa5443046ec828cb2fd94bab5da%252Fpa%252FMW66330_1d738bd41c7c4484d14c8814096e61d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_1d738bd41c7c4484d14c8814096e61d1.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62f68590490ab7f141c20c08dc7912%252Fpa%252FTW43134_4fa4fdde52475afb2857f6e45dd7bc7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_4fa4fdde52475afb2857f6e45dd7bc7c.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ffa%252Ffdfa407189054c24a35a2d8a15b38cb2%252Fpa%252FYA27330_0c4c48d219c2aa3d806701a202941735.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_0c4c48d219c2aa3d806701a202941735.jpg not downloaded yet
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4e1e90>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_a72e345fe2f55ebbc267fd61d4fc1be3.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_a72e345fe2f55ebbc267fd61d4fc1be3.jpg saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a953e90>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667b72e0-138a-5cab-a097-2dc55ca52e89/667b72e0-138a-5cab-a097-2dc55ca52e89_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa2928b334a759d57639545bc76b5b5%252Fpa%252FTH94228_934fc2051c5242f6896968398f79687e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_934fc2051c5242f6896968398f79687e.jpg saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 667b72e0-138a-5cab-a097-2dc55ca52e89
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a82fb90>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_508912fa-4d34-5727-afb5-2d6561316dcf/508912fa-4d34-5727-afb5-2d6561316dcf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F3106db1a23bc3e54adf31e05a87c5114%252Fpa%252FBX27064_862855d0de18a08f12c51bc0b05ca812.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_862855d0de18a08f12c51bc0b05ca812.jpg saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 508912fa-4d34-5727-afb5-2d6561316dcf
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa687d0>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667b72e0-138a-5cab-a097-2dc55ca52e89/667b72e0-138a-5cab-a097-2dc55ca52e89_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa2928b334a759d57639545bc76b5b5%252Fpa%252FTH94228_d4a361b2e732b133c67d24600ed55b5d.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_d4a361b2e732b133c67d24600ed55b5d.jpg saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 667b72e0-138a-5cab-a097-2dc55ca52e89
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a93c910>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_904846b5667f882bcf3d7b417489a5cb.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_904846b5667f882bcf3d7b417489a5cb.jpg saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_acba8f4cd88b36a5f71001fb7f04d76e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_acba8f4cd88b36a5f71001fb7f04d76e.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_fa1b6e86d8fa17afcc48d3c41599edc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_fa1b6e86d8fa17afcc48d3c41599edc8.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F70%252F7b707fa5443046ec828cb2fd94bab5da%252Fpa%252FMW66330_656b85a9e9ba07537c866867814302d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_656b85a9e9ba07537c866867814302d8.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62f68590490ab7f141c20c08dc7912%252Fpa%252FTW43134_5fed15b1d29b85ba21c7555f2c23efb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_5fed15b1d29b85ba21c7555f2c23efb8.jpg not downloaded yet
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ffa%252Ffdfa407189054c24a35a2d8a15b38cb2%252Fpa%252FYA27330_2d164ac9615978ad0133c6f96f1d7243.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_2d164ac9615978ad0133c6f96f1d7243.jpg not downloaded yet
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_f829242a09d048b5f0eae98978f2e4cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_644e964b0aee7fb0e4c8419b045d2548.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_daeadb28f83cfb90669ae7fe3244f706.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_f7d28f0f22a94b000f08d1d6e62839e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_f7d28f0f22a94b000f08d1d6e62839e2.jpg not downloaded yet
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a82d4d0>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_d5955a5ec18e3d38d037bc6290dd1e7e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_d5955a5ec18e3d38d037bc6290dd1e7e.jpg saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3ad150>
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_268d46034486cda219eb38a639de53fe.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_268d46034486cda219eb38a639de53fe.jpg saved to cache
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_6df11347d0b43405160c9c33c60a1ad0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_6df11347d0b43405160c9c33c60a1ad0.jpg not downloaded yet
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F70%252F7b707fa5443046ec828cb2fd94bab5da%252Fpa%252FMW66330_f296873a4de8beac3a54b8e5d7a34dfb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_f296873a4de8beac3a54b8e5d7a34dfb.jpg not downloaded yet
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62f68590490ab7f141c20c08dc7912%252Fpa%252FTW43134_79b5b3066e522eccc67bd16521327dd8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_79b5b3066e522eccc67bd16521327dd8.jpg not downloaded yet
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ffa%252Ffdfa407189054c24a35a2d8a15b38cb2%252Fpa%252FYA27330_e7dd071fe2efb07548b6d0c4ba659b93.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_e7dd071fe2efb07548b6d0c4ba659b93.jpg not downloaded yet
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_db649ba61dc9bf7243e48d9139a7265f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_d140bb00abc7a77bdb603ef3ee6cf50c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_36810980e6c17c5fdd1f0c0220ad44af.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_36810980e6c17c5fdd1f0c0220ad44af.jpg not downloaded yet
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_bf7e47966b6f09e7d199bf08a82c22c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_bf7e47966b6f09e7d199bf08a82c22c0.jpg not downloaded yet
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F70%252F7b707fa5443046ec828cb2fd94bab5da%252Fpa%252FMW66330_7ee9860a29caee17e50e5979d6c2ee52.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_7ee9860a29caee17e50e5979d6c2ee52.jpg not downloaded yet
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62f68590490ab7f141c20c08dc7912%252Fpa%252FTW43134_737884c863fda7c26e7bad0197025ac3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_737884c863fda7c26e7bad0197025ac3.jpg not downloaded yet
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ffa%252Ffdfa407189054c24a35a2d8a15b38cb2%252Fpa%252FYA27330_f21816217649785800c9efdd27307627.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_f21816217649785800c9efdd27307627.jpg not downloaded yet
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_6e55df6cb1f1e96ab1c19faf3bc83f4a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_2524e387516d98397c5c313568d4d17b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_2524e387516d98397c5c313568d4d17b.jpg not downloaded yet
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD02034/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3b07d0>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_f829242a09d048b5f0eae98978f2e4cb.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_f829242a09d048b5f0eae98978f2e4cb.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa34b90>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_508912fa-4d34-5727-afb5-2d6561316dcf/508912fa-4d34-5727-afb5-2d6561316dcf_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F3106db1a23bc3e54adf31e05a87c5114%252Fpa%252FBX27064_644e964b0aee7fb0e4c8419b045d2548.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_644e964b0aee7fb0e4c8419b045d2548.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 508912fa-4d34-5727-afb5-2d6561316dcf
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa99950>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667b72e0-138a-5cab-a097-2dc55ca52e89/667b72e0-138a-5cab-a097-2dc55ca52e89_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa2928b334a759d57639545bc76b5b5%252Fpa%252FTH94228_daeadb28f83cfb90669ae7fe3244f706.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_daeadb28f83cfb90669ae7fe3244f706.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 667b72e0-138a-5cab-a097-2dc55ca52e89
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_326c81077e5c6e5d75f71e2fee555b3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_d49fc064a45877921ea43d79d38e3a16.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_d49fc064a45877921ea43d79d38e3a16.jpg not downloaded yet
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_a9e8ca4eabf7b026d9156c4a377efb44.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3ac2d0>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_db649ba61dc9bf7243e48d9139a7265f.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_db649ba61dc9bf7243e48d9139a7265f.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4a9ed0>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_d140bb00abc7a77bdb603ef3ee6cf50c.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_d140bb00abc7a77bdb603ef3ee6cf50c.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_acba8f4cd88b36a5f71001fb7f04d76e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_0c4c48d219c2aa3d806701a202941735.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_e7dd071fe2efb07548b6d0c4ba659b93.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_381fa7e712ac6fb5e1175c74c35813d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_381fa7e712ac6fb5e1175c74c35813d8.jpg not downloaded yet
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa6a2d0>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed05125-30e8-54d6-b09f-1f189d46d070/bed05125-30e8-54d6-b09f-1f189d46d070_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ffa%252Ffdfa407189054c24a35a2d8a15b38cb2%252Fpa%252FYA27330_6e55df6cb1f1e96ab1c19faf3bc83f4a.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_6e55df6cb1f1e96ab1c19faf3bc83f4a.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bed05125-30e8-54d6-b09f-1f189d46d070
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_6ae29d0293e1862d7b553caf3f08838e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_6ae29d0293e1862d7b553caf3f08838e.jpg not downloaded yet
2026-03-28 14:06:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5e00d0>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_326c81077e5c6e5d75f71e2fee555b3a.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_326c81077e5c6e5d75f71e2fee555b3a.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_36810980e6c17c5fdd1f0c0220ad44af.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_f296873a4de8beac3a54b8e5d7a34dfb.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_2524e387516d98397c5c313568d4d17b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa023d0>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed4367c-e5a9-551a-9588-f3afeb941a02/6ed4367c-e5a9-551a-9588-f3afeb941a02_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62f68590490ab7f141c20c08dc7912%252Fpa%252FTW43134_a9e8ca4eabf7b026d9156c4a377efb44.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_a9e8ca4eabf7b026d9156c4a377efb44.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ed4367c-e5a9-551a-9588-f3afeb941a02
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a98ea90>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_acba8f4cd88b36a5f71001fb7f04d76e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_acba8f4cd88b36a5f71001fb7f04d76e.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644137b510>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed05125-30e8-54d6-b09f-1f189d46d070/bed05125-30e8-54d6-b09f-1f189d46d070_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ffa%252Ffdfa407189054c24a35a2d8a15b38cb2%252Fpa%252FYA27330_0c4c48d219c2aa3d806701a202941735.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_0c4c48d219c2aa3d806701a202941735.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bed05125-30e8-54d6-b09f-1f189d46d070
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b598e90>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed05125-30e8-54d6-b09f-1f189d46d070/bed05125-30e8-54d6-b09f-1f189d46d070_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ffa%252Ffdfa407189054c24a35a2d8a15b38cb2%252Fpa%252FYA27330_e7dd071fe2efb07548b6d0c4ba659b93.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_e7dd071fe2efb07548b6d0c4ba659b93.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bed05125-30e8-54d6-b09f-1f189d46d070
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_737884c863fda7c26e7bad0197025ac3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE13816> (referer: https://www.auto1.com/v1/car-details-view/JE13816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aac7fd0>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_36810980e6c17c5fdd1f0c0220ad44af.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_36810980e6c17c5fdd1f0c0220ad44af.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b414ed0>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99944ff7-2ab3-5c36-bcd5-43b9057384e4/99944ff7-2ab3-5c36-bcd5-43b9057384e4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F70%252F7b707fa5443046ec828cb2fd94bab5da%252Fpa%252FMW66330_f296873a4de8beac3a54b8e5d7a34dfb.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_f296873a4de8beac3a54b8e5d7a34dfb.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99944ff7-2ab3-5c36-bcd5-43b9057384e4
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa5df50>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_2524e387516d98397c5c313568d4d17b.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_2524e387516d98397c5c313568d4d17b.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a86939b3-f580-59a3-a47f-16a7bd6b1138
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_f21816217649785800c9efdd27307627.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_d49fc064a45877921ea43d79d38e3a16.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_6df11347d0b43405160c9c33c60a1ad0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aad90d0>
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed4367c-e5a9-551a-9588-f3afeb941a02/6ed4367c-e5a9-551a-9588-f3afeb941a02_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62f68590490ab7f141c20c08dc7912%252Fpa%252FTW43134_737884c863fda7c26e7bad0197025ac3.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_737884c863fda7c26e7bad0197025ac3.jpg saved to cache
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ed4367c-e5a9-551a-9588-f3afeb941a02
2026-03-28 14:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c752aa1-154a-5853-a6c3-706c7b28b973 with identifier: JE13816
2026-03-28 14:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c752aa1-154a-5853-a6c3-706c7b28b973 with scrape type 1
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c752aa1-154a-5853-a6c3-706c7b28b973
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_70c6856fbdcd24996df8bf075934a287.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_70c6856fbdcd24996df8bf075934a287.jpg not downloaded yet
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_9dedfa0396724f0f3deb1a6196655cb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_9dedfa0396724f0f3deb1a6196655cb2.jpg not downloaded yet
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_381fa7e712ac6fb5e1175c74c35813d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_2d164ac9615978ad0133c6f96f1d7243.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_bf7e47966b6f09e7d199bf08a82c22c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_f7d28f0f22a94b000f08d1d6e62839e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_847c0ba85e9ea43ebdf9ef0aa9620afb.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_847c0ba85e9ea43ebdf9ef0aa9620afb.jpg not downloaded yet
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_a3719ffa5f41b3cc84234dd1bd1e4d66.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_a3719ffa5f41b3cc84234dd1bd1e4d66.jpg not downloaded yet
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa6bfd0>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed05125-30e8-54d6-b09f-1f189d46d070/bed05125-30e8-54d6-b09f-1f189d46d070_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ffa%252Ffdfa407189054c24a35a2d8a15b38cb2%252Fpa%252FYA27330_f21816217649785800c9efdd27307627.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_f21816217649785800c9efdd27307627.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bed05125-30e8-54d6-b09f-1f189d46d070
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a800e10>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_d49fc064a45877921ea43d79d38e3a16.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_d49fc064a45877921ea43d79d38e3a16.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a86939b3-f580-59a3-a47f-16a7bd6b1138
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aaecd90>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_6df11347d0b43405160c9c33c60a1ad0.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_6df11347d0b43405160c9c33c60a1ad0.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a86939b3-f580-59a3-a47f-16a7bd6b1138
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_fe5bd4db2fc2d85935e70212b7d54467.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_fe5bd4db2fc2d85935e70212b7d54467.jpg not downloaded yet
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_656b85a9e9ba07537c866867814302d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_1d738bd41c7c4484d14c8814096e61d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_6ae29d0293e1862d7b553caf3f08838e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_1eea9e869401c32efeaca62e744012f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_1eea9e869401c32efeaca62e744012f7.jpg not downloaded yet
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_641e47b3730a74c5a9fa34dc1a8e4de3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_641e47b3730a74c5a9fa34dc1a8e4de3.jpg not downloaded yet
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3e9990>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_381fa7e712ac6fb5e1175c74c35813d8.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_381fa7e712ac6fb5e1175c74c35813d8.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a86939b3-f580-59a3-a47f-16a7bd6b1138
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8cdb90>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed05125-30e8-54d6-b09f-1f189d46d070/bed05125-30e8-54d6-b09f-1f189d46d070_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ffa%252Ffdfa407189054c24a35a2d8a15b38cb2%252Fpa%252FYA27330_2d164ac9615978ad0133c6f96f1d7243.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_2d164ac9615978ad0133c6f96f1d7243.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bed05125-30e8-54d6-b09f-1f189d46d070
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5a2310>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_bf7e47966b6f09e7d199bf08a82c22c0.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_bf7e47966b6f09e7d199bf08a82c22c0.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a86939b3-f580-59a3-a47f-16a7bd6b1138
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9c2110>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_f7d28f0f22a94b000f08d1d6e62839e2.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_f7d28f0f22a94b000f08d1d6e62839e2.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_fa1b6e86d8fa17afcc48d3c41599edc8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_5fed15b1d29b85ba21c7555f2c23efb8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_70c6856fbdcd24996df8bf075934a287.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 6ed4367c-e5a9-551a-9588-f3afeb941a02 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_825bc9b31b9af464c298b28fa250194f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_825bc9b31b9af464c298b28fa250194f.jpg not downloaded yet
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a89dfd0>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99944ff7-2ab3-5c36-bcd5-43b9057384e4/99944ff7-2ab3-5c36-bcd5-43b9057384e4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F70%252F7b707fa5443046ec828cb2fd94bab5da%252Fpa%252FMW66330_656b85a9e9ba07537c866867814302d8.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_656b85a9e9ba07537c866867814302d8.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99944ff7-2ab3-5c36-bcd5-43b9057384e4
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_49f6998618897bf5e778b3def64819f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_8e21d3f10c758c7128b9244042fae5c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a89fed0>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99944ff7-2ab3-5c36-bcd5-43b9057384e4/99944ff7-2ab3-5c36-bcd5-43b9057384e4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F70%252F7b707fa5443046ec828cb2fd94bab5da%252Fpa%252FMW66330_1d738bd41c7c4484d14c8814096e61d1.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_1d738bd41c7c4484d14c8814096e61d1.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99944ff7-2ab3-5c36-bcd5-43b9057384e4
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5e0310>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_6ae29d0293e1862d7b553caf3f08838e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_6ae29d0293e1862d7b553caf3f08838e.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a86939b3-f580-59a3-a47f-16a7bd6b1138
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_7904feea5b066639776c441a9238755f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_7904feea5b066639776c441a9238755f.jpg not downloaded yet
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_847c0ba85e9ea43ebdf9ef0aa9620afb.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV42226> (referer: https://www.auto1.com/v1/car-details-view/YV42226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_ce581a31c6f00fcdbc3e19d3e7fc9452.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_ce581a31c6f00fcdbc3e19d3e7fc9452.jpg not downloaded yet
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa34f50>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_fa1b6e86d8fa17afcc48d3c41599edc8.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_fa1b6e86d8fa17afcc48d3c41599edc8.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a86939b3-f580-59a3-a47f-16a7bd6b1138
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a952d90>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed4367c-e5a9-551a-9588-f3afeb941a02/6ed4367c-e5a9-551a-9588-f3afeb941a02_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62f68590490ab7f141c20c08dc7912%252Fpa%252FTW43134_5fed15b1d29b85ba21c7555f2c23efb8.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_5fed15b1d29b85ba21c7555f2c23efb8.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ed4367c-e5a9-551a-9588-f3afeb941a02
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f64413e3850>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_70c6856fbdcd24996df8bf075934a287.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_70c6856fbdcd24996df8bf075934a287.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c752aa1-154a-5853-a6c3-706c7b28b973
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a82fa10>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_49f6998618897bf5e778b3def64819f5.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_49f6998618897bf5e778b3def64819f5.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a822410>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_8e21d3f10c758c7128b9244042fae5c4.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_8e21d3f10c758c7128b9244042fae5c4.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a86939b3-f580-59a3-a47f-16a7bd6b1138
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_a3719ffa5f41b3cc84234dd1bd1e4d66.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_fe5bd4db2fc2d85935e70212b7d54467.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_641e47b3730a74c5a9fa34dc1a8e4de3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_1eea9e869401c32efeaca62e744012f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_9dedfa0396724f0f3deb1a6196655cb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 6ed4367c-e5a9-551a-9588-f3afeb941a02 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 99944ff7-2ab3-5c36-bcd5-43b9057384e4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD02034> (referer: https://www.auto1.com/v1/car-details-view/UD02034/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8ab2d0>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_847c0ba85e9ea43ebdf9ef0aa9620afb.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_847c0ba85e9ea43ebdf9ef0aa9620afb.jpg saved to cache
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c752aa1-154a-5853-a6c3-706c7b28b973
2026-03-28 14:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f with identifier: YV42226
2026-03-28 14:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f with scrape type 1
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_8ac0ead127130196139807ab2f573338.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_8ac0ead127130196139807ab2f573338.jpg not downloaded yet
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_a8a20b8b96ed9329fd88016f5cb78976.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_a8a20b8b96ed9329fd88016f5cb78976.jpg not downloaded yet
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_b5126192ac318d7db4c0672bcde784d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_256a93e736eb058910ff62dec607a641.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_9dd646d4eb0c0ac678fa39f14a5e82c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_9dd646d4eb0c0ac678fa39f14a5e82c6.jpg not downloaded yet
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_3901cd2c3e89e4a63dc02bf7d2d48f73.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_3901cd2c3e89e4a63dc02bf7d2d48f73.jpg not downloaded yet
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4879d0>
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_a3719ffa5f41b3cc84234dd1bd1e4d66.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_a3719ffa5f41b3cc84234dd1bd1e4d66.jpg saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c752aa1-154a-5853-a6c3-706c7b28b973
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_6454c79f6b70626da320a7ba840b55c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_6454c79f6b70626da320a7ba840b55c0.jpg not downloaded yet
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_ce581a31c6f00fcdbc3e19d3e7fc9452.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_eb3c5baa473cbbe3bc240c4adc4ffa9b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644166dbd0>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_fe5bd4db2fc2d85935e70212b7d54467.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_fe5bd4db2fc2d85935e70212b7d54467.jpg saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c752aa1-154a-5853-a6c3-706c7b28b973
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9c2f50>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_641e47b3730a74c5a9fa34dc1a8e4de3.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_641e47b3730a74c5a9fa34dc1a8e4de3.jpg saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c752aa1-154a-5853-a6c3-706c7b28b973
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a97abd0>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_1eea9e869401c32efeaca62e744012f7.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_1eea9e869401c32efeaca62e744012f7.jpg saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c752aa1-154a-5853-a6c3-706c7b28b973
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3e9790>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_9dedfa0396724f0f3deb1a6196655cb2.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_9dedfa0396724f0f3deb1a6196655cb2.jpg saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c752aa1-154a-5853-a6c3-706c7b28b973
2026-03-28 14:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8549f804-9b60-57f5-8d7b-2395d46a520f with identifier: UD02034
2026-03-28 14:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8549f804-9b60-57f5-8d7b-2395d46a520f with scrape type 1
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8549f804-9b60-57f5-8d7b-2395d46a520f
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_edae1cd3ccb8cb82cb53dba2acdd14d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_edae1cd3ccb8cb82cb53dba2acdd14d8.jpg not downloaded yet
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_933ec7f75ae4aca9a516d20ad789b885.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_4c60a43e5291b2b3aa0284d960415fbc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_4c60a43e5291b2b3aa0284d960415fbc.jpg not downloaded yet
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_938be33ba44fc1be73734286c3bc1578.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_938be33ba44fc1be73734286c3bc1578.jpg not downloaded yet
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_825bc9b31b9af464c298b28fa250194f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_7904feea5b066639776c441a9238755f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_c3367dd68cb0507c19777ef0c205fa84.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_c3367dd68cb0507c19777ef0c205fa84.jpg not downloaded yet
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9c0cd0>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed05125-30e8-54d6-b09f-1f189d46d070/bed05125-30e8-54d6-b09f-1f189d46d070_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ffa%252Ffdfa407189054c24a35a2d8a15b38cb2%252Fpa%252FYA27330_b5126192ac318d7db4c0672bcde784d8.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_b5126192ac318d7db4c0672bcde784d8.jpg saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bed05125-30e8-54d6-b09f-1f189d46d070
2026-03-28 14:06:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bed05125-30e8-54d6-b09f-1f189d46d070, skipping ID generation
2026-03-28 14:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bed05125-30e8-54d6-b09f-1f189d46d070 with scrape type 1
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bed05125-30e8-54d6-b09f-1f189d46d070 sending to next pipeline
2026-03-28 14:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bed05125-30e8-54d6-b09f-1f189d46d070, identifier: YA27330
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f64423d2f90>
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed4367c-e5a9-551a-9588-f3afeb941a02/6ed4367c-e5a9-551a-9588-f3afeb941a02_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62f68590490ab7f141c20c08dc7912%252Fpa%252FTW43134_256a93e736eb058910ff62dec607a641.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_256a93e736eb058910ff62dec607a641.jpg saved to cache
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ed4367c-e5a9-551a-9588-f3afeb941a02
2026-03-28 14:06:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ed4367c-e5a9-551a-9588-f3afeb941a02, skipping ID generation
2026-03-28 14:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ed4367c-e5a9-551a-9588-f3afeb941a02 with scrape type 1
2026-03-28 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ed4367c-e5a9-551a-9588-f3afeb941a02 sending to next pipeline
2026-03-28 14:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6ed4367c-e5a9-551a-9588-f3afeb941a02, identifier: TW43134
2026-03-28 14:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5a2dd0>
2026-03-28 14:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_ce581a31c6f00fcdbc3e19d3e7fc9452.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_ce581a31c6f00fcdbc3e19d3e7fc9452.jpg saved to cache
2026-03-28 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c752aa1-154a-5853-a6c3-706c7b28b973
2026-03-28 14:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5d5950>
2026-03-28 14:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99944ff7-2ab3-5c36-bcd5-43b9057384e4/99944ff7-2ab3-5c36-bcd5-43b9057384e4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F70%252F7b707fa5443046ec828cb2fd94bab5da%252Fpa%252FMW66330_eb3c5baa473cbbe3bc240c4adc4ffa9b.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_eb3c5baa473cbbe3bc240c4adc4ffa9b.jpg saved to cache
2026-03-28 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99944ff7-2ab3-5c36-bcd5-43b9057384e4
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_53425da84aa70939652df87bc9ee9bdc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_53425da84aa70939652df87bc9ee9bdc.jpg not downloaded yet
2026-03-28 14:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bed05125-30e8-54d6-b09f-1f189d46d070 with identifier: YA27330
2026-03-28 14:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bed05125-30e8-54d6-b09f-1f189d46d070 with identifier: YA27330
2026-03-28 14:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bed05125-30e8-54d6-b09f-1f189d46d070 with identifier: YA27330 to the API
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_b5126192ac318d7db4c0672bcde784d8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:03:53Z',
 'fuel_type': 'petrol',
 'id': 'bed05125-30e8-54d6-b09f-1f189d46d070',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA27330',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 189121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bed05125-30e8-54d6-b09f-1f189d46d070/bed05125-30e8-54d6-b09f-1f189d46d070_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_b5126192ac318d7db4c0672bcde784d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bed05125-30e8-54d6-b09f-1f189d46d070/bed05125-30e8-54d6-b09f-1f189d46d070_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_6e55df6cb1f1e96ab1c19faf3bc83f4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bed05125-30e8-54d6-b09f-1f189d46d070/bed05125-30e8-54d6-b09f-1f189d46d070_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_0c4c48d219c2aa3d806701a202941735.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bed05125-30e8-54d6-b09f-1f189d46d070/bed05125-30e8-54d6-b09f-1f189d46d070_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_2d164ac9615978ad0133c6f96f1d7243.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bed05125-30e8-54d6-b09f-1f189d46d070/bed05125-30e8-54d6-b09f-1f189d46d070_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_e7dd071fe2efb07548b6d0c4ba659b93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bed05125-30e8-54d6-b09f-1f189d46d070/bed05125-30e8-54d6-b09f-1f189d46d070_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/fa/fdfa407189054c24a35a2d8a15b38cb2/pa/YA27330_f21816217649785800c9efdd27307627.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fusion 1.4 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2007}
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA27330%27 HTTP/1.1" 200 None
2026-03-28 14:06:25 [auto1.es] INFO: Saving data for YA27330: {'created_time': 1774706785.508056, 'last_price_update_time': 1774706785.508066, 'auction_closing_time': 1774883033.0}
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YA27330') HTTP/1.1" 204 0
2026-03-28 14:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6ed4367c-e5a9-551a-9588-f3afeb941a02 with identifier: TW43134
2026-03-28 14:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6ed4367c-e5a9-551a-9588-f3afeb941a02 with identifier: TW43134
2026-03-28 14:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6ed4367c-e5a9-551a-9588-f3afeb941a02 with identifier: TW43134 to the API
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_256a93e736eb058910ff62dec607a641.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:03:46Z',
 'fuel_type': 'petrol',
 'id': '6ed4367c-e5a9-551a-9588-f3afeb941a02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW43134',
 'listing': 'auction',
 'location': 'ES, Churra (Murcia)',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 229323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed4367c-e5a9-551a-9588-f3afeb941a02/6ed4367c-e5a9-551a-9588-f3afeb941a02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_256a93e736eb058910ff62dec607a641.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed4367c-e5a9-551a-9588-f3afeb941a02/6ed4367c-e5a9-551a-9588-f3afeb941a02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_a9e8ca4eabf7b026d9156c4a377efb44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed4367c-e5a9-551a-9588-f3afeb941a02/6ed4367c-e5a9-551a-9588-f3afeb941a02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_5fed15b1d29b85ba21c7555f2c23efb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed4367c-e5a9-551a-9588-f3afeb941a02/6ed4367c-e5a9-551a-9588-f3afeb941a02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62f68590490ab7f141c20c08dc7912/pa/TW43134_737884c863fda7c26e7bad0197025ac3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 206 1.6 XS',
 'transmission': 'manual',
 'trim': 'XS',
 'year': 2003}
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW43134%27 HTTP/1.1" 200 None
2026-03-28 14:06:25 [auto1.es] INFO: Saving data for TW43134: {'created_time': 1774706785.857976, 'last_price_update_time': 1774706785.857986, 'auction_closing_time': 1774883026.0}
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TW43134') HTTP/1.1" 204 0
2026-03-28 14:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_d92ac25c152b901404124c16099bc557.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_0b7302a1b351d401b489a66e755d3742.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_0b7302a1b351d401b489a66e755d3742.jpg not downloaded yet
2026-03-28 14:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_7182b81f6b96d43d2a085b3b16a57edb.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_69f547a84a866945272c8710c31669c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_47c0e78f57021059c6f83eca59c349b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_47c0e78f57021059c6f83eca59c349b7.jpg not downloaded yet
2026-03-28 14:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE38757> (referer: https://www.auto1.com/v1/car-details-view/ZE38757/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_8ac0ead127130196139807ab2f573338.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_52b175cc5aee6ea4be446f27ef034cee.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_fb7657752a40108beb378beefd017ea4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_fb7657752a40108beb378beefd017ea4.jpg not downloaded yet
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_8c1ab0ee077caf057e2ec856227797da.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_8c1ab0ee077caf057e2ec856227797da.jpg not downloaded yet
2026-03-28 14:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a99b250>
2026-03-28 14:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd5%252F03d5c5c06c2abd803948f5bcb082124a%252Fpa%252FKB02091_933ec7f75ae4aca9a516d20ad789b885.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_933ec7f75ae4aca9a516d20ad789b885.jpg saved to cache
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a86939b3-f580-59a3-a47f-16a7bd6b1138
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b450ed0>
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_825bc9b31b9af464c298b28fa250194f.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_825bc9b31b9af464c298b28fa250194f.jpg saved to cache
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c752aa1-154a-5853-a6c3-706c7b28b973
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8344d0>
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Ff5%252F42f5e588192615595a099d1bd70b7398%252Fpa%252FJE13816_7904feea5b066639776c441a9238755f.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_7904feea5b066639776c441a9238755f.jpg saved to cache
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c752aa1-154a-5853-a6c3-706c7b28b973
2026-03-28 14:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c752aa1-154a-5853-a6c3-706c7b28b973, skipping ID generation
2026-03-28 14:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c752aa1-154a-5853-a6c3-706c7b28b973 with scrape type 1
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c752aa1-154a-5853-a6c3-706c7b28b973 sending to next pipeline
2026-03-28 14:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1c752aa1-154a-5853-a6c3-706c7b28b973, identifier: JE13816
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_faa86ff623cb014bdf5ce2a23087b19c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_faa86ff623cb014bdf5ce2a23087b19c.jpg not downloaded yet
2026-03-28 14:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1c752aa1-154a-5853-a6c3-706c7b28b973 with identifier: JE13816
2026-03-28 14:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1c752aa1-154a-5853-a6c3-706c7b28b973 with identifier: JE13816
2026-03-28 14:06:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1c752aa1-154a-5853-a6c3-706c7b28b973 with identifier: JE13816 to the API
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_7904feea5b066639776c441a9238755f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 215,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.4L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:38:22Z',
 'fuel_type': 'diesel',
 'id': '1c752aa1-154a-5853-a6c3-706c7b28b973',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE13816',
 'listing': 'auction',
 'location': 'ES, San Juan de Aznalfarache, Sevilla',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 162738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_70c6856fbdcd24996df8bf075934a287.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_9dedfa0396724f0f3deb1a6196655cb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_847c0ba85e9ea43ebdf9ef0aa9620afb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_a3719ffa5f41b3cc84234dd1bd1e4d66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_fe5bd4db2fc2d85935e70212b7d54467.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_1eea9e869401c32efeaca62e744012f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_641e47b3730a74c5a9fa34dc1a8e4de3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_825bc9b31b9af464c298b28fa250194f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_7904feea5b066639776c441a9238755f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c752aa1-154a-5853-a6c3-706c7b28b973/1c752aa1-154a-5853-a6c3-706c7b28b973_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/f5/42f5e588192615595a099d1bd70b7398/pa/JE13816_ce581a31c6f00fcdbc3e19d3e7fc9452.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 2.4 D5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2013}
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE13816%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [auto1.es] INFO: Saving data for JE13816: {'created_time': 1774706786.572175, 'last_price_update_time': 1774706786.572186, 'auction_closing_time': 1774885102.0}
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JE13816') HTTP/1.1" 204 0
2026-03-28 14:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 99944ff7-2ab3-5c36-bcd5-43b9057384e4 with identifier: MW66330
2026-03-28 14:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 99944ff7-2ab3-5c36-bcd5-43b9057384e4 with identifier: MW66330
2026-03-28 14:06:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 99944ff7-2ab3-5c36-bcd5-43b9057384e4 with identifier: MW66330 to the API
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:26 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:06:35Z',
 'fuel_type': 'diesel',
 'id': '99944ff7-2ab3-5c36-bcd5-43b9057384e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW66330',
 'listing': 'auction',
 'location': 'ES, Valencia',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 249259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_eb3c5baa473cbbe3bc240c4adc4ffa9b.jpg',
                'https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_3c228065a317384d516a5d0106310e89.jpg',
                'https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_1d738bd41c7c4484d14c8814096e61d1.jpg',
                'https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_656b85a9e9ba07537c866867814302d8.jpg',
                'https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_f296873a4de8beac3a54b8e5d7a34dfb.jpg',
                'https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_7ee9860a29caee17e50e5979d6c2ee52.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99944ff7-2ab3-5c36-bcd5-43b9057384e4/99944ff7-2ab3-5c36-bcd5-43b9057384e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_eb3c5baa473cbbe3bc240c4adc4ffa9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99944ff7-2ab3-5c36-bcd5-43b9057384e4/99944ff7-2ab3-5c36-bcd5-43b9057384e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_1d738bd41c7c4484d14c8814096e61d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99944ff7-2ab3-5c36-bcd5-43b9057384e4/99944ff7-2ab3-5c36-bcd5-43b9057384e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_656b85a9e9ba07537c866867814302d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99944ff7-2ab3-5c36-bcd5-43b9057384e4/99944ff7-2ab3-5c36-bcd5-43b9057384e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/70/7b707fa5443046ec828cb2fd94bab5da/pa/MW66330_f296873a4de8beac3a54b8e5d7a34dfb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW66330%27 HTTP/1.1" 200 None
2026-03-28 14:06:26 [auto1.es] INFO: Saving data for MW66330: {'created_time': 1774706786.958231, 'last_price_update_time': 1774706786.95824, 'auction_closing_time': 1774883195.0}
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MW66330') HTTP/1.1" 204 0
2026-03-28 14:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a86939b3-f580-59a3-a47f-16a7bd6b1138 with identifier: KB02091
2026-03-28 14:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a86939b3-f580-59a3-a47f-16a7bd6b1138 with identifier: KB02091
2026-03-28 14:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a86939b3-f580-59a3-a47f-16a7bd6b1138 with identifier: KB02091 to the API
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:27 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:10:04Z',
 'fuel_type': 'diesel',
 'id': 'a86939b3-f580-59a3-a47f-16a7bd6b1138',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB02091',
 'listing': 'auction',
 'location': 'ES, Churra (Murcia)',
 'make': 'Suzuki',
 'model': 'Grand Vitara',
 'odometer': 174166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_933ec7f75ae4aca9a516d20ad789b885.jpg',
                'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_dc3a7b880c22db4210ccc47c5468572e.jpg',
                'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_8e21d3f10c758c7128b9244042fae5c4.jpg',
                'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_fa1b6e86d8fa17afcc48d3c41599edc8.jpg',
                'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_6df11347d0b43405160c9c33c60a1ad0.jpg',
                'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_bf7e47966b6f09e7d199bf08a82c22c0.jpg',
                'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_2524e387516d98397c5c313568d4d17b.jpg',
                'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_d49fc064a45877921ea43d79d38e3a16.jpg',
                'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_381fa7e712ac6fb5e1175c74c35813d8.jpg',
                'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_6ae29d0293e1862d7b553caf3f08838e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_933ec7f75ae4aca9a516d20ad789b885.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_8e21d3f10c758c7128b9244042fae5c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_fa1b6e86d8fa17afcc48d3c41599edc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_6df11347d0b43405160c9c33c60a1ad0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_bf7e47966b6f09e7d199bf08a82c22c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_2524e387516d98397c5c313568d4d17b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_d49fc064a45877921ea43d79d38e3a16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_381fa7e712ac6fb5e1175c74c35813d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86939b3-f580-59a3-a47f-16a7bd6b1138/a86939b3-f580-59a3-a47f-16a7bd6b1138_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d5/03d5c5c06c2abd803948f5bcb082124a/pa/KB02091_6ae29d0293e1862d7b553caf3f08838e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Grand Vitara 1.9 DDiS JLX',
 'transmission': 'manual',
 'trim': 'JLX',
 'year': 2007}
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB02091%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [auto1.es] INFO: Saving data for KB02091: {'created_time': 1774706787.400529, 'last_price_update_time': 1774706787.400542, 'auction_closing_time': 1774883404.0}
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KB02091') HTTP/1.1" 204 0
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_4219eb87fa94ec3e8a796764750e64e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_4219eb87fa94ec3e8a796764750e64e1.jpg not downloaded yet
2026-03-28 14:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_edae1cd3ccb8cb82cb53dba2acdd14d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_4c60a43e5291b2b3aa0284d960415fbc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_c3367dd68cb0507c19777ef0c205fa84.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 99944ff7-2ab3-5c36-bcd5-43b9057384e4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item a86939b3-f580-59a3-a47f-16a7bd6b1138 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a931cd0>
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F8a%252F7d8a097f054adf52b51df918c154b35e%252Fpa%252FCE25443_d92ac25c152b901404124c16099bc557.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_d92ac25c152b901404124c16099bc557.jpg saved to cache
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4
2026-03-28 14:06:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5fb6797-d8e0-5fb0-825f-e9e3b87504b4, skipping ID generation
2026-03-28 14:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4 with scrape type 1
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5fb6797-d8e0-5fb0-825f-e9e3b87504b4 sending to next pipeline
2026-03-28 14:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f5fb6797-d8e0-5fb0-825f-e9e3b87504b4, identifier: CE25443
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3eef50>
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_508912fa-4d34-5727-afb5-2d6561316dcf/508912fa-4d34-5727-afb5-2d6561316dcf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F06%252F3106db1a23bc3e54adf31e05a87c5114%252Fpa%252FBX27064_7182b81f6b96d43d2a085b3b16a57edb.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_7182b81f6b96d43d2a085b3b16a57edb.jpg saved to cache
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 508912fa-4d34-5727-afb5-2d6561316dcf
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a987110>
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_69f547a84a866945272c8710c31669c1.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_69f547a84a866945272c8710c31669c1.jpg saved to cache
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e
2026-03-28 14:06:27 [auto1.es] INFO: Channel: 24h | Page: 4 | totalHits: 2696 | hits on page: 40
2026-03-28 14:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31e0a1dd-daa0-5169-933a-ba14debbe79a with identifier: ZE38757
2026-03-28 14:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31e0a1dd-daa0-5169-933a-ba14debbe79a with scrape type 1
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 31e0a1dd-daa0-5169-933a-ba14debbe79a
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3e%252F6f3e2bca6ccad8fcd9261ce252a88fab%252Fpa%252FZE38757_50f976937250edf082f97b2cf6472a48.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_50f976937250edf082f97b2cf6472a48.jpg not downloaded yet
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4d85d0>
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b98ee7a-ddcd-5888-b5d8-41d64d5d682f/3b98ee7a-ddcd-5888-b5d8-41d64d5d682f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_8ac0ead127130196139807ab2f573338.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_8ac0ead127130196139807ab2f573338.jpg saved to cache
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a905510>
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667b72e0-138a-5cab-a097-2dc55ca52e89/667b72e0-138a-5cab-a097-2dc55ca52e89_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa2928b334a759d57639545bc76b5b5%252Fpa%252FTH94228_52b175cc5aee6ea4be446f27ef034cee.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_52b175cc5aee6ea4be446f27ef034cee.jpg saved to cache
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 667b72e0-138a-5cab-a097-2dc55ca52e89
2026-03-28 14:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_a8a20b8b96ed9329fd88016f5cb78976.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_938be33ba44fc1be73734286c3bc1578.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_d6953c861dd75d5f13282ada16cc1b5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_d6953c861dd75d5f13282ada16cc1b5e.jpg not downloaded yet
2026-03-28 14:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f5fb6797-d8e0-5fb0-825f-e9e3b87504b4 with identifier: CE25443
2026-03-28 14:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f5fb6797-d8e0-5fb0-825f-e9e3b87504b4 with identifier: CE25443
2026-03-28 14:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f5fb6797-d8e0-5fb0-825f-e9e3b87504b4 with identifier: CE25443 to the API
2026-03-28 14:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_d92ac25c152b901404124c16099bc557.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:37:17Z',
 'fuel_type': 'petrol',
 'id': 'f5fb6797-d8e0-5fb0-825f-e9e3b87504b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE25443',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 133004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_904846b5667f882bcf3d7b417489a5cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_d5955a5ec18e3d38d037bc6290dd1e7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_268d46034486cda219eb38a639de53fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_db649ba61dc9bf7243e48d9139a7265f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_d92ac25c152b901404124c16099bc557.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_49f6998618897bf5e778b3def64819f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_acba8f4cd88b36a5f71001fb7f04d76e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_f7d28f0f22a94b000f08d1d6e62839e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fb6797-d8e0-5fb0-825f-e9e3b87504b4/f5fb6797-d8e0-5fb0-825f-e9e3b87504b4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/8a/7d8a097f054adf52b51df918c154b35e/pa/CE25443_36810980e6c17c5fdd1f0c0220ad44af.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam ecoFlex',
 'transmission': 'manual',
 'trim': 'Jam ecoFlex',
 'year': 2014}
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE25443%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [auto1.es] INFO: Saving data for CE25443: {'created_time': 1774706788.213279, 'last_price_update_time': 1774706788.213288, 'auction_closing_time': 1774885037.0}
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CE25443') HTTP/1.1" 204 0
2026-03-28 14:06:28 [auto1.es] INFO: Found listing with ID: LG52328
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG52328%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [auto1.es] INFO: Scrape type for LG52328: 1
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3e%252F6f3e2bca6ccad8fcd9261ce252a88fab%252Fpa%252FZE38757_3dbad447d0589f6a4c766d458e1b5ad9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_3dbad447d0589f6a4c766d458e1b5ad9.jpg not downloaded yet
2026-03-28 14:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_cdb7ecfe5226bc0ef659647ff264861e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_cdb7ecfe5226bc0ef659647ff264861e.jpg not downloaded yet
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_341983434ba1cd48ed6985ed45bec1c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_53425da84aa70939652df87bc9ee9bdc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_1243d2a3a9452110030516f39f744f83.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:28 [auto1.es] INFO: Found listing with ID: RF71791
2026-03-28 14:06:28 [auto1.es] INFO: Found listing with ID: GE54234
2026-03-28 14:06:28 [auto1.es] INFO: Found listing with ID: VN90638
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN90638%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [auto1.es] INFO: Scrape type for VN90638: 1
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3e%252F6f3e2bca6ccad8fcd9261ce252a88fab%252Fpa%252FZE38757_7a826147c9e3da7c0bd089abce586f17.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_7a826147c9e3da7c0bd089abce586f17.jpg not downloaded yet
2026-03-28 14:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa10250>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_edae1cd3ccb8cb82cb53dba2acdd14d8.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_edae1cd3ccb8cb82cb53dba2acdd14d8.jpg saved to cache
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8549f804-9b60-57f5-8d7b-2395d46a520f
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8a8690>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b98ee7a-ddcd-5888-b5d8-41d64d5d682f/3b98ee7a-ddcd-5888-b5d8-41d64d5d682f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_4c60a43e5291b2b3aa0284d960415fbc.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_4c60a43e5291b2b3aa0284d960415fbc.jpg saved to cache
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa96650>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b98ee7a-ddcd-5888-b5d8-41d64d5d682f/3b98ee7a-ddcd-5888-b5d8-41d64d5d682f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_c3367dd68cb0507c19777ef0c205fa84.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_c3367dd68cb0507c19777ef0c205fa84.jpg saved to cache
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8dd190>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b98ee7a-ddcd-5888-b5d8-41d64d5d682f/3b98ee7a-ddcd-5888-b5d8-41d64d5d682f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_a8a20b8b96ed9329fd88016f5cb78976.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_a8a20b8b96ed9329fd88016f5cb78976.jpg saved to cache
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8a8850>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_938be33ba44fc1be73734286c3bc1578.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_938be33ba44fc1be73734286c3bc1578.jpg saved to cache
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8549f804-9b60-57f5-8d7b-2395d46a520f
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_38995d2457db6bea0f58c9bdd73535cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_38995d2457db6bea0f58c9bdd73535cf.jpg not downloaded yet
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_faa86ff623cb014bdf5ce2a23087b19c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_8c1ab0ee077caf057e2ec856227797da.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:28 [auto1.es] INFO: Found listing with ID: UF54007
2026-03-28 14:06:28 [auto1.es] INFO: Found listing with ID: DH26781
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH26781%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [auto1.es] INFO: Scrape type for DH26781: 1
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3e%252F6f3e2bca6ccad8fcd9261ce252a88fab%252Fpa%252FZE38757_ac85cdf7c6b243ab581db5f906688625.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_ac85cdf7c6b243ab581db5f906688625.jpg not downloaded yet
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU66337/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_1a97d363c21de5f237239ce20964082e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_1a97d363c21de5f237239ce20964082e.jpg not downloaded yet
2026-03-28 14:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3e8810>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_341983434ba1cd48ed6985ed45bec1c7.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_341983434ba1cd48ed6985ed45bec1c7.jpg saved to cache
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8dac90>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_53425da84aa70939652df87bc9ee9bdc.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_53425da84aa70939652df87bc9ee9bdc.jpg saved to cache
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8549f804-9b60-57f5-8d7b-2395d46a520f
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9d0b10>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_1243d2a3a9452110030516f39f744f83.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_1243d2a3a9452110030516f39f744f83.jpg saved to cache
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e
2026-03-28 14:06:28 [auto1.es] INFO: Found listing with ID: XP71209
2026-03-28 14:06:28 [auto1.es] INFO: Found listing with ID: AT12035
2026-03-28 14:06:28 [auto1.es] INFO: Found listing with ID: CB66471
2026-03-28 14:06:28 [auto1.es] INFO: Found listing with ID: XJ81708
2026-03-28 14:06:28 [auto1.es] INFO: Found listing with ID: BT51966
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT51966%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [auto1.es] INFO: Scrape type for BT51966: 1
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3e%252F6f3e2bca6ccad8fcd9261ce252a88fab%252Fpa%252FZE38757_75a4a336897b01250a7e7147bfb2d006.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_75a4a336897b01250a7e7147bfb2d006.jpg not downloaded yet
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_0c04a012919ecfcf38072eee61111afc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_161f8c878b2c5ab1029ac0a126dcf45e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_fb7657752a40108beb378beefd017ea4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:28 [auto1.es] INFO: Found listing with ID: WU60183
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU60183%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [auto1.es] INFO: Scrape type for WU60183: 1
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3e%252F6f3e2bca6ccad8fcd9261ce252a88fab%252Fpa%252FZE38757_bd49d8b7e42bd315edaddf0ffb100d07.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_bd49d8b7e42bd315edaddf0ffb100d07.jpg not downloaded yet
2026-03-28 14:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a922290>
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b98ee7a-ddcd-5888-b5d8-41d64d5d682f/3b98ee7a-ddcd-5888-b5d8-41d64d5d682f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_faa86ff623cb014bdf5ce2a23087b19c.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_faa86ff623cb014bdf5ce2a23087b19c.jpg saved to cache
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a919210>
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_8c1ab0ee077caf057e2ec856227797da.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_8c1ab0ee077caf057e2ec856227797da.jpg saved to cache
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8549f804-9b60-57f5-8d7b-2395d46a520f
2026-03-28 14:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_50f976937250edf082f97b2cf6472a48.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_ce896afaf48890f044daded311357865.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:29 [auto1.es] INFO: Found listing with ID: LK89400
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK89400%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [auto1.es] INFO: Scrape type for LK89400: 1
2026-03-28 14:06:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644166a890>
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667b72e0-138a-5cab-a097-2dc55ca52e89/667b72e0-138a-5cab-a097-2dc55ca52e89_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa2928b334a759d57639545bc76b5b5%252Fpa%252FTH94228_0c04a012919ecfcf38072eee61111afc.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_0c04a012919ecfcf38072eee61111afc.jpg saved to cache
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 667b72e0-138a-5cab-a097-2dc55ca52e89
2026-03-28 14:06:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 667b72e0-138a-5cab-a097-2dc55ca52e89, skipping ID generation
2026-03-28 14:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667b72e0-138a-5cab-a097-2dc55ca52e89 with scrape type 1
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 667b72e0-138a-5cab-a097-2dc55ca52e89 sending to next pipeline
2026-03-28 14:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 667b72e0-138a-5cab-a097-2dc55ca52e89, identifier: TH94228
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9cbed0>
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_161f8c878b2c5ab1029ac0a126dcf45e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_161f8c878b2c5ab1029ac0a126dcf45e.jpg saved to cache
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa51dd0>
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b98ee7a-ddcd-5888-b5d8-41d64d5d682f/3b98ee7a-ddcd-5888-b5d8-41d64d5d682f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdb%252F46db87035f249acdda388eec0c5f6b27%252Fpa%252FYV42226_fb7657752a40108beb378beefd017ea4.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_fb7657752a40108beb378beefd017ea4.jpg saved to cache
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f
2026-03-28 14:06:29 [auto1.es] INFO: Found listing with ID: DV24306
2026-03-28 14:06:29 [auto1.es] INFO: Found listing with ID: TV24981
2026-03-28 14:06:29 [auto1.es] INFO: Found listing with ID: PC32522
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC32522%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [auto1.es] INFO: Scrape type for PC32522: 1
2026-03-28 14:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 667b72e0-138a-5cab-a097-2dc55ca52e89 with identifier: TH94228
2026-03-28 14:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 667b72e0-138a-5cab-a097-2dc55ca52e89 with identifier: TH94228
2026-03-28 14:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 667b72e0-138a-5cab-a097-2dc55ca52e89 with identifier: TH94228 to the API
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_0c04a012919ecfcf38072eee61111afc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:51:25Z',
 'fuel_type': 'petrol',
 'id': '667b72e0-138a-5cab-a097-2dc55ca52e89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH94228',
 'listing': 'auction',
 'location': 'ES, Alcalá de Henares',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 101802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667b72e0-138a-5cab-a097-2dc55ca52e89/667b72e0-138a-5cab-a097-2dc55ca52e89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_0c04a012919ecfcf38072eee61111afc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667b72e0-138a-5cab-a097-2dc55ca52e89/667b72e0-138a-5cab-a097-2dc55ca52e89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_b4fa0aaa9d2cb4c2534712baeeb43f44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667b72e0-138a-5cab-a097-2dc55ca52e89/667b72e0-138a-5cab-a097-2dc55ca52e89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_52b175cc5aee6ea4be446f27ef034cee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667b72e0-138a-5cab-a097-2dc55ca52e89/667b72e0-138a-5cab-a097-2dc55ca52e89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_934fc2051c5242f6896968398f79687e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667b72e0-138a-5cab-a097-2dc55ca52e89/667b72e0-138a-5cab-a097-2dc55ca52e89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_d4a361b2e732b133c67d24600ed55b5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667b72e0-138a-5cab-a097-2dc55ca52e89/667b72e0-138a-5cab-a097-2dc55ca52e89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa2928b334a759d57639545bc76b5b5/pa/TH94228_daeadb28f83cfb90669ae7fe3244f706.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 307 1.6 XR Clim',
 'transmission': 'manual',
 'trim': 'XR Clim',
 'year': 2004}
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH94228%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [auto1.es] INFO: Saving data for TH94228: {'created_time': 1774706789.67656, 'last_price_update_time': 1774706789.676568, 'auction_closing_time': 1774885885.0}
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TH94228') HTTP/1.1" 204 0
2026-03-28 14:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_7a826147c9e3da7c0bd089abce586f17.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_38995d2457db6bea0f58c9bdd73535cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_3dbad447d0589f6a4c766d458e1b5ad9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_75a4a336897b01250a7e7147bfb2d006.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_d6953c861dd75d5f13282ada16cc1b5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:29 [auto1.es] INFO: Found listing with ID: HV31906
2026-03-28 14:06:29 [auto1.es] INFO: Found listing with ID: CP18304
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP18304%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [auto1.es] INFO: Scrape type for CP18304: 1
2026-03-28 14:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG52328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG71405> (referer: https://www.auto1.com/v1/car-details-view/NG71405/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa228d0>
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31e0a1dd-daa0-5169-933a-ba14debbe79a/31e0a1dd-daa0-5169-933a-ba14debbe79a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3e%252F6f3e2bca6ccad8fcd9261ce252a88fab%252Fpa%252FZE38757_50f976937250edf082f97b2cf6472a48.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_50f976937250edf082f97b2cf6472a48.jpg saved to cache
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31e0a1dd-daa0-5169-933a-ba14debbe79a
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b46bdd0>
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_ce896afaf48890f044daded311357865.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_ce896afaf48890f044daded311357865.jpg saved to cache
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e
2026-03-28 14:06:29 [auto1.es] INFO: Found listing with ID: YD38751
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD38751%27 HTTP/1.1" 200 None
2026-03-28 14:06:29 [auto1.es] INFO: Scrape type for YD38751: 2
2026-03-28 14:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7abb1501-a1f6-5fa2-afb8-87638f07952b with identifier: YD38751
2026-03-28 14:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7abb1501-a1f6-5fa2-afb8-87638f07952b with scrape type 2
2026-03-28 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7abb1501-a1f6-5fa2-afb8-87638f07952b with scrape type 2
2026-03-28 14:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7abb1501-a1f6-5fa2-afb8-87638f07952b, identifier: YD38751
2026-03-28 14:06:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 508912fa-4d34-5727-afb5-2d6561316dcf with identifier: BX27064
2026-03-28 14:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 508912fa-4d34-5727-afb5-2d6561316dcf with identifier: BX27064
2026-03-28 14:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 508912fa-4d34-5727-afb5-2d6561316dcf with identifier: BX27064 to the API
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:30 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:30:47Z',
 'fuel_type': 'petrol',
 'id': '508912fa-4d34-5727-afb5-2d6561316dcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX27064',
 'listing': 'auction',
 'location': 'ES, Terrassa',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 164998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_dab3b6dc9385190c97aee7635578aef2.jpg',
                'https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_62c66619b0dcf1277f9ab5c0b58a875c.jpg',
                'https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_7182b81f6b96d43d2a085b3b16a57edb.jpg',
                'https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_12764edfed67a996ac8f8cf734a87f74.jpg',
                'https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_862855d0de18a08f12c51bc0b05ca812.jpg',
                'https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_644e964b0aee7fb0e4c8419b045d2548.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_508912fa-4d34-5727-afb5-2d6561316dcf/508912fa-4d34-5727-afb5-2d6561316dcf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_62c66619b0dcf1277f9ab5c0b58a875c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_508912fa-4d34-5727-afb5-2d6561316dcf/508912fa-4d34-5727-afb5-2d6561316dcf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_7182b81f6b96d43d2a085b3b16a57edb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_508912fa-4d34-5727-afb5-2d6561316dcf/508912fa-4d34-5727-afb5-2d6561316dcf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_12764edfed67a996ac8f8cf734a87f74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_508912fa-4d34-5727-afb5-2d6561316dcf/508912fa-4d34-5727-afb5-2d6561316dcf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_862855d0de18a08f12c51bc0b05ca812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_508912fa-4d34-5727-afb5-2d6561316dcf/508912fa-4d34-5727-afb5-2d6561316dcf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/06/3106db1a23bc3e54adf31e05a87c5114/pa/BX27064_644e964b0aee7fb0e4c8419b045d2548.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-12-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX27064%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [auto1.es] INFO: Saving data for BX27064: {'created_time': 1774706790.430063, 'last_price_update_time': 1774706790.430073, 'auction_closing_time': 1774884647.0}
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BX27064') HTTP/1.1" 204 0
2026-03-28 14:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f with identifier: YV42226
2026-03-28 14:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f with identifier: YV42226
2026-03-28 14:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f with identifier: YV42226 to the API
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:30 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:01:12Z',
 'fuel_type': 'diesel',
 'id': '3b98ee7a-ddcd-5888-b5d8-41d64d5d682f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV42226',
 'listing': 'auction',
 'location': 'ES, Oiartzun',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 238924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_8ac0ead127130196139807ab2f573338.jpg',
                'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_a8a20b8b96ed9329fd88016f5cb78976.jpg',
                'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_9dd646d4eb0c0ac678fa39f14a5e82c6.jpg',
                'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_3901cd2c3e89e4a63dc02bf7d2d48f73.jpg',
                'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_6454c79f6b70626da320a7ba840b55c0.jpg',
                'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_4c60a43e5291b2b3aa0284d960415fbc.jpg',
                'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_c3367dd68cb0507c19777ef0c205fa84.jpg',
                'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_0b7302a1b351d401b489a66e755d3742.jpg',
                'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_fb7657752a40108beb378beefd017ea4.jpg',
                'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_faa86ff623cb014bdf5ce2a23087b19c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b98ee7a-ddcd-5888-b5d8-41d64d5d682f/3b98ee7a-ddcd-5888-b5d8-41d64d5d682f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_8ac0ead127130196139807ab2f573338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b98ee7a-ddcd-5888-b5d8-41d64d5d682f/3b98ee7a-ddcd-5888-b5d8-41d64d5d682f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_a8a20b8b96ed9329fd88016f5cb78976.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b98ee7a-ddcd-5888-b5d8-41d64d5d682f/3b98ee7a-ddcd-5888-b5d8-41d64d5d682f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_4c60a43e5291b2b3aa0284d960415fbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b98ee7a-ddcd-5888-b5d8-41d64d5d682f/3b98ee7a-ddcd-5888-b5d8-41d64d5d682f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_c3367dd68cb0507c19777ef0c205fa84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b98ee7a-ddcd-5888-b5d8-41d64d5d682f/3b98ee7a-ddcd-5888-b5d8-41d64d5d682f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_fb7657752a40108beb378beefd017ea4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b98ee7a-ddcd-5888-b5d8-41d64d5d682f/3b98ee7a-ddcd-5888-b5d8-41d64d5d682f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/db/46db87035f249acdda388eec0c5f6b27/pa/YV42226_faa86ff623cb014bdf5ce2a23087b19c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Advance BlueMotion',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion',
 'year': 2015}
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV42226%27 HTTP/1.1" 200 None
2026-03-28 14:06:30 [auto1.es] INFO: Saving data for YV42226: {'created_time': 1774706790.792784, 'last_price_update_time': 1774706790.792796, 'auction_closing_time': 1774882872.0}
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YV42226') HTTP/1.1" 204 0
2026-03-28 14:06:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 8549f804-9b60-57f5-8d7b-2395d46a520f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7abb1501-a1f6-5fa2-afb8-87638f07952b with identifier: YD38751
2026-03-28 14:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7abb1501-a1f6-5fa2-afb8-87638f07952b with identifier: YD38751
2026-03-28 14:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7abb1501-a1f6-5fa2-afb8-87638f07952b with identifier: YD38751 to the API
2026-03-28 14:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:57:54Z',
 'fuel_type': 'diesel',
 'id': '7abb1501-a1f6-5fa2-afb8-87638f07952b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD38751',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 119057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-13',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Longitude 4WD',
 'transmission': 'manual',
 'trim': 'Longitude 4WD',
 'year': 2018}
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD38751%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Saving data for YD38751: {'auction_closing_time': 1774886274.0, 'created_time': 1773410774.725712, 'last_price_update_time': 1774706791.421017}
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YD38751') HTTP/1.1" 204 0
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_1a97d363c21de5f237239ce20964082e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 508912fa-4d34-5727-afb5-2d6561316dcf due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 3b98ee7a-ddcd-5888-b5d8-41d64d5d682f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: MF35221
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF35221%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Scrape type for MF35221: 1
2026-03-28 14:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5d5210>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31e0a1dd-daa0-5169-933a-ba14debbe79a/31e0a1dd-daa0-5169-933a-ba14debbe79a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3e%252F6f3e2bca6ccad8fcd9261ce252a88fab%252Fpa%252FZE38757_7a826147c9e3da7c0bd089abce586f17.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_7a826147c9e3da7c0bd089abce586f17.jpg saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31e0a1dd-daa0-5169-933a-ba14debbe79a
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b5c7050>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_38995d2457db6bea0f58c9bdd73535cf.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_38995d2457db6bea0f58c9bdd73535cf.jpg saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8549f804-9b60-57f5-8d7b-2395d46a520f
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa81390>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31e0a1dd-daa0-5169-933a-ba14debbe79a/31e0a1dd-daa0-5169-933a-ba14debbe79a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3e%252F6f3e2bca6ccad8fcd9261ce252a88fab%252Fpa%252FZE38757_3dbad447d0589f6a4c766d458e1b5ad9.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_3dbad447d0589f6a4c766d458e1b5ad9.jpg saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31e0a1dd-daa0-5169-933a-ba14debbe79a
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a835410>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31e0a1dd-daa0-5169-933a-ba14debbe79a/31e0a1dd-daa0-5169-933a-ba14debbe79a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3e%252F6f3e2bca6ccad8fcd9261ce252a88fab%252Fpa%252FZE38757_75a4a336897b01250a7e7147bfb2d006.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_75a4a336897b01250a7e7147bfb2d006.jpg saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31e0a1dd-daa0-5169-933a-ba14debbe79a
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a931e90>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_d6953c861dd75d5f13282ada16cc1b5e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_d6953c861dd75d5f13282ada16cc1b5e.jpg saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8549f804-9b60-57f5-8d7b-2395d46a520f
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_cdb7ecfe5226bc0ef659647ff264861e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_4219eb87fa94ec3e8a796764750e64e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_607f4e0bde0ddf859bfa8735b20e7a0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN90638/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49c0a8c5-baca-557a-8b52-a59ad2f7573e with identifier: NG71405
2026-03-28 14:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49c0a8c5-baca-557a-8b52-a59ad2f7573e with scrape type 1
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 49c0a8c5-baca-557a-8b52-a59ad2f7573e
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f25cccf34e47d4dd49cda0dd1fe621%252Fpa%252FNG71405_25f4f8fa438740ad4326d580f3538d5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_25f4f8fa438740ad4326d580f3538d5a.jpg not downloaded yet
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: LR44040
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR44040%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Scrape type for LR44040: 1
2026-03-28 14:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_f2a057a1c0b08694c25ac19c27079d6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f25cccf34e47d4dd49cda0dd1fe621%252Fpa%252FNG71405_93fff3fd133d817f82a8d53833cc3b6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_93fff3fd133d817f82a8d53833cc3b6a.jpg not downloaded yet
2026-03-28 14:06:31 [auto1.es] INFO: Channel: 24h | Page: 5 | totalHits: 2696 | hits on page: 40
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa830d0>
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_1a97d363c21de5f237239ce20964082e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_1a97d363c21de5f237239ce20964082e.jpg saved to cache
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8549f804-9b60-57f5-8d7b-2395d46a520f
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: XZ62069
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: LV43298
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: AW26906
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: BF82684
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF82684%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Scrape type for BF82684: 0
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: LS22424
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: JN16141
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN16141%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Scrape type for JN16141: 0
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: RE29158
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE29158%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Scrape type for RE29158: 0
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: XM37259
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM37259%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Scrape type for XM37259: 0
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: DD08743
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: MB84722
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB84722%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Scrape type for MB84722: 0
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: LJ76741
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ76741%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Scrape type for LJ76741: 0
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: EJ15822
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: MY16878
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY16878%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Scrape type for MY16878: 0
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: SR36141
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR36141%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Scrape type for SR36141: 0
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: PW93745
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: RW31062
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: UB86701
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB86701%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Scrape type for UB86701: 0
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: XP60269
2026-03-28 14:06:31 [auto1.es] INFO: Found listing with ID: KL17964
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL17964%27 HTTP/1.1" 200 None
2026-03-28 14:06:31 [auto1.es] INFO: Scrape type for KL17964: 0
2026-03-28 14:06:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 31e0a1dd-daa0-5169-933a-ba14debbe79a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 31e0a1dd-daa0-5169-933a-ba14debbe79a with identifier: ZE38757
2026-03-28 14:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 31e0a1dd-daa0-5169-933a-ba14debbe79a with identifier: ZE38757
2026-03-28 14:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 31e0a1dd-daa0-5169-933a-ba14debbe79a with identifier: ZE38757 to the API
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:32 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:35:06Z',
 'fuel_type': 'diesel',
 'id': '31e0a1dd-daa0-5169-933a-ba14debbe79a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE38757',
 'listing': 'auction',
 'location': 'ES, Girona',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 218768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_50f976937250edf082f97b2cf6472a48.jpg',
                'https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_3dbad447d0589f6a4c766d458e1b5ad9.jpg',
                'https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_7a826147c9e3da7c0bd089abce586f17.jpg',
                'https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_ac85cdf7c6b243ab581db5f906688625.jpg',
                'https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_75a4a336897b01250a7e7147bfb2d006.jpg',
                'https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_bd49d8b7e42bd315edaddf0ffb100d07.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e0a1dd-daa0-5169-933a-ba14debbe79a/31e0a1dd-daa0-5169-933a-ba14debbe79a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_50f976937250edf082f97b2cf6472a48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e0a1dd-daa0-5169-933a-ba14debbe79a/31e0a1dd-daa0-5169-933a-ba14debbe79a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_3dbad447d0589f6a4c766d458e1b5ad9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e0a1dd-daa0-5169-933a-ba14debbe79a/31e0a1dd-daa0-5169-933a-ba14debbe79a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_7a826147c9e3da7c0bd089abce586f17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e0a1dd-daa0-5169-933a-ba14debbe79a/31e0a1dd-daa0-5169-933a-ba14debbe79a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3e/6f3e2bca6ccad8fcd9261ce252a88fab/pa/ZE38757_75a4a336897b01250a7e7147bfb2d006.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.6 HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE38757%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Saving data for ZE38757: {'created_time': 1774706792.598717, 'last_price_update_time': 1774706792.598729, 'auction_closing_time': 1774884906.0}
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZE38757') HTTP/1.1" 204 0
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f25cccf34e47d4dd49cda0dd1fe621%252Fpa%252FNG71405_dfa86d9ae4d69c3dda90120cb5e97da1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_dfa86d9ae4d69c3dda90120cb5e97da1.jpg not downloaded yet
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: NM08693
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM08693%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for NM08693: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: MM24927
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM24927%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for MM24927: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: WG45325
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: MD68479
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: AZ60367
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ60367%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for AZ60367: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: LJ63273
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: EH03748
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH03748%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for EH03748: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: GF33961
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF33961%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for GF33961: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: LX05735
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: FX69665
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX69665%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for FX69665: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: NV64390
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV64390%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for NV64390: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: UH53722
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH53722%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for UH53722: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: UP08006
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: AP47288
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: EG51857
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: TS53334
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: HP31470
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP31470%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for HP31470: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: TW94946
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: KE70928
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: HX30017
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: PE66788
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE66788%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for PE66788: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: WA65207
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA65207%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for WA65207: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: SY19830
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: RR07700
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR07700%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for RR07700: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: RF07402
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: FR94321
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: UA24744
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: US29597
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US29597%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for US29597: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: NJ67875
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: XF82752
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF82752%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for XF82752: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: RK77233
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK77233%27 HTTP/1.1" 200 None
2026-03-28 14:06:32 [auto1.es] INFO: Scrape type for RK77233: 0
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: YJ22884
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: VV48329
2026-03-28 14:06:32 [auto1.es] INFO: Found listing with ID: NR06421
2026-03-28 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR06421%27 HTTP/1.1" 200 None
2026-03-28 14:06:33 [auto1.es] INFO: Scrape type for NR06421: 0
2026-03-28 14:06:33 [auto1.es] INFO: Found listing with ID: UE40961
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE40961%27 HTTP/1.1" 200 None
2026-03-28 14:06:33 [auto1.es] INFO: Scrape type for UE40961: 0
2026-03-28 14:06:33 [auto1.es] INFO: Found listing with ID: KH51643
2026-03-28 14:06:33 [auto1.es] INFO: Found listing with ID: VK88655
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK88655%27 HTTP/1.1" 200 None
2026-03-28 14:06:33 [auto1.es] INFO: Scrape type for VK88655: 0
2026-03-28 14:06:33 [auto1.es] INFO: Found listing with ID: LX19850
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX19850%27 HTTP/1.1" 200 None
2026-03-28 14:06:33 [auto1.es] INFO: Scrape type for LX19850: 0
2026-03-28 14:06:33 [auto1.es] INFO: Found listing with ID: VY33491
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY33491%27 HTTP/1.1" 200 None
2026-03-28 14:06:33 [auto1.es] INFO: Scrape type for VY33491: 0
2026-03-28 14:06:33 [auto1.es] INFO: Found listing with ID: MK70823
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_9235863f01e136a24f540e5e485b0b3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_921090c7aaf716dba808435fc4c4f396.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_606262f9ae2044229fd419f60bfeb1aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 31e0a1dd-daa0-5169-933a-ba14debbe79a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a930fd0>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_cdb7ecfe5226bc0ef659647ff264861e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_cdb7ecfe5226bc0ef659647ff264861e.jpg saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8549f804-9b60-57f5-8d7b-2395d46a520f
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a923b50>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F5f%252F605fc00c1505abfcd43760ce9cbe475a%252Fpa%252FUD02034_4219eb87fa94ec3e8a796764750e64e1.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_4219eb87fa94ec3e8a796764750e64e1.jpg saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8549f804-9b60-57f5-8d7b-2395d46a520f
2026-03-28 14:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8549f804-9b60-57f5-8d7b-2395d46a520f, skipping ID generation
2026-03-28 14:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8549f804-9b60-57f5-8d7b-2395d46a520f with scrape type 1
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8549f804-9b60-57f5-8d7b-2395d46a520f sending to next pipeline
2026-03-28 14:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8549f804-9b60-57f5-8d7b-2395d46a520f, identifier: UD02034
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa50990>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_607f4e0bde0ddf859bfa8735b20e7a0c.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_607f4e0bde0ddf859bfa8735b20e7a0c.jpg saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_25f4f8fa438740ad4326d580f3538d5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f25cccf34e47d4dd49cda0dd1fe621%252Fpa%252FNG71405_40dd1cb01f650161d4056c9ac57ed89e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_40dd1cb01f650161d4056c9ac57ed89e.jpg not downloaded yet
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK89400/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU60183/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT51966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8549f804-9b60-57f5-8d7b-2395d46a520f with identifier: UD02034
2026-03-28 14:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8549f804-9b60-57f5-8d7b-2395d46a520f with identifier: UD02034
2026-03-28 14:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8549f804-9b60-57f5-8d7b-2395d46a520f with identifier: UD02034 to the API
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_4219eb87fa94ec3e8a796764750e64e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:04:40Z',
 'fuel_type': 'diesel',
 'id': '8549f804-9b60-57f5-8d7b-2395d46a520f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD02034',
 'listing': 'auction',
 'location': 'ES, Valladolid',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 411092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_edae1cd3ccb8cb82cb53dba2acdd14d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_938be33ba44fc1be73734286c3bc1578.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_53425da84aa70939652df87bc9ee9bdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_8c1ab0ee077caf057e2ec856227797da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_4219eb87fa94ec3e8a796764750e64e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_d6953c861dd75d5f13282ada16cc1b5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_cdb7ecfe5226bc0ef659647ff264861e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_38995d2457db6bea0f58c9bdd73535cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8549f804-9b60-57f5-8d7b-2395d46a520f/8549f804-9b60-57f5-8d7b-2395d46a520f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/5f/605fc00c1505abfcd43760ce9cbe475a/pa/UD02034_1a97d363c21de5f237239ce20964082e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD02034%27 HTTP/1.1" 200 None
2026-03-28 14:06:33 [auto1.es] INFO: Saving data for UD02034: {'created_time': 1774706793.7619, 'last_price_update_time': 1774706793.761909, 'auction_closing_time': 1774883080.0}
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UD02034') HTTP/1.1" 204 0
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9864d0>
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fdd%252F7ddd597ef5527e5cc771513d74c34565%252Fpa%252FWK81773_f2a057a1c0b08694c25ac19c27079d6c.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_f2a057a1c0b08694c25ac19c27079d6c.jpg saved to cache
2026-03-28 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e
2026-03-28 14:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e with identifier: WK81773
2026-03-28 14:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e with identifier: WK81773
2026-03-28 14:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e with identifier: WK81773 to the API
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:34 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 232,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:23:25Z',
 'fuel_type': 'diesel',
 'id': '6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK81773',
 'listing': 'auction',
 'location': 'ES, Basauri',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 336517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_c88aeccd400b4280bbbafb78faea089e.jpg',
                'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_d59a2e7950810d13a375989c2e8363f4.jpg',
                'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_f2a057a1c0b08694c25ac19c27079d6c.jpg',
                'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_ce896afaf48890f044daded311357865.jpg',
                'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_460594c7c400dff6093ce569dd54f7a4.jpg',
                'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_1243d2a3a9452110030516f39f744f83.jpg',
                'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_a72e345fe2f55ebbc267fd61d4fc1be3.jpg',
                'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_69f547a84a866945272c8710c31669c1.jpg',
                'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_326c81077e5c6e5d75f71e2fee555b3a.jpg',
                'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_f829242a09d048b5f0eae98978f2e4cb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_c88aeccd400b4280bbbafb78faea089e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_f2a057a1c0b08694c25ac19c27079d6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_ce896afaf48890f044daded311357865.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_460594c7c400dff6093ce569dd54f7a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_1243d2a3a9452110030516f39f744f83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_a72e345fe2f55ebbc267fd61d4fc1be3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_69f547a84a866945272c8710c31669c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_326c81077e5c6e5d75f71e2fee555b3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e/6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/dd/7ddd597ef5527e5cc771513d74c34565/pa/WK81773_f829242a09d048b5f0eae98978f2e4cb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-04-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2006}
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK81773%27 HTTP/1.1" 200 None
2026-03-28 14:06:34 [auto1.es] INFO: Saving data for WK81773: {'created_time': 1774706794.646922, 'last_price_update_time': 1774706794.646933, 'auction_closing_time': 1774884205.0}
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WK81773') HTTP/1.1" 204 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f25cccf34e47d4dd49cda0dd1fe621%252Fpa%252FNG71405_f245e22fa8431ba882c0d82740e5009b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_f245e22fa8431ba882c0d82740e5009b.jpg not downloaded yet
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644166ac90>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ffd%252Fdafd665722133a90e2373720d0f4e8d4%252Fpa%252FGH57787_9235863f01e136a24f540e5e485b0b3a.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_9235863f01e136a24f540e5e485b0b3a.jpg saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d
2026-03-28 14:06:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d, skipping ID generation
2026-03-28 14:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d with scrape type 1
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d sending to next pipeline
2026-03-28 14:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d, identifier: GH57787
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a838c10>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_921090c7aaf716dba808435fc4c4f396.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_921090c7aaf716dba808435fc4c4f396.jpg saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53e2b045-f68f-5fe4-8689-10549b8f0546
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aaeed50>
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_606262f9ae2044229fd419f60bfeb1aa.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_606262f9ae2044229fd419f60bfeb1aa.jpg saved to cache
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53e2b045-f68f-5fe4-8689-10549b8f0546
2026-03-28 14:06:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 6ccdcc6e-8a5a-5c00-b671-052ddf2fe97e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU66337> (referer: https://www.auto1.com/v1/car-details-view/GU66337/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d with identifier: GH57787
2026-03-28 14:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d with identifier: GH57787
2026-03-28 14:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f09dd9f-0c1a-5d4c-bb88-accddb9f821d with identifier: GH57787 to the API
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_9235863f01e136a24f540e5e485b0b3a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:04Z',
 'fuel_type': 'diesel',
 'id': '7f09dd9f-0c1a-5d4c-bb88-accddb9f821d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH57787',
 'listing': 'auction',
 'location': 'ES, Colmenar Viejo',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 202273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_fde17b7d4b94e68e6d3c9018165c9a79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_9235863f01e136a24f540e5e485b0b3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_607f4e0bde0ddf859bfa8735b20e7a0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_161f8c878b2c5ab1029ac0a126dcf45e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_e81293a5d222d792081d7a368169d03b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_341983434ba1cd48ed6985ed45bec1c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f09dd9f-0c1a-5d4c-bb88-accddb9f821d/7f09dd9f-0c1a-5d4c-bb88-accddb9f821d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/fd/dafd665722133a90e2373720d0f4e8d4/pa/GH57787_d140bb00abc7a77bdb603ef3ee6cf50c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 2.0 Blue-HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2015}
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH57787%27 HTTP/1.1" 200 None
2026-03-28 14:06:35 [auto1.es] INFO: Saving data for GH57787: {'created_time': 1774706795.338642, 'last_price_update_time': 1774706795.338653, 'auction_closing_time': 1774886224.0}
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GH57787') HTTP/1.1" 204 0
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9b4610>
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c0a8c5-baca-557a-8b52-a59ad2f7573e/49c0a8c5-baca-557a-8b52-a59ad2f7573e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f25cccf34e47d4dd49cda0dd1fe621%252Fpa%252FNG71405_25f4f8fa438740ad4326d580f3538d5a.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_25f4f8fa438740ad4326d580f3538d5a.jpg saved to cache
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49c0a8c5-baca-557a-8b52-a59ad2f7573e
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_dfa86d9ae4d69c3dda90120cb5e97da1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_93fff3fd133d817f82a8d53833cc3b6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f25cccf34e47d4dd49cda0dd1fe621%252Fpa%252FNG71405_bc326ab36e7495d8e6ec5ca19d2794b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_bc326ab36e7495d8e6ec5ca19d2794b5.jpg not downloaded yet
2026-03-28 14:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DH26781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC32522/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CP18304/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_e4e302eee199d83b7920d24c83f9eaac.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6 with identifier: GU66337
2026-03-28 14:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6 with scrape type 1
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_10db95d025215952c8916e4d4b0c9ea2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_10db95d025215952c8916e4d4b0c9ea2.jpg not downloaded yet
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_09eb91557bdd8862d4b0d993a08890c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_09eb91557bdd8862d4b0d993a08890c4.jpg not downloaded yet
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_97d1b1b6c6de44ae52516be6da405e9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_97d1b1b6c6de44ae52516be6da405e9b.jpg not downloaded yet
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_04622dcce63c2c063f0b4bdbc39db07f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_04622dcce63c2c063f0b4bdbc39db07f.jpg not downloaded yet
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_cdfc05d94f2a8b07657c962a94f98b82.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_66a799b78d74763ef01267ad667d4c70.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_29d492fc37aa518a6ba19e629efb409c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_29d492fc37aa518a6ba19e629efb409c.jpg not downloaded yet
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_f245e22fa8431ba882c0d82740e5009b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b387690>
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c0a8c5-baca-557a-8b52-a59ad2f7573e/49c0a8c5-baca-557a-8b52-a59ad2f7573e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f25cccf34e47d4dd49cda0dd1fe621%252Fpa%252FNG71405_dfa86d9ae4d69c3dda90120cb5e97da1.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_dfa86d9ae4d69c3dda90120cb5e97da1.jpg saved to cache
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49c0a8c5-baca-557a-8b52-a59ad2f7573e
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9d2b50>
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c0a8c5-baca-557a-8b52-a59ad2f7573e/49c0a8c5-baca-557a-8b52-a59ad2f7573e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f25cccf34e47d4dd49cda0dd1fe621%252Fpa%252FNG71405_93fff3fd133d817f82a8d53833cc3b6a.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_93fff3fd133d817f82a8d53833cc3b6a.jpg saved to cache
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49c0a8c5-baca-557a-8b52-a59ad2f7573e
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_897caccd96c8a4eba6cc1763d2f1bcc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_897caccd96c8a4eba6cc1763d2f1bcc1.jpg not downloaded yet
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_a53fb01dd391182da891f8de7fa3bf91.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_a53fb01dd391182da891f8de7fa3bf91.jpg not downloaded yet
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9dfbd0>
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F79%252F1679289e82db19df7289d9309fde1006%252Fpa%252FZV53496_e4e302eee199d83b7920d24c83f9eaac.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_e4e302eee199d83b7920d24c83f9eaac.jpg saved to cache
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53e2b045-f68f-5fe4-8689-10549b8f0546
2026-03-28 14:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53e2b045-f68f-5fe4-8689-10549b8f0546, skipping ID generation
2026-03-28 14:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53e2b045-f68f-5fe4-8689-10549b8f0546 with scrape type 1
2026-03-28 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53e2b045-f68f-5fe4-8689-10549b8f0546 sending to next pipeline
2026-03-28 14:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 53e2b045-f68f-5fe4-8689-10549b8f0546, identifier: ZV53496
2026-03-28 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_40dd1cb01f650161d4056c9ac57ed89e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 53e2b045-f68f-5fe4-8689-10549b8f0546 with identifier: ZV53496
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 14:06:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 53e2b045-f68f-5fe4-8689-10549b8f0546 with identifier: ZV53496
2026-03-28 14:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 53e2b045-f68f-5fe4-8689-10549b8f0546 with identifier: ZV53496 to the API
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_e4e302eee199d83b7920d24c83f9eaac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:40:56Z',
 'fuel_type': 'diesel',
 'id': '53e2b045-f68f-5fe4-8689-10549b8f0546',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV53496',
 'listing': 'auction',
 'location': 'ES, Rubí',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 184128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_e4e302eee199d83b7920d24c83f9eaac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_606262f9ae2044229fd419f60bfeb1aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_921090c7aaf716dba808435fc4c4f396.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_09ecea910c3dd3611790fe806fb1de2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_c90718d2a73eaa8cb10b1c430fc24337.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_b0524fef9cfd2b3c5b2c8797ca6bfa93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_a09a797ba273e78c7714eb69a0191707.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_bb307ba36d85fd8585ff507156110d8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53e2b045-f68f-5fe4-8689-10549b8f0546/53e2b045-f68f-5fe4-8689-10549b8f0546_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/79/1679289e82db19df7289d9309fde1006/pa/ZV53496_b32d92a542306fd8af1849a115d99bf1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2014}
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV53496%27 HTTP/1.1" 200 None
2026-03-28 14:06:36 [auto1.es] INFO: Saving data for ZV53496: {'created_time': 1774706796.338776, 'last_price_update_time': 1774706796.338787, 'auction_closing_time': 1774885256.0}
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZV53496') HTTP/1.1" 204 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_7bd125c2d8538b6a6fc0e9b89d1f55b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_7bd125c2d8538b6a6fc0e9b89d1f55b3.jpg not downloaded yet
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa493d0>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b485adc-2451-540a-af82-13790129b8d7/1b485adc-2451-540a-af82-13790129b8d7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e853dfdc8efb8d9dd52c2440dd8f66%252Fpa%252FBX14033_cdfc05d94f2a8b07657c962a94f98b82.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_cdfc05d94f2a8b07657c962a94f98b82.jpg saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b485adc-2451-540a-af82-13790129b8d7
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9d7cd0>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b485adc-2451-540a-af82-13790129b8d7/1b485adc-2451-540a-af82-13790129b8d7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e853dfdc8efb8d9dd52c2440dd8f66%252Fpa%252FBX14033_66a799b78d74763ef01267ad667d4c70.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_66a799b78d74763ef01267ad667d4c70.jpg saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b485adc-2451-540a-af82-13790129b8d7
2026-03-28 14:06:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b485adc-2451-540a-af82-13790129b8d7, skipping ID generation
2026-03-28 14:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b485adc-2451-540a-af82-13790129b8d7 with scrape type 1
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b485adc-2451-540a-af82-13790129b8d7 sending to next pipeline
2026-03-28 14:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b485adc-2451-540a-af82-13790129b8d7, identifier: BX14033
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aaab810>
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c0a8c5-baca-557a-8b52-a59ad2f7573e/49c0a8c5-baca-557a-8b52-a59ad2f7573e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f25cccf34e47d4dd49cda0dd1fe621%252Fpa%252FNG71405_f245e22fa8431ba882c0d82740e5009b.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_f245e22fa8431ba882c0d82740e5009b.jpg saved to cache
2026-03-28 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49c0a8c5-baca-557a-8b52-a59ad2f7573e
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_97d1b1b6c6de44ae52516be6da405e9b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_04622dcce63c2c063f0b4bdbc39db07f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ95264> (referer: https://www.auto1.com/v1/car-details-view/KZ95264/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b485adc-2451-540a-af82-13790129b8d7 with identifier: BX14033
2026-03-28 14:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b485adc-2451-540a-af82-13790129b8d7 with identifier: BX14033
2026-03-28 14:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b485adc-2451-540a-af82-13790129b8d7 with identifier: BX14033 to the API
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_66a799b78d74763ef01267ad667d4c70.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:56:59Z',
 'fuel_type': 'diesel',
 'id': '1b485adc-2451-540a-af82-13790129b8d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX14033',
 'listing': 'auction',
 'location': 'ES, Granollers',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 253752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b485adc-2451-540a-af82-13790129b8d7/1b485adc-2451-540a-af82-13790129b8d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_66a799b78d74763ef01267ad667d4c70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b485adc-2451-540a-af82-13790129b8d7/1b485adc-2451-540a-af82-13790129b8d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_9ecf5f05a84882651b83f68cfd8875ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b485adc-2451-540a-af82-13790129b8d7/1b485adc-2451-540a-af82-13790129b8d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_c3148e713d8f1bf7b498caaa5f7c928f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b485adc-2451-540a-af82-13790129b8d7/1b485adc-2451-540a-af82-13790129b8d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_cdfc05d94f2a8b07657c962a94f98b82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b485adc-2451-540a-af82-13790129b8d7/1b485adc-2451-540a-af82-13790129b8d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/e8/70e853dfdc8efb8d9dd52c2440dd8f66/pa/BX14033_20e33c19845f90720b9fe0a00fc54757.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2010}
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX14033%27 HTTP/1.1" 200 None
2026-03-28 14:06:36 [auto1.es] INFO: Saving data for BX14033: {'created_time': 1774706796.969685, 'last_price_update_time': 1774706796.969694, 'auction_closing_time': 1774886219.0}
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BX14033') HTTP/1.1" 204 0
2026-03-28 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_09eb91557bdd8862d4b0d993a08890c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_66a203c200302e8be5921a5f99d74de5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_66a203c200302e8be5921a5f99d74de5.jpg not downloaded yet
2026-03-28 14:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD78517> (referer: https://www.auto1.com/v1/car-details-view/DD78517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a94fb90>
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49c0a8c5-baca-557a-8b52-a59ad2f7573e/49c0a8c5-baca-557a-8b52-a59ad2f7573e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f25cccf34e47d4dd49cda0dd1fe621%252Fpa%252FNG71405_40dd1cb01f650161d4056c9ac57ed89e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_40dd1cb01f650161d4056c9ac57ed89e.jpg saved to cache
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49c0a8c5-baca-557a-8b52-a59ad2f7573e
2026-03-28 14:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF35221/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY48827> (referer: https://www.auto1.com/v1/car-details-view/GY48827/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_0da33d3de58f2403ae4d5597e2fbe49a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_0da33d3de58f2403ae4d5597e2fbe49a.jpg not downloaded yet
2026-03-28 14:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a958fd0>
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_97d1b1b6c6de44ae52516be6da405e9b.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_97d1b1b6c6de44ae52516be6da405e9b.jpg saved to cache
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a97f3d0>
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_04622dcce63c2c063f0b4bdbc39db07f.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_04622dcce63c2c063f0b4bdbc39db07f.jpg saved to cache
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6
2026-03-28 14:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37aab2a0-264e-55f9-9d94-91468e66fe01 with identifier: KZ95264
2026-03-28 14:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37aab2a0-264e-55f9-9d94-91468e66fe01 with scrape type 1
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 37aab2a0-264e-55f9-9d94-91468e66fe01
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F2b%252F992bb5517f0859744ebc3aa526368ad8%252Fpa%252FKZ95264_9518cd2bb0f516cf94f68848993997cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_9518cd2bb0f516cf94f68848993997cf.jpg not downloaded yet
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F2b%252F992bb5517f0859744ebc3aa526368ad8%252Fpa%252FKZ95264_c6bec8653237f1b9b44f0275d8e1f583.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_c6bec8653237f1b9b44f0275d8e1f583.jpg not downloaded yet
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_7bd125c2d8538b6a6fc0e9b89d1f55b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a98fc90>
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_09eb91557bdd8862d4b0d993a08890c4.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_09eb91557bdd8862d4b0d993a08890c4.jpg saved to cache
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6
2026-03-28 14:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfbac497-0745-5922-9284-ee6513af0b5c with identifier: DD78517
2026-03-28 14:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfbac497-0745-5922-9284-ee6513af0b5c with scrape type 1
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfbac497-0745-5922-9284-ee6513af0b5c
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_764668b1a105e5f444e8871df88ac956.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_764668b1a105e5f444e8871df88ac956.jpg not downloaded yet
2026-03-28 14:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42b50bee-f7f5-55d2-8439-e51745b98132 with identifier: GY48827
2026-03-28 14:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42b50bee-f7f5-55d2-8439-e51745b98132 with scrape type 1
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 42b50bee-f7f5-55d2-8439-e51745b98132
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3c%252F753c0d3812e975ad50ed49b58a748038%252Fpa%252FGY48827_e4081de26f27f4bace7c6b8db8a328be.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_e4081de26f27f4bace7c6b8db8a328be.jpg not downloaded yet
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F2b%252F992bb5517f0859744ebc3aa526368ad8%252Fpa%252FKZ95264_187be14f18b1a60071086f16e58e26ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_187be14f18b1a60071086f16e58e26ee.jpg not downloaded yet
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_b03b2c3b4fdfc3dc7239ad8e3b4fa587.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_b03b2c3b4fdfc3dc7239ad8e3b4fa587.jpg not downloaded yet
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3c%252F753c0d3812e975ad50ed49b58a748038%252Fpa%252FGY48827_8b55f7c590262c43c1a279016f01f714.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_8b55f7c590262c43c1a279016f01f714.jpg not downloaded yet
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_897caccd96c8a4eba6cc1763d2f1bcc1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_66a203c200302e8be5921a5f99d74de5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_a53fb01dd391182da891f8de7fa3bf91.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F2b%252F992bb5517f0859744ebc3aa526368ad8%252Fpa%252FKZ95264_d2ad4e7518d2d85b207969ac8aa0f58d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_d2ad4e7518d2d85b207969ac8aa0f58d.jpg not downloaded yet
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_29d492fc37aa518a6ba19e629efb409c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_40d06b81a5ab24622678cbf4747590fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_40d06b81a5ab24622678cbf4747590fa.jpg not downloaded yet
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3c%252F753c0d3812e975ad50ed49b58a748038%252Fpa%252FGY48827_55acd282f1a3ffd418e9f2b79ac53c37.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_55acd282f1a3ffd418e9f2b79ac53c37.jpg not downloaded yet
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b427b90>
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_7bd125c2d8538b6a6fc0e9b89d1f55b3.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_7bd125c2d8538b6a6fc0e9b89d1f55b3.jpg saved to cache
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_9518cd2bb0f516cf94f68848993997cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F2b%252F992bb5517f0859744ebc3aa526368ad8%252Fpa%252FKZ95264_d2795ab571cf53224b53dc0942f5e420.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_d2795ab571cf53224b53dc0942f5e420.jpg not downloaded yet
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_8af0b5a6b0eb2e53338c488af3fc8616.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_8af0b5a6b0eb2e53338c488af3fc8616.jpg not downloaded yet
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3c%252F753c0d3812e975ad50ed49b58a748038%252Fpa%252FGY48827_eb3d7011991b149eb4a0881455f65ab8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_eb3d7011991b149eb4a0881455f65ab8.jpg not downloaded yet
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN90638> (referer: https://www.auto1.com/v1/car-details-view/VN90638/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F2b%252F992bb5517f0859744ebc3aa526368ad8%252Fpa%252FKZ95264_2d9d79818db0cf984dd90edc88d41fe1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_2d9d79818db0cf984dd90edc88d41fe1.jpg not downloaded yet
2026-03-28 14:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa12c10>
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_897caccd96c8a4eba6cc1763d2f1bcc1.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_897caccd96c8a4eba6cc1763d2f1bcc1.jpg saved to cache
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa5e1d0>
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_66a203c200302e8be5921a5f99d74de5.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_66a203c200302e8be5921a5f99d74de5.jpg saved to cache
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b318650>
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_a53fb01dd391182da891f8de7fa3bf91.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_a53fb01dd391182da891f8de7fa3bf91.jpg saved to cache
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_9209bd9fc564a13f355dc78ad1065720.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_9209bd9fc564a13f355dc78ad1065720.jpg not downloaded yet
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3c%252F753c0d3812e975ad50ed49b58a748038%252Fpa%252FGY48827_121d6a528606561988be82d4dd3cc947.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_121d6a528606561988be82d4dd3cc947.jpg not downloaded yet
2026-03-28 14:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG52328> (referer: https://www.auto1.com/v1/car-details-view/LG52328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa5d390>
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb8%252Fa7b8f836ff4c46a675bb48f9f35db779%252Fpa%252FGU66337_29d492fc37aa518a6ba19e629efb409c.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_29d492fc37aa518a6ba19e629efb409c.jpg saved to cache
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_e4081de26f27f4bace7c6b8db8a328be.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_d2ad4e7518d2d85b207969ac8aa0f58d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_187be14f18b1a60071086f16e58e26ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_8b55f7c590262c43c1a279016f01f714.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_af1eea75044224ae345a46d656609d4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_af1eea75044224ae345a46d656609d4a.jpg not downloaded yet
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3c%252F753c0d3812e975ad50ed49b58a748038%252Fpa%252FGY48827_23e11ccdb90bfb4cda408d7408a4f631.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_23e11ccdb90bfb4cda408d7408a4f631.jpg not downloaded yet
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3f8c90>
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37aab2a0-264e-55f9-9d94-91468e66fe01/37aab2a0-264e-55f9-9d94-91468e66fe01_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F2b%252F992bb5517f0859744ebc3aa526368ad8%252Fpa%252FKZ95264_9518cd2bb0f516cf94f68848993997cf.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_9518cd2bb0f516cf94f68848993997cf.jpg saved to cache
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37aab2a0-264e-55f9-9d94-91468e66fe01
2026-03-28 14:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cedfdfd-6524-530a-81f9-50c8e417a7b2 with identifier: VN90638
2026-03-28 14:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cedfdfd-6524-530a-81f9-50c8e417a7b2 with scrape type 1
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0cedfdfd-6524-530a-81f9-50c8e417a7b2
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd8%252F81d81456f2abd99d495c6c2cca697140%252Fpa%252FVN90638_236b382890fc02b6fd15cdf7d8a3930e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_236b382890fc02b6fd15cdf7d8a3930e.jpg not downloaded yet
2026-03-28 14:06:37 [auto1.es] INFO: Channel: 24h | Page: 6 | totalHits: 2696 | hits on page: 40
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_ef70df16b38a1a247c6ad4280d985593.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_ef70df16b38a1a247c6ad4280d985593.jpg not downloaded yet
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd8%252F81d81456f2abd99d495c6c2cca697140%252Fpa%252FVN90638_2cc7223e841400a514033c79f4d5d280.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_2cc7223e841400a514033c79f4d5d280.jpg not downloaded yet
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: WJ13987
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ13987%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [auto1.es] INFO: Scrape type for WJ13987: 0
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: CV66475
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: WV13003
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: RU20773
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: DX72954
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: VA33750
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: SR52978
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR52978%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [auto1.es] INFO: Scrape type for SR52978: 0
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: BA23720
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: PL84711
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: AZ04928
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: ZK54179
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: JA60709
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: BK75900
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK75900%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [auto1.es] INFO: Scrape type for BK75900: 0
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: EF82008
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF82008%27 HTTP/1.1" 200 None
2026-03-28 14:06:37 [auto1.es] INFO: Scrape type for EF82008: 0
2026-03-28 14:06:37 [auto1.es] INFO: Found listing with ID: TX62344
2026-03-28 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX62344%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for TX62344: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: CY52892
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: RW90517
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: KK87704
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: AF53027
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: NX17648
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: RX17538
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX17538%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for RX17538: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: PP42780
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP42780%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for PP42780: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: EK21860
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK21860%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for EK21860: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: EM88527
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM88527%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for EM88527: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: ML70720
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML70720%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for ML70720: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: XA25667
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: LH42756
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH42756%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for LH42756: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: YS26400
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS26400%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for YS26400: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: DL67174
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL67174%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for DL67174: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: VT22035
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT22035%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for VT22035: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: BM94316
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM94316%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for BM94316: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: NP14618
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP14618%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for NP14618: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: MS21138
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS21138%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for MS21138: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: EG18417
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG18417%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for EG18417: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: MH61134
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH61134%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for MH61134: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: SJ29812
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: YR47021
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR47021%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for YR47021: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: HD15587
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD15587%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for HD15587: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: RV46161
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV46161%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for RV46161: 0
2026-03-28 14:06:38 [auto1.es] INFO: Found listing with ID: BE52894
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE52894%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [auto1.es] INFO: Scrape type for BE52894: 0
2026-03-28 14:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7597be81-6d94-58a1-988c-77ebaa7736c2 with identifier: LG52328
2026-03-28 14:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7597be81-6d94-58a1-988c-77ebaa7736c2 with scrape type 1
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7597be81-6d94-58a1-988c-77ebaa7736c2
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F55%252F6f5554b427be0ed365664e6097fdd804%252Fpa%252FLG52328_64ae93960766ec894dfd596de5bce6cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_64ae93960766ec894dfd596de5bce6cf.jpg already downloaded
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F55%252F6f5554b427be0ed365664e6097fdd804%252Fpa%252FLG52328_a7427a65196f30a2f71e14af5b87fb11.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_a7427a65196f30a2f71e14af5b87fb11.jpg already downloaded
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F55%252F6f5554b427be0ed365664e6097fdd804%252Fpa%252FLG52328_9f19098043148a6fd39978ee07bd1cc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_9f19098043148a6fd39978ee07bd1cc1.jpg already downloaded
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F55%252F6f5554b427be0ed365664e6097fdd804%252Fpa%252FLG52328_a50621ffc02dfb4897f7332d2130bbf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_a50621ffc02dfb4897f7332d2130bbf3.jpg already downloaded
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F55%252F6f5554b427be0ed365664e6097fdd804%252Fpa%252FLG52328_36d011e1c1ef2789500096a0c9453ebd.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_36d011e1c1ef2789500096a0c9453ebd.jpg already downloaded
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F55%252F6f5554b427be0ed365664e6097fdd804%252Fpa%252FLG52328_32a45856a08f41df23f8ef7cedcc4b1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_32a45856a08f41df23f8ef7cedcc4b1b.jpg already downloaded
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F55%252F6f5554b427be0ed365664e6097fdd804%252Fpa%252FLG52328_7a2f565cde5b38081da0b51630a862ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_7a2f565cde5b38081da0b51630a862ec.jpg already downloaded
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F55%252F6f5554b427be0ed365664e6097fdd804%252Fpa%252FLG52328_26047abce2f286e297935ae173ca37ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_26047abce2f286e297935ae173ca37ae.jpg already downloaded
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F55%252F6f5554b427be0ed365664e6097fdd804%252Fpa%252FLG52328_087469d97a2e3e8a92ac2e91f5120782.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_087469d97a2e3e8a92ac2e91f5120782.jpg already downloaded
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F55%252F6f5554b427be0ed365664e6097fdd804%252Fpa%252FLG52328_57d7326a0b023fd9cb3c5e2eb49acfc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_57d7326a0b023fd9cb3c5e2eb49acfc0.jpg already downloaded
2026-03-28 14:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7597be81-6d94-58a1-988c-77ebaa7736c2, identifier: LG52328
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4440d0>
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b50bee-f7f5-55d2-8439-e51745b98132/42b50bee-f7f5-55d2-8439-e51745b98132_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3c%252F753c0d3812e975ad50ed49b58a748038%252Fpa%252FGY48827_e4081de26f27f4bace7c6b8db8a328be.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_e4081de26f27f4bace7c6b8db8a328be.jpg saved to cache
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42b50bee-f7f5-55d2-8439-e51745b98132
2026-03-28 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_d2795ab571cf53224b53dc0942f5e420.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_ee686d0f4fcfc8098c685619fe10a204.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_ee686d0f4fcfc8098c685619fe10a204.jpg not downloaded yet
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd8%252F81d81456f2abd99d495c6c2cca697140%252Fpa%252FVN90638_1aea5df2bc062afdd34145f596a873bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_1aea5df2bc062afdd34145f596a873bc.jpg not downloaded yet
2026-03-28 14:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7597be81-6d94-58a1-988c-77ebaa7736c2 with identifier: LG52328
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:06:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 14:06:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7597be81-6d94-58a1-988c-77ebaa7736c2 with identifier: LG52328
2026-03-28 14:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7597be81-6d94-58a1-988c-77ebaa7736c2 with identifier: LG52328 to the API
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LG52328>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:23:55Z',
 'fuel_type': 'hybrid',
 'id': '7597be81-6d94-58a1-988c-77ebaa7736c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG52328',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 28969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_64ae93960766ec894dfd596de5bce6cf.jpg',
                'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_a7427a65196f30a2f71e14af5b87fb11.jpg',
                'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_9f19098043148a6fd39978ee07bd1cc1.jpg',
                'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_a50621ffc02dfb4897f7332d2130bbf3.jpg',
                'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_36d011e1c1ef2789500096a0c9453ebd.jpg',
                'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_32a45856a08f41df23f8ef7cedcc4b1b.jpg',
                'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_7a2f565cde5b38081da0b51630a862ec.jpg',
                'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_26047abce2f286e297935ae173ca37ae.jpg',
                'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_087469d97a2e3e8a92ac2e91f5120782.jpg',
                'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_57d7326a0b023fd9cb3c5e2eb49acfc0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7597be81-6d94-58a1-988c-77ebaa7736c2/7597be81-6d94-58a1-988c-77ebaa7736c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_64ae93960766ec894dfd596de5bce6cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7597be81-6d94-58a1-988c-77ebaa7736c2/7597be81-6d94-58a1-988c-77ebaa7736c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_a7427a65196f30a2f71e14af5b87fb11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7597be81-6d94-58a1-988c-77ebaa7736c2/7597be81-6d94-58a1-988c-77ebaa7736c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_9f19098043148a6fd39978ee07bd1cc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7597be81-6d94-58a1-988c-77ebaa7736c2/7597be81-6d94-58a1-988c-77ebaa7736c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_a50621ffc02dfb4897f7332d2130bbf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7597be81-6d94-58a1-988c-77ebaa7736c2/7597be81-6d94-58a1-988c-77ebaa7736c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_36d011e1c1ef2789500096a0c9453ebd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7597be81-6d94-58a1-988c-77ebaa7736c2/7597be81-6d94-58a1-988c-77ebaa7736c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_32a45856a08f41df23f8ef7cedcc4b1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7597be81-6d94-58a1-988c-77ebaa7736c2/7597be81-6d94-58a1-988c-77ebaa7736c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_7a2f565cde5b38081da0b51630a862ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7597be81-6d94-58a1-988c-77ebaa7736c2/7597be81-6d94-58a1-988c-77ebaa7736c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_26047abce2f286e297935ae173ca37ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7597be81-6d94-58a1-988c-77ebaa7736c2/7597be81-6d94-58a1-988c-77ebaa7736c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_087469d97a2e3e8a92ac2e91f5120782.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7597be81-6d94-58a1-988c-77ebaa7736c2/7597be81-6d94-58a1-988c-77ebaa7736c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/55/6f5554b427be0ed365664e6097fdd804/pa/LG52328_57d7326a0b023fd9cb3c5e2eb49acfc0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 VC-T e-POWER N-Connecta+',
 'transmission': 'automatic',
 'trim': 'N-Connecta+',
 'year': 2024}
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG52328%27 HTTP/1.1" 200 None
2026-03-28 14:06:39 [auto1.es] INFO: Saving data for LG52328: {'created_time': 1774706799.376837, 'last_price_update_time': 1774706799.376847, 'auction_closing_time': 1774884235.0}
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LG52328') HTTP/1.1" 204 0
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_9209bd9fc564a13f355dc78ad1065720.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_2d9d79818db0cf984dd90edc88d41fe1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_121d6a528606561988be82d4dd3cc947.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_55acd282f1a3ffd418e9f2b79ac53c37.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR44040/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT51966> (referer: https://www.auto1.com/v1/car-details-view/BT51966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU60183> (referer: https://www.auto1.com/v1/car-details-view/WU60183/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b487090>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37aab2a0-264e-55f9-9d94-91468e66fe01/37aab2a0-264e-55f9-9d94-91468e66fe01_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F2b%252F992bb5517f0859744ebc3aa526368ad8%252Fpa%252FKZ95264_d2ad4e7518d2d85b207969ac8aa0f58d.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_d2ad4e7518d2d85b207969ac8aa0f58d.jpg saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37aab2a0-264e-55f9-9d94-91468e66fe01
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a91d010>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37aab2a0-264e-55f9-9d94-91468e66fe01/37aab2a0-264e-55f9-9d94-91468e66fe01_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F2b%252F992bb5517f0859744ebc3aa526368ad8%252Fpa%252FKZ95264_187be14f18b1a60071086f16e58e26ee.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_187be14f18b1a60071086f16e58e26ee.jpg saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37aab2a0-264e-55f9-9d94-91468e66fe01
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b38bdd0>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b50bee-f7f5-55d2-8439-e51745b98132/42b50bee-f7f5-55d2-8439-e51745b98132_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3c%252F753c0d3812e975ad50ed49b58a748038%252Fpa%252FGY48827_8b55f7c590262c43c1a279016f01f714.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_8b55f7c590262c43c1a279016f01f714.jpg saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 42b50bee-f7f5-55d2-8439-e51745b98132
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_fcae5bd64d90a866435aaa63e9547dd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_fcae5bd64d90a866435aaa63e9547dd2.jpg not downloaded yet
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd8%252F81d81456f2abd99d495c6c2cca697140%252Fpa%252FVN90638_49bdacc158cc4c3311a69c055e36280c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_49bdacc158cc4c3311a69c055e36280c.jpg not downloaded yet
2026-03-28 14:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK89400> (referer: https://www.auto1.com/v1/car-details-view/LK89400/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a898dd0>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37aab2a0-264e-55f9-9d94-91468e66fe01/37aab2a0-264e-55f9-9d94-91468e66fe01_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F2b%252F992bb5517f0859744ebc3aa526368ad8%252Fpa%252FKZ95264_d2795ab571cf53224b53dc0942f5e420.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_d2795ab571cf53224b53dc0942f5e420.jpg saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37aab2a0-264e-55f9-9d94-91468e66fe01
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_a7a05da349729f750e969e8fc9d1299f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_a7a05da349729f750e969e8fc9d1299f.jpg not downloaded yet
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd8%252F81d81456f2abd99d495c6c2cca697140%252Fpa%252FVN90638_ab61ef89fffd8410cc2e75a47695e00f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_ab61ef89fffd8410cc2e75a47695e00f.jpg not downloaded yet
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3f9510>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbac497-0745-5922-9284-ee6513af0b5c/dfbac497-0745-5922-9284-ee6513af0b5c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_9209bd9fc564a13f355dc78ad1065720.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_9209bd9fc564a13f355dc78ad1065720.jpg saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfbac497-0745-5922-9284-ee6513af0b5c
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a86fd50>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37aab2a0-264e-55f9-9d94-91468e66fe01/37aab2a0-264e-55f9-9d94-91468e66fe01_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F2b%252F992bb5517f0859744ebc3aa526368ad8%252Fpa%252FKZ95264_2d9d79818db0cf984dd90edc88d41fe1.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_2d9d79818db0cf984dd90edc88d41fe1.jpg saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37aab2a0-264e-55f9-9d94-91468e66fe01
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6441640690>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b50bee-f7f5-55d2-8439-e51745b98132/42b50bee-f7f5-55d2-8439-e51745b98132_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3c%252F753c0d3812e975ad50ed49b58a748038%252Fpa%252FGY48827_121d6a528606561988be82d4dd3cc947.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_121d6a528606561988be82d4dd3cc947.jpg saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 42b50bee-f7f5-55d2-8439-e51745b98132
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a999d90>
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b50bee-f7f5-55d2-8439-e51745b98132/42b50bee-f7f5-55d2-8439-e51745b98132_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3c%252F753c0d3812e975ad50ed49b58a748038%252Fpa%252FGY48827_55acd282f1a3ffd418e9f2b79ac53c37.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_55acd282f1a3ffd418e9f2b79ac53c37.jpg saved to cache
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 42b50bee-f7f5-55d2-8439-e51745b98132
2026-03-28 14:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae0f6d0-a5c7-506b-af09-b033d54bc633 with identifier: BT51966
2026-03-28 14:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae0f6d0-a5c7-506b-af09-b033d54bc633 with scrape type 1
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ae0f6d0-a5c7-506b-af09-b033d54bc633
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F8d%252Fb38d2c1f9cd31bebe1afa8a2b86d6aae%252Fpa%252FBT51966_bd5eb9fb226b67ab7809c000460d18fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_bd5eb9fb226b67ab7809c000460d18fd.jpg already downloaded
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F8d%252Fb38d2c1f9cd31bebe1afa8a2b86d6aae%252Fpa%252FBT51966_39c378a1e509412a5a27fba41c67aedc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_39c378a1e509412a5a27fba41c67aedc.jpg already downloaded
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F8d%252Fb38d2c1f9cd31bebe1afa8a2b86d6aae%252Fpa%252FBT51966_16564d102511da65e96ada8910decc5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_16564d102511da65e96ada8910decc5b.jpg already downloaded
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F8d%252Fb38d2c1f9cd31bebe1afa8a2b86d6aae%252Fpa%252FBT51966_f9958e515d4745a33596b438492c7d7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_f9958e515d4745a33596b438492c7d7c.jpg already downloaded
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F8d%252Fb38d2c1f9cd31bebe1afa8a2b86d6aae%252Fpa%252FBT51966_b5d4b9744b269c8282b776c1585bcb6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_b5d4b9744b269c8282b776c1585bcb6a.jpg already downloaded
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F8d%252Fb38d2c1f9cd31bebe1afa8a2b86d6aae%252Fpa%252FBT51966_c8830ff4161d2aee2ff9d5f5a4b4e2ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_c8830ff4161d2aee2ff9d5f5a4b4e2ac.jpg already downloaded
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F8d%252Fb38d2c1f9cd31bebe1afa8a2b86d6aae%252Fpa%252FBT51966_6933996be0c3a4032d1e9a637ab4a038.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_6933996be0c3a4032d1e9a637ab4a038.jpg already downloaded
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F8d%252Fb38d2c1f9cd31bebe1afa8a2b86d6aae%252Fpa%252FBT51966_dccebd9fc71d1475a46c30fcf52ba2ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_dccebd9fc71d1475a46c30fcf52ba2ea.jpg already downloaded
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F8d%252Fb38d2c1f9cd31bebe1afa8a2b86d6aae%252Fpa%252FBT51966_ef63ea602c7f8151cae0dd9662e4d6ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_ef63ea602c7f8151cae0dd9662e4d6ce.jpg already downloaded
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F8d%252Fb38d2c1f9cd31bebe1afa8a2b86d6aae%252Fpa%252FBT51966_247bb8b4b18c2ed095a743022d7f3b21.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_247bb8b4b18c2ed095a743022d7f3b21.jpg already downloaded
2026-03-28 14:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8ae0f6d0-a5c7-506b-af09-b033d54bc633, identifier: BT51966
2026-03-28 14:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 563a4ff4-54c9-5e84-9268-842a1b727fa2 with identifier: WU60183
2026-03-28 14:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 563a4ff4-54c9-5e84-9268-842a1b727fa2 with scrape type 1
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 563a4ff4-54c9-5e84-9268-842a1b727fa2
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb3%252F03b36e9e70c2e0386b28220244fd2979%252Fpa%252FWU60183_172d91a1d94a43c981d6d7530494a0d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_172d91a1d94a43c981d6d7530494a0d3.jpg not downloaded yet
2026-03-28 14:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8ae0f6d0-a5c7-506b-af09-b033d54bc633 with identifier: BT51966
2026-03-28 14:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8ae0f6d0-a5c7-506b-af09-b033d54bc633 with identifier: BT51966
2026-03-28 14:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8ae0f6d0-a5c7-506b-af09-b033d54bc633 with identifier: BT51966 to the API
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BT51966>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-03-30T15:55:02Z',
 'fuel_type': 'petrol',
 'id': '8ae0f6d0-a5c7-506b-af09-b033d54bc633',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT51966',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Fiat',
 'model': '500',
 'odometer': 164596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_bd5eb9fb226b67ab7809c000460d18fd.jpg',
                'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_39c378a1e509412a5a27fba41c67aedc.jpg',
                'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_16564d102511da65e96ada8910decc5b.jpg',
                'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_f9958e515d4745a33596b438492c7d7c.jpg',
                'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_b5d4b9744b269c8282b776c1585bcb6a.jpg',
                'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_c8830ff4161d2aee2ff9d5f5a4b4e2ac.jpg',
                'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_6933996be0c3a4032d1e9a637ab4a038.jpg',
                'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_dccebd9fc71d1475a46c30fcf52ba2ea.jpg',
                'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_ef63ea602c7f8151cae0dd9662e4d6ce.jpg',
                'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_247bb8b4b18c2ed095a743022d7f3b21.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae0f6d0-a5c7-506b-af09-b033d54bc633/8ae0f6d0-a5c7-506b-af09-b033d54bc633_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_bd5eb9fb226b67ab7809c000460d18fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae0f6d0-a5c7-506b-af09-b033d54bc633/8ae0f6d0-a5c7-506b-af09-b033d54bc633_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_39c378a1e509412a5a27fba41c67aedc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae0f6d0-a5c7-506b-af09-b033d54bc633/8ae0f6d0-a5c7-506b-af09-b033d54bc633_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_16564d102511da65e96ada8910decc5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae0f6d0-a5c7-506b-af09-b033d54bc633/8ae0f6d0-a5c7-506b-af09-b033d54bc633_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_f9958e515d4745a33596b438492c7d7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae0f6d0-a5c7-506b-af09-b033d54bc633/8ae0f6d0-a5c7-506b-af09-b033d54bc633_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_b5d4b9744b269c8282b776c1585bcb6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae0f6d0-a5c7-506b-af09-b033d54bc633/8ae0f6d0-a5c7-506b-af09-b033d54bc633_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_c8830ff4161d2aee2ff9d5f5a4b4e2ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae0f6d0-a5c7-506b-af09-b033d54bc633/8ae0f6d0-a5c7-506b-af09-b033d54bc633_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_6933996be0c3a4032d1e9a637ab4a038.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae0f6d0-a5c7-506b-af09-b033d54bc633/8ae0f6d0-a5c7-506b-af09-b033d54bc633_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_dccebd9fc71d1475a46c30fcf52ba2ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae0f6d0-a5c7-506b-af09-b033d54bc633/8ae0f6d0-a5c7-506b-af09-b033d54bc633_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_ef63ea602c7f8151cae0dd9662e4d6ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ae0f6d0-a5c7-506b-af09-b033d54bc633/8ae0f6d0-a5c7-506b-af09-b033d54bc633_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/8d/b38d2c1f9cd31bebe1afa8a2b86d6aae/pa/BT51966_247bb8b4b18c2ed095a743022d7f3b21.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2020}
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT51966%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [auto1.es] INFO: Saving data for BT51966: {'created_time': 1774706800.553759, 'last_price_update_time': 1774706800.55377, 'auction_closing_time': 1774886102.0}
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BT51966') HTTP/1.1" 204 0
2026-03-28 14:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_ef70df16b38a1a247c6ad4280d985593.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_236b382890fc02b6fd15cdf7d8a3930e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd8%252F81d81456f2abd99d495c6c2cca697140%252Fpa%252FVN90638_3ef9fc10f0858bd3ef6e48f96270b21e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_3ef9fc10f0858bd3ef6e48f96270b21e.jpg not downloaded yet
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb3%252F03b36e9e70c2e0386b28220244fd2979%252Fpa%252FWU60183_17f6437e6158aaabcc12b65f6b723aae.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_17f6437e6158aaabcc12b65f6b723aae.jpg not downloaded yet
2026-03-28 14:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_2cc7223e841400a514033c79f4d5d280.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_1aea5df2bc062afdd34145f596a873bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 42b50bee-f7f5-55d2-8439-e51745b98132 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item dfbac497-0745-5922-9284-ee6513af0b5c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_23e11ccdb90bfb4cda408d7408a4f631.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb3%252F03b36e9e70c2e0386b28220244fd2979%252Fpa%252FWU60183_9153a3e8adf72c1fc4f8d44310aac0a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_9153a3e8adf72c1fc4f8d44310aac0a7.jpg not downloaded yet
2026-03-28 14:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC66995> (referer: https://www.auto1.com/v1/car-details-view/FC66995/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 409b5ee9-4091-58ee-9701-c1b403a6533f with identifier: LK89400
2026-03-28 14:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 409b5ee9-4091-58ee-9701-c1b403a6533f with scrape type 1
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 409b5ee9-4091-58ee-9701-c1b403a6533f
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_bd6c95a76580db009f332a586dcfb3bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_bd6c95a76580db009f332a586dcfb3bc.jpg not downloaded yet
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb3%252F03b36e9e70c2e0386b28220244fd2979%252Fpa%252FWU60183_58bc0253ed9ef9eed8bb66db4e08cc44.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_58bc0253ed9ef9eed8bb66db4e08cc44.jpg not downloaded yet
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_c1b5428df786f4d0ba675912a97aa5bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_c1b5428df786f4d0ba675912a97aa5bc.jpg not downloaded yet
2026-03-28 14:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_b03b2c3b4fdfc3dc7239ad8e3b4fa587.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a930fd0>
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbac497-0745-5922-9284-ee6513af0b5c/dfbac497-0745-5922-9284-ee6513af0b5c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_ef70df16b38a1a247c6ad4280d985593.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_ef70df16b38a1a247c6ad4280d985593.jpg saved to cache
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfbac497-0745-5922-9284-ee6513af0b5c
2026-03-28 14:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_172d91a1d94a43c981d6d7530494a0d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_764668b1a105e5f444e8871df88ac956.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb3%252F03b36e9e70c2e0386b28220244fd2979%252Fpa%252FWU60183_fe80960e1ec7642ccd54aecb6dd0156e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_fe80960e1ec7642ccd54aecb6dd0156e.jpg not downloaded yet
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_2c2f17bbeef429596c049f08c22943b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_2c2f17bbeef429596c049f08c22943b0.jpg not downloaded yet
2026-03-28 14:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_a7a05da349729f750e969e8fc9d1299f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb3%252F03b36e9e70c2e0386b28220244fd2979%252Fpa%252FWU60183_bb32f5a588ed9543b55a946cc4829697.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_bb32f5a588ed9543b55a946cc4829697.jpg not downloaded yet
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_b61a5452690de6d3fc8cb0e8d955d71b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_b61a5452690de6d3fc8cb0e8d955d71b.jpg not downloaded yet
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a894290>
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cedfdfd-6524-530a-81f9-50c8e417a7b2/0cedfdfd-6524-530a-81f9-50c8e417a7b2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd8%252F81d81456f2abd99d495c6c2cca697140%252Fpa%252FVN90638_236b382890fc02b6fd15cdf7d8a3930e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_236b382890fc02b6fd15cdf7d8a3930e.jpg saved to cache
2026-03-28 14:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cedfdfd-6524-530a-81f9-50c8e417a7b2
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f64416688d0>
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cedfdfd-6524-530a-81f9-50c8e417a7b2/0cedfdfd-6524-530a-81f9-50c8e417a7b2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd8%252F81d81456f2abd99d495c6c2cca697140%252Fpa%252FVN90638_2cc7223e841400a514033c79f4d5d280.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_2cc7223e841400a514033c79f4d5d280.jpg saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cedfdfd-6524-530a-81f9-50c8e417a7b2
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a81e090>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cedfdfd-6524-530a-81f9-50c8e417a7b2/0cedfdfd-6524-530a-81f9-50c8e417a7b2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd8%252F81d81456f2abd99d495c6c2cca697140%252Fpa%252FVN90638_1aea5df2bc062afdd34145f596a873bc.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_1aea5df2bc062afdd34145f596a873bc.jpg saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cedfdfd-6524-530a-81f9-50c8e417a7b2
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a922890>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b50bee-f7f5-55d2-8439-e51745b98132/42b50bee-f7f5-55d2-8439-e51745b98132_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3c%252F753c0d3812e975ad50ed49b58a748038%252Fpa%252FGY48827_23e11ccdb90bfb4cda408d7408a4f631.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_23e11ccdb90bfb4cda408d7408a4f631.jpg saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 42b50bee-f7f5-55d2-8439-e51745b98132
2026-03-28 14:06:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42b50bee-f7f5-55d2-8439-e51745b98132, skipping ID generation
2026-03-28 14:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42b50bee-f7f5-55d2-8439-e51745b98132 with scrape type 1
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42b50bee-f7f5-55d2-8439-e51745b98132 sending to next pipeline
2026-03-28 14:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 42b50bee-f7f5-55d2-8439-e51745b98132, identifier: GY48827
2026-03-28 14:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03bbcd3e-a66f-5b80-9878-3c09aab2749d with identifier: FC66995
2026-03-28 14:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03bbcd3e-a66f-5b80-9878-3c09aab2749d with scrape type 1
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 03bbcd3e-a66f-5b80-9878-3c09aab2749d
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F7d%252F337dcfcd4ca91d1e68c4f83b6f5ecc89%252Fpa%252FFC66995_1f56356aabeae03ed7b36dc982ff669c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_1f56356aabeae03ed7b36dc982ff669c.jpg not downloaded yet
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_17f6437e6158aaabcc12b65f6b723aae.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 42b50bee-f7f5-55d2-8439-e51745b98132 with identifier: GY48827
2026-03-28 14:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 42b50bee-f7f5-55d2-8439-e51745b98132 with identifier: GY48827
2026-03-28 14:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 42b50bee-f7f5-55d2-8439-e51745b98132 with identifier: GY48827 to the API
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_23e11ccdb90bfb4cda408d7408a4f631.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:32:41Z',
 'fuel_type': 'diesel',
 'id': '42b50bee-f7f5-55d2-8439-e51745b98132',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY48827',
 'listing': 'auction',
 'location': 'ES, Majadahonda, Madrid',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 298691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b50bee-f7f5-55d2-8439-e51745b98132/42b50bee-f7f5-55d2-8439-e51745b98132_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_e4081de26f27f4bace7c6b8db8a328be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b50bee-f7f5-55d2-8439-e51745b98132/42b50bee-f7f5-55d2-8439-e51745b98132_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_8b55f7c590262c43c1a279016f01f714.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b50bee-f7f5-55d2-8439-e51745b98132/42b50bee-f7f5-55d2-8439-e51745b98132_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_55acd282f1a3ffd418e9f2b79ac53c37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b50bee-f7f5-55d2-8439-e51745b98132/42b50bee-f7f5-55d2-8439-e51745b98132_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_121d6a528606561988be82d4dd3cc947.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b50bee-f7f5-55d2-8439-e51745b98132/42b50bee-f7f5-55d2-8439-e51745b98132_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/3c/753c0d3812e975ad50ed49b58a748038/pa/GY48827_23e11ccdb90bfb4cda408d7408a4f631.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 2.0 HDi SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2003}
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY48827%27 HTTP/1.1" 200 None
2026-03-28 14:06:41 [auto1.es] INFO: Saving data for GY48827: {'created_time': 1774706801.596857, 'last_price_update_time': 1774706801.596869, 'auction_closing_time': 1774884761.0}
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GY48827') HTTP/1.1" 204 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_02d7954a1a30080ed9558e699b044c63.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_02d7954a1a30080ed9558e699b044c63.jpg not downloaded yet
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F7d%252F337dcfcd4ca91d1e68c4f83b6f5ecc89%252Fpa%252FFC66995_80cb0933db6c7d6e3c1e654797f310f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_80cb0933db6c7d6e3c1e654797f310f1.jpg not downloaded yet
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_bd6c95a76580db009f332a586dcfb3bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_3ef9fc10f0858bd3ef6e48f96270b21e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_ab61ef89fffd8410cc2e75a47695e00f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_c1b5428df786f4d0ba675912a97aa5bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_33e545d82aa783a80ae00f14cdd5df87.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_33e545d82aa783a80ae00f14cdd5df87.jpg not downloaded yet
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F7d%252F337dcfcd4ca91d1e68c4f83b6f5ecc89%252Fpa%252FFC66995_064cd76696d05f07f1475a822ef56428.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_064cd76696d05f07f1475a822ef56428.jpg not downloaded yet
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC32522> (referer: https://www.auto1.com/v1/car-details-view/PC32522/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DH26781> (referer: https://www.auto1.com/v1/car-details-view/DH26781/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a812310>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbac497-0745-5922-9284-ee6513af0b5c/dfbac497-0745-5922-9284-ee6513af0b5c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_b03b2c3b4fdfc3dc7239ad8e3b4fa587.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_b03b2c3b4fdfc3dc7239ad8e3b4fa587.jpg saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfbac497-0745-5922-9284-ee6513af0b5c
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a83b890>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563a4ff4-54c9-5e84-9268-842a1b727fa2/563a4ff4-54c9-5e84-9268-842a1b727fa2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb3%252F03b36e9e70c2e0386b28220244fd2979%252Fpa%252FWU60183_172d91a1d94a43c981d6d7530494a0d3.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_172d91a1d94a43c981d6d7530494a0d3.jpg saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 563a4ff4-54c9-5e84-9268-842a1b727fa2
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a837410>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbac497-0745-5922-9284-ee6513af0b5c/dfbac497-0745-5922-9284-ee6513af0b5c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_764668b1a105e5f444e8871df88ac956.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_764668b1a105e5f444e8871df88ac956.jpg saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfbac497-0745-5922-9284-ee6513af0b5c
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6441668ed0>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbac497-0745-5922-9284-ee6513af0b5c/dfbac497-0745-5922-9284-ee6513af0b5c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_a7a05da349729f750e969e8fc9d1299f.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_a7a05da349729f750e969e8fc9d1299f.jpg saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dfbac497-0745-5922-9284-ee6513af0b5c
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644139b5d0>
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563a4ff4-54c9-5e84-9268-842a1b727fa2/563a4ff4-54c9-5e84-9268-842a1b727fa2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb3%252F03b36e9e70c2e0386b28220244fd2979%252Fpa%252FWU60183_17f6437e6158aaabcc12b65f6b723aae.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_17f6437e6158aaabcc12b65f6b723aae.jpg saved to cache
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 563a4ff4-54c9-5e84-9268-842a1b727fa2
2026-03-28 14:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_58bc0253ed9ef9eed8bb66db4e08cc44.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item dfbac497-0745-5922-9284-ee6513af0b5c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item dfbac497-0745-5922-9284-ee6513af0b5c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item dfbac497-0745-5922-9284-ee6513af0b5c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_e8700331302c4d1de62612e2c17d29a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_e8700331302c4d1de62612e2c17d29a5.jpg not downloaded yet
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F7d%252F337dcfcd4ca91d1e68c4f83b6f5ecc89%252Fpa%252FFC66995_4c66aa0cb9f59cc04727f9550f29115a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_4c66aa0cb9f59cc04727f9550f29115a.jpg not downloaded yet
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF35221> (referer: https://www.auto1.com/v1/car-details-view/MF35221/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CP18304> (referer: https://www.auto1.com/v1/car-details-view/CP18304/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a88f090>
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_bd6c95a76580db009f332a586dcfb3bc.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_bd6c95a76580db009f332a586dcfb3bc.jpg saved to cache
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 409b5ee9-4091-58ee-9701-c1b403a6533f
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aad92d0>
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cedfdfd-6524-530a-81f9-50c8e417a7b2/0cedfdfd-6524-530a-81f9-50c8e417a7b2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd8%252F81d81456f2abd99d495c6c2cca697140%252Fpa%252FVN90638_3ef9fc10f0858bd3ef6e48f96270b21e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_3ef9fc10f0858bd3ef6e48f96270b21e.jpg saved to cache
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cedfdfd-6524-530a-81f9-50c8e417a7b2
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644137d9d0>
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cedfdfd-6524-530a-81f9-50c8e417a7b2/0cedfdfd-6524-530a-81f9-50c8e417a7b2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd8%252F81d81456f2abd99d495c6c2cca697140%252Fpa%252FVN90638_ab61ef89fffd8410cc2e75a47695e00f.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_ab61ef89fffd8410cc2e75a47695e00f.jpg saved to cache
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cedfdfd-6524-530a-81f9-50c8e417a7b2
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aadbd90>
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_c1b5428df786f4d0ba675912a97aa5bc.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_c1b5428df786f4d0ba675912a97aa5bc.jpg saved to cache
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 409b5ee9-4091-58ee-9701-c1b403a6533f
2026-03-28 14:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f20de1f-c905-5fcc-b1bf-916fa411b0f7 with identifier: PC32522
2026-03-28 14:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f20de1f-c905-5fcc-b1bf-916fa411b0f7 with scrape type 1
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6f20de1f-c905-5fcc-b1bf-916fa411b0f7
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F97%252F6d97693ca1fb958ad50ee2bd5dca94f8%252Fpa%252FPC32522_1f6381bebeefbf0d6e470ee33370861f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_1f6381bebeefbf0d6e470ee33370861f.jpg not downloaded yet
2026-03-28 14:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fef3130c-a204-5fe0-9fcc-438cffc4ee50 with identifier: DH26781
2026-03-28 14:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fef3130c-a204-5fe0-9fcc-438cffc4ee50 with scrape type 1
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fef3130c-a204-5fe0-9fcc-438cffc4ee50
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_a343975ba00fe8211e6ec5de08efc8f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_a343975ba00fe8211e6ec5de08efc8f8.jpg not downloaded yet
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_2bf0534fe1ff5bf58b6333552cf371a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_2bf0534fe1ff5bf58b6333552cf371a3.jpg not downloaded yet
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F7d%252F337dcfcd4ca91d1e68c4f83b6f5ecc89%252Fpa%252FFC66995_ddfe1a761b35a9a6118c47ba056e1e58.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_ddfe1a761b35a9a6118c47ba056e1e58.jpg not downloaded yet
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_49bdacc158cc4c3311a69c055e36280c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_b61a5452690de6d3fc8cb0e8d955d71b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_bb32f5a588ed9543b55a946cc4829697.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_fe80960e1ec7642ccd54aecb6dd0156e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F97%252F6d97693ca1fb958ad50ee2bd5dca94f8%252Fpa%252FPC32522_e291ed4bc1643d5a9d9133fbc3863a8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_e291ed4bc1643d5a9d9133fbc3863a8a.jpg not downloaded yet
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_579ad9c0991cc6733acc0b67c93f6f54.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_579ad9c0991cc6733acc0b67c93f6f54.jpg not downloaded yet
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_fcae5bd64d90a866435aaa63e9547dd2.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_698b3d7bf04e1aea72fe43a043eb564d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_698b3d7bf04e1aea72fe43a043eb564d.jpg not downloaded yet
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F7d%252F337dcfcd4ca91d1e68c4f83b6f5ecc89%252Fpa%252FFC66995_bce2b9976c3f24b3efc4fee051a8dafc.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_bce2b9976c3f24b3efc4fee051a8dafc.jpg not downloaded yet
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F97%252F6d97693ca1fb958ad50ee2bd5dca94f8%252Fpa%252FPC32522_130832fae04c4dc5c5cd172ba811e21d.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_130832fae04c4dc5c5cd172ba811e21d.jpg not downloaded yet
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_054f4b4df2c02086c4073907c33df9e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_054f4b4df2c02086c4073907c33df9e0.jpg not downloaded yet
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_68c8afde38cee95fa34560473c17fc0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_68c8afde38cee95fa34560473c17fc0b.jpg not downloaded yet
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6441730fd0>
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563a4ff4-54c9-5e84-9268-842a1b727fa2/563a4ff4-54c9-5e84-9268-842a1b727fa2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb3%252F03b36e9e70c2e0386b28220244fd2979%252Fpa%252FWU60183_58bc0253ed9ef9eed8bb66db4e08cc44.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_58bc0253ed9ef9eed8bb66db4e08cc44.jpg saved to cache
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 563a4ff4-54c9-5e84-9268-842a1b727fa2
2026-03-28 14:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c with identifier: MF35221
2026-03-28 14:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c with scrape type 1
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F34%252Fcf3412d85c16574e0dfeb6e05f77b1da%252Fpa%252FMF35221_d13822a995ddf4908f8ca061053bab93.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_d13822a995ddf4908f8ca061053bab93.jpg not downloaded yet
2026-03-28 14:06:42 [auto1.es] INFO: Channel: 24h | Page: 7 | totalHits: 2696 | hits on page: 40
2026-03-28 14:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5b0d519-cdda-5620-abfe-d674c80f5b6f with identifier: CP18304
2026-03-28 14:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5b0d519-cdda-5620-abfe-d674c80f5b6f with scrape type 1
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5b0d519-cdda-5620-abfe-d674c80f5b6f
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_053d483e831f835d3f9e16ed36345a79.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_053d483e831f835d3f9e16ed36345a79.jpg not downloaded yet
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F97%252F6d97693ca1fb958ad50ee2bd5dca94f8%252Fpa%252FPC32522_46e55cbb1b3e09d6033620601781a37e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_46e55cbb1b3e09d6033620601781a37e.jpg not downloaded yet
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_24fcaf2751adddb6a30ff2cea0f2f074.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_24fcaf2751adddb6a30ff2cea0f2f074.jpg not downloaded yet
2026-03-28 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_a343975ba00fe8211e6ec5de08efc8f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F34%252Fcf3412d85c16574e0dfeb6e05f77b1da%252Fpa%252FMF35221_89c49da5ed8133a475383dd94d5cee5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_89c49da5ed8133a475383dd94d5cee5c.jpg not downloaded yet
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: VG10975
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG10975%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for VG10975: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: VC46387
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: PT83214
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: JM22028
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: BE06656
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE06656%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for BE06656: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: BB43424
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB43424%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for BB43424: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: PP51748
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: UR52438
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR52438%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for UR52438: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: PS14149
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS14149%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for PS14149: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: KW41207
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: DZ14313
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: GB85500
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB85500%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for GB85500: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: MM10114
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: HB49696
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB49696%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for HB49696: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: BD69274
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: ES13897
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: PD50482
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: FP09547
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP09547%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for FP09547: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: KU62533
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU62533%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for KU62533: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: JZ72773
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: SX89883
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX89883%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for SX89883: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: KP23641
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP23641%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for KP23641: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: FN14601
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: ZT45272
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT45272%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for ZT45272: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: EW17140
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: GP84876
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP84876%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for GP84876: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: FF19626
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: GG14536
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG14536%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for GG14536: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: XF41535
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: KK57262
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: PL51206
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL51206%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for PL51206: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: GZ44796
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ44796%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for GZ44796: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: EU70316
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: PN86377
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN86377%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for PN86377: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: MF61460
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: JS10706
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: UG73300
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: CE73826
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE73826%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for CE73826: 0
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: DW64016
2026-03-28 14:06:42 [auto1.es] INFO: Found listing with ID: XB82673
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB82673%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [auto1.es] INFO: Scrape type for XB82673: 0
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_5a0772c009a36a781656e7e5daabd350.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_5a0772c009a36a781656e7e5daabd350.jpg not downloaded yet
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa00210>
2026-03-28 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cedfdfd-6524-530a-81f9-50c8e417a7b2/0cedfdfd-6524-530a-81f9-50c8e417a7b2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd8%252F81d81456f2abd99d495c6c2cca697140%252Fpa%252FVN90638_49bdacc158cc4c3311a69c055e36280c.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_49bdacc158cc4c3311a69c055e36280c.jpg saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cedfdfd-6524-530a-81f9-50c8e417a7b2
2026-03-28 14:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cedfdfd-6524-530a-81f9-50c8e417a7b2, skipping ID generation
2026-03-28 14:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cedfdfd-6524-530a-81f9-50c8e417a7b2 with scrape type 1
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cedfdfd-6524-530a-81f9-50c8e417a7b2 sending to next pipeline
2026-03-28 14:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0cedfdfd-6524-530a-81f9-50c8e417a7b2, identifier: VN90638
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a81ced0>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_b61a5452690de6d3fc8cb0e8d955d71b.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_b61a5452690de6d3fc8cb0e8d955d71b.jpg saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 409b5ee9-4091-58ee-9701-c1b403a6533f
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b46b210>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563a4ff4-54c9-5e84-9268-842a1b727fa2/563a4ff4-54c9-5e84-9268-842a1b727fa2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb3%252F03b36e9e70c2e0386b28220244fd2979%252Fpa%252FWU60183_bb32f5a588ed9543b55a946cc4829697.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_bb32f5a588ed9543b55a946cc4829697.jpg saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 563a4ff4-54c9-5e84-9268-842a1b727fa2
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6441332d90>
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563a4ff4-54c9-5e84-9268-842a1b727fa2/563a4ff4-54c9-5e84-9268-842a1b727fa2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb3%252F03b36e9e70c2e0386b28220244fd2979%252Fpa%252FWU60183_fe80960e1ec7642ccd54aecb6dd0156e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_fe80960e1ec7642ccd54aecb6dd0156e.jpg saved to cache
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 563a4ff4-54c9-5e84-9268-842a1b727fa2
2026-03-28 14:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_80cb0933db6c7d6e3c1e654797f310f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_064cd76696d05f07f1475a822ef56428.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F97%252F6d97693ca1fb958ad50ee2bd5dca94f8%252Fpa%252FPC32522_20dff751c78b05269b6c6396fa1658b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_20dff751c78b05269b6c6396fa1658b6.jpg not downloaded yet
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_3f3b56292f2a0e33868a88d0bc4128be.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_3f3b56292f2a0e33868a88d0bc4128be.jpg not downloaded yet
2026-03-28 14:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0cedfdfd-6524-530a-81f9-50c8e417a7b2 with identifier: VN90638
2026-03-28 14:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0cedfdfd-6524-530a-81f9-50c8e417a7b2 with identifier: VN90638
2026-03-28 14:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0cedfdfd-6524-530a-81f9-50c8e417a7b2 with identifier: VN90638 to the API
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_49bdacc158cc4c3311a69c055e36280c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:56:16Z',
 'fuel_type': 'diesel',
 'id': '0cedfdfd-6524-530a-81f9-50c8e417a7b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN90638',
 'listing': 'auction',
 'location': 'ES, Málaga',
 'make': 'Mazda',
 'model': '5',
 'odometer': 270810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cedfdfd-6524-530a-81f9-50c8e417a7b2/0cedfdfd-6524-530a-81f9-50c8e417a7b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_236b382890fc02b6fd15cdf7d8a3930e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cedfdfd-6524-530a-81f9-50c8e417a7b2/0cedfdfd-6524-530a-81f9-50c8e417a7b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_2cc7223e841400a514033c79f4d5d280.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cedfdfd-6524-530a-81f9-50c8e417a7b2/0cedfdfd-6524-530a-81f9-50c8e417a7b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_1aea5df2bc062afdd34145f596a873bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cedfdfd-6524-530a-81f9-50c8e417a7b2/0cedfdfd-6524-530a-81f9-50c8e417a7b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_49bdacc158cc4c3311a69c055e36280c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cedfdfd-6524-530a-81f9-50c8e417a7b2/0cedfdfd-6524-530a-81f9-50c8e417a7b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_ab61ef89fffd8410cc2e75a47695e00f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cedfdfd-6524-530a-81f9-50c8e417a7b2/0cedfdfd-6524-530a-81f9-50c8e417a7b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/d8/81d81456f2abd99d495c6c2cca697140/pa/VN90638_3ef9fc10f0858bd3ef6e48f96270b21e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mazda 5 2.0 Diesel CRTD Sportive',
 'transmission': 'manual',
 'trim': 'CRTD Sportive',
 'year': 2008}
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN90638%27 HTTP/1.1" 200 None
2026-03-28 14:06:43 [auto1.es] INFO: Saving data for VN90638: {'created_time': 1774706803.811453, 'last_price_update_time': 1774706803.811468, 'auction_closing_time': 1774886176.0}
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VN90638') HTTP/1.1" 204 0
2026-03-28 14:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_c6bec8653237f1b9b44f0275d8e1f583.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_02d7954a1a30080ed9558e699b044c63.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F34%252Fcf3412d85c16574e0dfeb6e05f77b1da%252Fpa%252FMF35221_a50113c41a2df33b6dd36c45f51e5285.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_a50113c41a2df33b6dd36c45f51e5285.jpg not downloaded yet
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_748c3ae73a62e13f0d16ea275906b374.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_748c3ae73a62e13f0d16ea275906b374.jpg not downloaded yet
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F97%252F6d97693ca1fb958ad50ee2bd5dca94f8%252Fpa%252FPC32522_9ba9b99484017401210ae7e5e88b53a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_9ba9b99484017401210ae7e5e88b53a6.jpg not downloaded yet
2026-03-28 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_6cc808b60357ea3ef72c88220901c2b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_6cc808b60357ea3ef72c88220901c2b5.jpg not downloaded yet
2026-03-28 14:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b580850>
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbac497-0745-5922-9284-ee6513af0b5c/dfbac497-0745-5922-9284-ee6513af0b5c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F3e%252F213ea8887902c3e06d9f03683ff8ad92%252Fpa%252FDD78517_fcae5bd64d90a866435aaa63e9547dd2.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_fcae5bd64d90a866435aaa63e9547dd2.jpg saved to cache
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dfbac497-0745-5922-9284-ee6513af0b5c
2026-03-28 14:06:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfbac497-0745-5922-9284-ee6513af0b5c, skipping ID generation
2026-03-28 14:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfbac497-0745-5922-9284-ee6513af0b5c with scrape type 1
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfbac497-0745-5922-9284-ee6513af0b5c sending to next pipeline
2026-03-28 14:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dfbac497-0745-5922-9284-ee6513af0b5c, identifier: DD78517
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a881b90>
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_a343975ba00fe8211e6ec5de08efc8f8.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_a343975ba00fe8211e6ec5de08efc8f8.jpg saved to cache
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fef3130c-a204-5fe0-9fcc-438cffc4ee50
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_1f6381bebeefbf0d6e470ee33370861f.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F34%252Fcf3412d85c16574e0dfeb6e05f77b1da%252Fpa%252FMF35221_2df2dc2264f5ac892617f486591e34e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_2df2dc2264f5ac892617f486591e34e1.jpg not downloaded yet
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_026659380f615d3f0c4ee9183d8d6a3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_026659380f615d3f0c4ee9183d8d6a3e.jpg not downloaded yet
2026-03-28 14:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dfbac497-0745-5922-9284-ee6513af0b5c with identifier: DD78517
2026-03-28 14:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dfbac497-0745-5922-9284-ee6513af0b5c with identifier: DD78517
2026-03-28 14:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dfbac497-0745-5922-9284-ee6513af0b5c with identifier: DD78517 to the API
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_fcae5bd64d90a866435aaa63e9547dd2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:33:22Z',
 'fuel_type': 'hybrid',
 'id': 'dfbac497-0745-5922-9284-ee6513af0b5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD78517',
 'listing': 'auction',
 'location': 'ES, Móstoles',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 33293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfbac497-0745-5922-9284-ee6513af0b5c/dfbac497-0745-5922-9284-ee6513af0b5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_764668b1a105e5f444e8871df88ac956.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfbac497-0745-5922-9284-ee6513af0b5c/dfbac497-0745-5922-9284-ee6513af0b5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_b03b2c3b4fdfc3dc7239ad8e3b4fa587.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfbac497-0745-5922-9284-ee6513af0b5c/dfbac497-0745-5922-9284-ee6513af0b5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_9209bd9fc564a13f355dc78ad1065720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfbac497-0745-5922-9284-ee6513af0b5c/dfbac497-0745-5922-9284-ee6513af0b5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_ef70df16b38a1a247c6ad4280d985593.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfbac497-0745-5922-9284-ee6513af0b5c/dfbac497-0745-5922-9284-ee6513af0b5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_fcae5bd64d90a866435aaa63e9547dd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfbac497-0745-5922-9284-ee6513af0b5c/dfbac497-0745-5922-9284-ee6513af0b5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/3e/213ea8887902c3e06d9f03683ff8ad92/pa/DD78517_a7a05da349729f750e969e8fc9d1299f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Corolla 1.8 Hybrid GR Sport',
 'transmission': 'automatic',
 'trim': 'GR Sport',
 'year': 2024}
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD78517%27 HTTP/1.1" 200 None
2026-03-28 14:06:44 [auto1.es] INFO: Saving data for DD78517: {'created_time': 1774706804.581268, 'last_price_update_time': 1774706804.581279, 'auction_closing_time': 1774884802.0}
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DD78517') HTTP/1.1" 204 0
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_e8700331302c4d1de62612e2c17d29a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 563a4ff4-54c9-5e84-9268-842a1b727fa2 with identifier: WU60183
2026-03-28 14:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 563a4ff4-54c9-5e84-9268-842a1b727fa2 with identifier: WU60183
2026-03-28 14:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 563a4ff4-54c9-5e84-9268-842a1b727fa2 with identifier: WU60183 to the API
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:44 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:26:05Z',
 'fuel_type': 'diesel',
 'id': '563a4ff4-54c9-5e84-9268-842a1b727fa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU60183',
 'listing': 'auction',
 'location': 'ES, Granollers',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 164676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_172d91a1d94a43c981d6d7530494a0d3.jpg',
                'https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_17f6437e6158aaabcc12b65f6b723aae.jpg',
                'https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_9153a3e8adf72c1fc4f8d44310aac0a7.jpg',
                'https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_58bc0253ed9ef9eed8bb66db4e08cc44.jpg',
                'https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_fe80960e1ec7642ccd54aecb6dd0156e.jpg',
                'https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_bb32f5a588ed9543b55a946cc4829697.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563a4ff4-54c9-5e84-9268-842a1b727fa2/563a4ff4-54c9-5e84-9268-842a1b727fa2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_172d91a1d94a43c981d6d7530494a0d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563a4ff4-54c9-5e84-9268-842a1b727fa2/563a4ff4-54c9-5e84-9268-842a1b727fa2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_17f6437e6158aaabcc12b65f6b723aae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563a4ff4-54c9-5e84-9268-842a1b727fa2/563a4ff4-54c9-5e84-9268-842a1b727fa2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_58bc0253ed9ef9eed8bb66db4e08cc44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563a4ff4-54c9-5e84-9268-842a1b727fa2/563a4ff4-54c9-5e84-9268-842a1b727fa2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_fe80960e1ec7642ccd54aecb6dd0156e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563a4ff4-54c9-5e84-9268-842a1b727fa2/563a4ff4-54c9-5e84-9268-842a1b727fa2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b3/03b36e9e70c2e0386b28220244fd2979/pa/WU60183_bb32f5a588ed9543b55a946cc4829697.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Furio',
 'transmission': 'manual',
 'trim': 'Furio',
 'year': 2005}
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU60183%27 HTTP/1.1" 200 None
2026-03-28 14:06:44 [auto1.es] INFO: Saving data for WU60183: {'created_time': 1774706804.944946, 'last_price_update_time': 1774706804.944957, 'auction_closing_time': 1774884365.0}
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WU60183') HTTP/1.1" 204 0
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 409b5ee9-4091-58ee-9701-c1b403a6533f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 03bbcd3e-a66f-5b80-9878-3c09aab2749d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_384f4da33b1d4696c845bab167147d52.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_384f4da33b1d4696c845bab167147d52.jpg not downloaded yet
2026-03-28 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR44040> (referer: https://www.auto1.com/v1/car-details-view/LR44040/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9f7590>
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03bbcd3e-a66f-5b80-9878-3c09aab2749d/03bbcd3e-a66f-5b80-9878-3c09aab2749d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F7d%252F337dcfcd4ca91d1e68c4f83b6f5ecc89%252Fpa%252FFC66995_80cb0933db6c7d6e3c1e654797f310f1.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_80cb0933db6c7d6e3c1e654797f310f1.jpg saved to cache
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03bbcd3e-a66f-5b80-9878-3c09aab2749d
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3a2e90>
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03bbcd3e-a66f-5b80-9878-3c09aab2749d/03bbcd3e-a66f-5b80-9878-3c09aab2749d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F7d%252F337dcfcd4ca91d1e68c4f83b6f5ecc89%252Fpa%252FFC66995_064cd76696d05f07f1475a822ef56428.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_064cd76696d05f07f1475a822ef56428.jpg saved to cache
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03bbcd3e-a66f-5b80-9878-3c09aab2749d
2026-03-28 14:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_ddfe1a761b35a9a6118c47ba056e1e58.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_4c66aa0cb9f59cc04727f9550f29115a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 563a4ff4-54c9-5e84-9268-842a1b727fa2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F34%252Fcf3412d85c16574e0dfeb6e05f77b1da%252Fpa%252FMF35221_5f502f5326ad1c41642ab92bd7001cc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_5f502f5326ad1c41642ab92bd7001cc2.jpg not downloaded yet
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_d5e1b766c2e3c7347238d19d035c0c75.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_d5e1b766c2e3c7347238d19d035c0c75.jpg not downloaded yet
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b307690>
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37aab2a0-264e-55f9-9d94-91468e66fe01/37aab2a0-264e-55f9-9d94-91468e66fe01_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F2b%252F992bb5517f0859744ebc3aa526368ad8%252Fpa%252FKZ95264_c6bec8653237f1b9b44f0275d8e1f583.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_c6bec8653237f1b9b44f0275d8e1f583.jpg saved to cache
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37aab2a0-264e-55f9-9d94-91468e66fe01
2026-03-28 14:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37aab2a0-264e-55f9-9d94-91468e66fe01, skipping ID generation
2026-03-28 14:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37aab2a0-264e-55f9-9d94-91468e66fe01 with scrape type 1
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37aab2a0-264e-55f9-9d94-91468e66fe01 sending to next pipeline
2026-03-28 14:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 37aab2a0-264e-55f9-9d94-91468e66fe01, identifier: KZ95264
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3a0150>
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_02d7954a1a30080ed9558e699b044c63.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_02d7954a1a30080ed9558e699b044c63.jpg saved to cache
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 409b5ee9-4091-58ee-9701-c1b403a6533f
2026-03-28 14:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_24fcaf2751adddb6a30ff2cea0f2f074.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_053d483e831f835d3f9e16ed36345a79.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_41205efd0272dc3a04eb142d3f238841.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_41205efd0272dc3a04eb142d3f238841.jpg not downloaded yet
2026-03-28 14:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 37aab2a0-264e-55f9-9d94-91468e66fe01 with identifier: KZ95264
2026-03-28 14:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 37aab2a0-264e-55f9-9d94-91468e66fe01 with identifier: KZ95264
2026-03-28 14:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 37aab2a0-264e-55f9-9d94-91468e66fe01 with identifier: KZ95264 to the API
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_c6bec8653237f1b9b44f0275d8e1f583.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:32:16Z',
 'fuel_type': 'diesel',
 'id': '37aab2a0-264e-55f9-9d94-91468e66fe01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ95264',
 'listing': 'auction',
 'location': 'ES, Cabrera de Mar',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 52412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37aab2a0-264e-55f9-9d94-91468e66fe01/37aab2a0-264e-55f9-9d94-91468e66fe01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_9518cd2bb0f516cf94f68848993997cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37aab2a0-264e-55f9-9d94-91468e66fe01/37aab2a0-264e-55f9-9d94-91468e66fe01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_c6bec8653237f1b9b44f0275d8e1f583.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37aab2a0-264e-55f9-9d94-91468e66fe01/37aab2a0-264e-55f9-9d94-91468e66fe01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_187be14f18b1a60071086f16e58e26ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37aab2a0-264e-55f9-9d94-91468e66fe01/37aab2a0-264e-55f9-9d94-91468e66fe01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_d2ad4e7518d2d85b207969ac8aa0f58d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37aab2a0-264e-55f9-9d94-91468e66fe01/37aab2a0-264e-55f9-9d94-91468e66fe01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_d2795ab571cf53224b53dc0942f5e420.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37aab2a0-264e-55f9-9d94-91468e66fe01/37aab2a0-264e-55f9-9d94-91468e66fe01_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/2b/992bb5517f0859744ebc3aa526368ad8/pa/KZ95264_2d9d79818db0cf984dd90edc88d41fe1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Expression Confort',
 'transmission': 'manual',
 'trim': 'Expression Confort',
 'year': 2004}
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ95264%27 HTTP/1.1" 200 None
2026-03-28 14:06:45 [auto1.es] INFO: Saving data for KZ95264: {'created_time': 1774706805.721675, 'last_price_update_time': 1774706805.721686, 'auction_closing_time': 1774884736.0}
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KZ95264') HTTP/1.1" 204 0
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F34%252Fcf3412d85c16574e0dfeb6e05f77b1da%252Fpa%252FMF35221_243ac904cfb9d6d67bf28089fee84938.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_243ac904cfb9d6d67bf28089fee84938.jpg not downloaded yet
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_39fc39a4cd0962119c225213187bebac.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_39fc39a4cd0962119c225213187bebac.jpg not downloaded yet
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b414a50>
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f20de1f-c905-5fcc-b1bf-916fa411b0f7/6f20de1f-c905-5fcc-b1bf-916fa411b0f7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F97%252F6d97693ca1fb958ad50ee2bd5dca94f8%252Fpa%252FPC32522_1f6381bebeefbf0d6e470ee33370861f.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_1f6381bebeefbf0d6e470ee33370861f.jpg saved to cache
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f20de1f-c905-5fcc-b1bf-916fa411b0f7
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b57b010>
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_e8700331302c4d1de62612e2c17d29a5.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_e8700331302c4d1de62612e2c17d29a5.jpg saved to cache
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 409b5ee9-4091-58ee-9701-c1b403a6533f
2026-03-28 14:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_20dff751c78b05269b6c6396fa1658b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_46e55cbb1b3e09d6033620601781a37e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_4943a6c5ade2502ccbb714e1cf184d75.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_4943a6c5ade2502ccbb714e1cf184d75.jpg not downloaded yet
2026-03-28 14:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_3f3b56292f2a0e33868a88d0bc4128be.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_5b9f96cc9ce06c84f28e2c19e95111ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_5b9f96cc9ce06c84f28e2c19e95111ba.jpg not downloaded yet
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_1ddee27cd2675961c12064fe6872a83a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_1ddee27cd2675961c12064fe6872a83a.jpg not downloaded yet
2026-03-28 14:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da8e23f9-1195-5599-9591-9f1ba2b9561f with identifier: LR44040
2026-03-28 14:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da8e23f9-1195-5599-9591-9f1ba2b9561f with scrape type 1
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da8e23f9-1195-5599-9591-9f1ba2b9561f
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff9%252F39f9b3d8003dc0ad7aeed5049a204857%252Fpa%252FLR44040_6f66650115d477f94cc0872299f74603.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_6f66650115d477f94cc0872299f74603.jpg already downloaded
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff9%252F39f9b3d8003dc0ad7aeed5049a204857%252Fpa%252FLR44040_9ff16827698d7cd37b33fbd96574a1ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_9ff16827698d7cd37b33fbd96574a1ea.jpg already downloaded
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff9%252F39f9b3d8003dc0ad7aeed5049a204857%252Fpa%252FLR44040_dc3a592092585434238cbdc8d0df13f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_dc3a592092585434238cbdc8d0df13f4.jpg already downloaded
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff9%252F39f9b3d8003dc0ad7aeed5049a204857%252Fpa%252FLR44040_5701af8bd275eb4ed1579e1308af8702.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_5701af8bd275eb4ed1579e1308af8702.jpg already downloaded
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff9%252F39f9b3d8003dc0ad7aeed5049a204857%252Fpa%252FLR44040_1478a9c8fe738d1b964a8878b73d84f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_1478a9c8fe738d1b964a8878b73d84f9.jpg already downloaded
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff9%252F39f9b3d8003dc0ad7aeed5049a204857%252Fpa%252FLR44040_41762e0739c109400d0c758722f19f2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_41762e0739c109400d0c758722f19f2b.jpg already downloaded
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff9%252F39f9b3d8003dc0ad7aeed5049a204857%252Fpa%252FLR44040_8bdcd6581cdf132be7dfb4f327ca689e.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_8bdcd6581cdf132be7dfb4f327ca689e.jpg already downloaded
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff9%252F39f9b3d8003dc0ad7aeed5049a204857%252Fpa%252FLR44040_0a8422ca40b6cf91d2f22d068cf4aa7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_0a8422ca40b6cf91d2f22d068cf4aa7a.jpg already downloaded
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff9%252F39f9b3d8003dc0ad7aeed5049a204857%252Fpa%252FLR44040_b6fb4559943e5de827379c8ac609414f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_b6fb4559943e5de827379c8ac609414f.jpg already downloaded
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff9%252F39f9b3d8003dc0ad7aeed5049a204857%252Fpa%252FLR44040_b0b2c09a0ba12a134f8748d78b75de4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_b0b2c09a0ba12a134f8748d78b75de4f.jpg already downloaded
2026-03-28 14:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: da8e23f9-1195-5599-9591-9f1ba2b9561f, identifier: LR44040
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4176d0>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03bbcd3e-a66f-5b80-9878-3c09aab2749d/03bbcd3e-a66f-5b80-9878-3c09aab2749d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F7d%252F337dcfcd4ca91d1e68c4f83b6f5ecc89%252Fpa%252FFC66995_ddfe1a761b35a9a6118c47ba056e1e58.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_ddfe1a761b35a9a6118c47ba056e1e58.jpg saved to cache
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03bbcd3e-a66f-5b80-9878-3c09aab2749d
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa99390>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03bbcd3e-a66f-5b80-9878-3c09aab2749d/03bbcd3e-a66f-5b80-9878-3c09aab2749d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F7d%252F337dcfcd4ca91d1e68c4f83b6f5ecc89%252Fpa%252FFC66995_4c66aa0cb9f59cc04727f9550f29115a.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_4c66aa0cb9f59cc04727f9550f29115a.jpg saved to cache
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03bbcd3e-a66f-5b80-9878-3c09aab2749d
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6441333c10>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_24fcaf2751adddb6a30ff2cea0f2f074.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_24fcaf2751adddb6a30ff2cea0f2f074.jpg saved to cache
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fef3130c-a204-5fe0-9fcc-438cffc4ee50
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3076d0>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_053d483e831f835d3f9e16ed36345a79.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_053d483e831f835d3f9e16ed36345a79.jpg saved to cache
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5b0d519-cdda-5620-abfe-d674c80f5b6f
2026-03-28 14:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_89c49da5ed8133a475383dd94d5cee5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_3644c22bb5cba9c17b00b97b81d2dc79.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_3644c22bb5cba9c17b00b97b81d2dc79.jpg not downloaded yet
2026-03-28 14:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: da8e23f9-1195-5599-9591-9f1ba2b9561f with identifier: LR44040
2026-03-28 14:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: da8e23f9-1195-5599-9591-9f1ba2b9561f with identifier: LR44040
2026-03-28 14:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: da8e23f9-1195-5599-9591-9f1ba2b9561f with identifier: LR44040 to the API
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LR44040>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:54Z',
 'fuel_type': 'petrol',
 'id': 'da8e23f9-1195-5599-9591-9f1ba2b9561f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR44040',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 230415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_6f66650115d477f94cc0872299f74603.jpg',
                'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_9ff16827698d7cd37b33fbd96574a1ea.jpg',
                'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_dc3a592092585434238cbdc8d0df13f4.jpg',
                'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_5701af8bd275eb4ed1579e1308af8702.jpg',
                'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_1478a9c8fe738d1b964a8878b73d84f9.jpg',
                'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_41762e0739c109400d0c758722f19f2b.jpg',
                'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_8bdcd6581cdf132be7dfb4f327ca689e.jpg',
                'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_0a8422ca40b6cf91d2f22d068cf4aa7a.jpg',
                'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_b6fb4559943e5de827379c8ac609414f.jpg',
                'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_b0b2c09a0ba12a134f8748d78b75de4f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8e23f9-1195-5599-9591-9f1ba2b9561f/da8e23f9-1195-5599-9591-9f1ba2b9561f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_6f66650115d477f94cc0872299f74603.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8e23f9-1195-5599-9591-9f1ba2b9561f/da8e23f9-1195-5599-9591-9f1ba2b9561f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_9ff16827698d7cd37b33fbd96574a1ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8e23f9-1195-5599-9591-9f1ba2b9561f/da8e23f9-1195-5599-9591-9f1ba2b9561f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_dc3a592092585434238cbdc8d0df13f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8e23f9-1195-5599-9591-9f1ba2b9561f/da8e23f9-1195-5599-9591-9f1ba2b9561f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_5701af8bd275eb4ed1579e1308af8702.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8e23f9-1195-5599-9591-9f1ba2b9561f/da8e23f9-1195-5599-9591-9f1ba2b9561f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_1478a9c8fe738d1b964a8878b73d84f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8e23f9-1195-5599-9591-9f1ba2b9561f/da8e23f9-1195-5599-9591-9f1ba2b9561f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_41762e0739c109400d0c758722f19f2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8e23f9-1195-5599-9591-9f1ba2b9561f/da8e23f9-1195-5599-9591-9f1ba2b9561f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_8bdcd6581cdf132be7dfb4f327ca689e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8e23f9-1195-5599-9591-9f1ba2b9561f/da8e23f9-1195-5599-9591-9f1ba2b9561f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_0a8422ca40b6cf91d2f22d068cf4aa7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8e23f9-1195-5599-9591-9f1ba2b9561f/da8e23f9-1195-5599-9591-9f1ba2b9561f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_b6fb4559943e5de827379c8ac609414f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8e23f9-1195-5599-9591-9f1ba2b9561f/da8e23f9-1195-5599-9591-9f1ba2b9561f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/f9/39f9b3d8003dc0ad7aeed5049a204857/pa/LR44040_b0b2c09a0ba12a134f8748d78b75de4f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-THP GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR44040%27 HTTP/1.1" 200 None
2026-03-28 14:06:46 [auto1.es] INFO: Saving data for LR44040: {'created_time': 1774706806.89147, 'last_price_update_time': 1774706806.891482, 'auction_closing_time': 1774884114.0}
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LR44040') HTTP/1.1" 204 0
2026-03-28 14:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_5a0772c009a36a781656e7e5daabd350.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_748c3ae73a62e13f0d16ea275906b374.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3f9310>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f20de1f-c905-5fcc-b1bf-916fa411b0f7/6f20de1f-c905-5fcc-b1bf-916fa411b0f7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F97%252F6d97693ca1fb958ad50ee2bd5dca94f8%252Fpa%252FPC32522_20dff751c78b05269b6c6396fa1658b6.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_20dff751c78b05269b6c6396fa1658b6.jpg saved to cache
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f20de1f-c905-5fcc-b1bf-916fa411b0f7
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b47c5d0>
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f20de1f-c905-5fcc-b1bf-916fa411b0f7/6f20de1f-c905-5fcc-b1bf-916fa411b0f7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F97%252F6d97693ca1fb958ad50ee2bd5dca94f8%252Fpa%252FPC32522_46e55cbb1b3e09d6033620601781a37e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_46e55cbb1b3e09d6033620601781a37e.jpg saved to cache
2026-03-28 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f20de1f-c905-5fcc-b1bf-916fa411b0f7
2026-03-28 14:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_026659380f615d3f0c4ee9183d8d6a3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_6cc808b60357ea3ef72c88220901c2b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_726f9115685a9e53631894f3a4950311.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_726f9115685a9e53631894f3a4950311.jpg not downloaded yet
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa37690>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_3f3b56292f2a0e33868a88d0bc4128be.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_3f3b56292f2a0e33868a88d0bc4128be.jpg saved to cache
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fef3130c-a204-5fe0-9fcc-438cffc4ee50
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_2df2dc2264f5ac892617f486591e34e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_b796d251a0b1e82727896e3b8aa20159.jpg%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_b796d251a0b1e82727896e3b8aa20159.jpg not downloaded yet
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9ed910>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fce5f2c-2f8b-5a09-85d5-2672e6ac879c/3fce5f2c-2f8b-5a09-85d5-2672e6ac879c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F34%252Fcf3412d85c16574e0dfeb6e05f77b1da%252Fpa%252FMF35221_89c49da5ed8133a475383dd94d5cee5c.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_89c49da5ed8133a475383dd94d5cee5c.jpg saved to cache
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6 with identifier: GU66337
2026-03-28 14:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6 with identifier: GU66337
2026-03-28 14:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6 with identifier: GU66337 to the API
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:47 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:19:27Z',
 'fuel_type': 'petrol',
 'id': '666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU66337',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'BMW',
 'model': '1er',
 'odometer': 151990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_10db95d025215952c8916e4d4b0c9ea2.jpg',
                'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_09eb91557bdd8862d4b0d993a08890c4.jpg',
                'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_97d1b1b6c6de44ae52516be6da405e9b.jpg',
                'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_04622dcce63c2c063f0b4bdbc39db07f.jpg',
                'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_29d492fc37aa518a6ba19e629efb409c.jpg',
                'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_897caccd96c8a4eba6cc1763d2f1bcc1.jpg',
                'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_a53fb01dd391182da891f8de7fa3bf91.jpg',
                'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_7bd125c2d8538b6a6fc0e9b89d1f55b3.jpg',
                'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_66a203c200302e8be5921a5f99d74de5.jpg',
                'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_0da33d3de58f2403ae4d5597e2fbe49a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_09eb91557bdd8862d4b0d993a08890c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_97d1b1b6c6de44ae52516be6da405e9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_04622dcce63c2c063f0b4bdbc39db07f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_29d492fc37aa518a6ba19e629efb409c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_897caccd96c8a4eba6cc1763d2f1bcc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_a53fb01dd391182da891f8de7fa3bf91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_7bd125c2d8538b6a6fc0e9b89d1f55b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6/666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b8/a7b8f836ff4c46a675bb48f9f35db779/pa/GU66337_66a203c200302e8be5921a5f99d74de5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU66337%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Saving data for GU66337: {'created_time': 1774706807.548808, 'last_price_update_time': 1774706807.548819, 'auction_closing_time': 1774883967.0}
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GU66337') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 409b5ee9-4091-58ee-9701-c1b403a6533f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_9ba9b99484017401210ae7e5e88b53a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_5b9f96cc9ce06c84f28e2c19e95111ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 666da3fd-c4b0-55d8-bd26-dc0eae4f5bd6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644166c650>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_5a0772c009a36a781656e7e5daabd350.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_5a0772c009a36a781656e7e5daabd350.jpg saved to cache
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5b0d519-cdda-5620-abfe-d674c80f5b6f
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9d2850>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_748c3ae73a62e13f0d16ea275906b374.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_748c3ae73a62e13f0d16ea275906b374.jpg saved to cache
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5b0d519-cdda-5620-abfe-d674c80f5b6f
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_1ddee27cd2675961c12064fe6872a83a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_384f4da33b1d4696c845bab167147d52.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_4943a6c5ade2502ccbb714e1cf184d75.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b487690>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_026659380f615d3f0c4ee9183d8d6a3e.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_026659380f615d3f0c4ee9183d8d6a3e.jpg saved to cache
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5b0d519-cdda-5620-abfe-d674c80f5b6f
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a8e5210>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_6cc808b60357ea3ef72c88220901c2b5.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_6cc808b60357ea3ef72c88220901c2b5.jpg saved to cache
2026-03-28 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fef3130c-a204-5fe0-9fcc-438cffc4ee50
2026-03-28 14:06:47 [auto1.es] INFO: Channel: 24h | Page: 8 | totalHits: 2696 | hits on page: 40
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: NM22189
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM22189%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for NM22189: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: BA61536
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: UP09375
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: GE22021
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: FA09072
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: ZH42049
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: LB38939
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: RV29319
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: US62634
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: XN12672
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: YH49695
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH49695%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for YH49695: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: RW91373
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW91373%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for RW91373: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: RP67068
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: LG74328
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG74328%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for LG74328: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: RF85744
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: YX32704
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: ZG63896
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG63896%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for ZG63896: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: XN94474
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: VU26922
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU26922%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for VU26922: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: AG57096
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG57096%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for AG57096: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: CM29770
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: PU80612
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU80612%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for PU80612: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: RX82713
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: AE71783
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: GH02704
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH02704%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for GH02704: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: GR51630
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: CM09391
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: DU59373
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: ZH62909
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH62909%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for ZH62909: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: HZ84685
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: GC12558
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC12558%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for GC12558: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: KD17519
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: UZ29384
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ29384%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for UZ29384: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: KA03965
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: WN30367
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: FC18044
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: EE40480
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: ZU46399
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: KY80374
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY80374%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for KY80374: 0
2026-03-28 14:06:47 [auto1.es] INFO: Found listing with ID: ZB60783
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB60783%27 HTTP/1.1" 200 None
2026-03-28 14:06:47 [auto1.es] INFO: Scrape type for ZB60783: 0
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6441371e50>
2026-03-28 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fce5f2c-2f8b-5a09-85d5-2672e6ac879c/3fce5f2c-2f8b-5a09-85d5-2672e6ac879c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F34%252Fcf3412d85c16574e0dfeb6e05f77b1da%252Fpa%252FMF35221_2df2dc2264f5ac892617f486591e34e1.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_2df2dc2264f5ac892617f486591e34e1.jpg saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_3644c22bb5cba9c17b00b97b81d2dc79.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3a00d0>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f20de1f-c905-5fcc-b1bf-916fa411b0f7/6f20de1f-c905-5fcc-b1bf-916fa411b0f7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F97%252F6d97693ca1fb958ad50ee2bd5dca94f8%252Fpa%252FPC32522_9ba9b99484017401210ae7e5e88b53a6.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_9ba9b99484017401210ae7e5e88b53a6.jpg saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f20de1f-c905-5fcc-b1bf-916fa411b0f7
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b442250>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_5b9f96cc9ce06c84f28e2c19e95111ba.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_5b9f96cc9ce06c84f28e2c19e95111ba.jpg saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5b0d519-cdda-5620-abfe-d674c80f5b6f
2026-03-28 14:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_d13822a995ddf4908f8ca061053bab93.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_39fc39a4cd0962119c225213187bebac.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_a50113c41a2df33b6dd36c45f51e5285.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_243ac904cfb9d6d67bf28089fee84938.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa8b650>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_1ddee27cd2675961c12064fe6872a83a.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_1ddee27cd2675961c12064fe6872a83a.jpg saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fef3130c-a204-5fe0-9fcc-438cffc4ee50
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b306390>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_384f4da33b1d4696c845bab167147d52.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_384f4da33b1d4696c845bab167147d52.jpg saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fef3130c-a204-5fe0-9fcc-438cffc4ee50
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b589c50>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_4943a6c5ade2502ccbb714e1cf184d75.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_4943a6c5ade2502ccbb714e1cf184d75.jpg saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fef3130c-a204-5fe0-9fcc-438cffc4ee50
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item b5b0d519-cdda-5620-abfe-d674c80f5b6f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item fef3130c-a204-5fe0-9fcc-438cffc4ee50 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a882450>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_3644c22bb5cba9c17b00b97b81d2dc79.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_3644c22bb5cba9c17b00b97b81d2dc79.jpg saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5b0d519-cdda-5620-abfe-d674c80f5b6f
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a88ee10>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fce5f2c-2f8b-5a09-85d5-2672e6ac879c/3fce5f2c-2f8b-5a09-85d5-2672e6ac879c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F34%252Fcf3412d85c16574e0dfeb6e05f77b1da%252Fpa%252FMF35221_d13822a995ddf4908f8ca061053bab93.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_d13822a995ddf4908f8ca061053bab93.jpg saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa31810>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_39fc39a4cd0962119c225213187bebac.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_39fc39a4cd0962119c225213187bebac.jpg saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5b0d519-cdda-5620-abfe-d674c80f5b6f
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644172d1d0>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fce5f2c-2f8b-5a09-85d5-2672e6ac879c/3fce5f2c-2f8b-5a09-85d5-2672e6ac879c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F34%252Fcf3412d85c16574e0dfeb6e05f77b1da%252Fpa%252FMF35221_a50113c41a2df33b6dd36c45f51e5285.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_a50113c41a2df33b6dd36c45f51e5285.jpg saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4d8e50>
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fce5f2c-2f8b-5a09-85d5-2672e6ac879c/3fce5f2c-2f8b-5a09-85d5-2672e6ac879c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F34%252Fcf3412d85c16574e0dfeb6e05f77b1da%252Fpa%252FMF35221_243ac904cfb9d6d67bf28089fee84938.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_243ac904cfb9d6d67bf28089fee84938.jpg saved to cache
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c
2026-03-28 14:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c, skipping ID generation
2026-03-28 14:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c with scrape type 1
2026-03-28 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c sending to next pipeline
2026-03-28 14:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c, identifier: MF35221
2026-03-28 14:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c with identifier: MF35221
2026-03-28 14:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c with identifier: MF35221
2026-03-28 14:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3fce5f2c-2f8b-5a09-85d5-2672e6ac879c with identifier: MF35221 to the API
2026-03-28 14:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_243ac904cfb9d6d67bf28089fee84938.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:22Z',
 'fuel_type': 'diesel',
 'id': '3fce5f2c-2f8b-5a09-85d5-2672e6ac879c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF35221',
 'listing': 'auction',
 'location': 'ES, Las Lagunas de Mijas',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 225822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fce5f2c-2f8b-5a09-85d5-2672e6ac879c/3fce5f2c-2f8b-5a09-85d5-2672e6ac879c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_d13822a995ddf4908f8ca061053bab93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fce5f2c-2f8b-5a09-85d5-2672e6ac879c/3fce5f2c-2f8b-5a09-85d5-2672e6ac879c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_89c49da5ed8133a475383dd94d5cee5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fce5f2c-2f8b-5a09-85d5-2672e6ac879c/3fce5f2c-2f8b-5a09-85d5-2672e6ac879c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_a50113c41a2df33b6dd36c45f51e5285.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fce5f2c-2f8b-5a09-85d5-2672e6ac879c/3fce5f2c-2f8b-5a09-85d5-2672e6ac879c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_2df2dc2264f5ac892617f486591e34e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fce5f2c-2f8b-5a09-85d5-2672e6ac879c/3fce5f2c-2f8b-5a09-85d5-2672e6ac879c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/34/cf3412d85c16574e0dfeb6e05f77b1da/pa/MF35221_243ac904cfb9d6d67bf28089fee84938.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel Luna',
 'transmission': 'manual',
 'trim': 'Luna',
 'year': 2007}
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF35221%27 HTTP/1.1" 200 None
2026-03-28 14:06:49 [auto1.es] INFO: Saving data for MF35221: {'created_time': 1774706809.564436, 'last_price_update_time': 1774706809.564447, 'auction_closing_time': 1774883842.0}
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MF35221') HTTP/1.1" 204 0
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_726f9115685a9e53631894f3a4950311.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_b796d251a0b1e82727896e3b8aa20159.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_054f4b4df2c02086c4073907c33df9e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_68c8afde38cee95fa34560473c17fc0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_130832fae04c4dc5c5cd172ba811e21d.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_e291ed4bc1643d5a9d9133fbc3863a8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_900edecdaec2719daab3bfb61a8e7e28.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b304290>
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_726f9115685a9e53631894f3a4950311.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_726f9115685a9e53631894f3a4950311.jpg saved to cache
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5b0d519-cdda-5620-abfe-d674c80f5b6f
2026-03-28 14:06:49 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item fef3130c-a204-5fe0-9fcc-438cffc4ee50 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 03bbcd3e-a66f-5b80-9878-3c09aab2749d with identifier: FC66995
2026-03-28 14:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 03bbcd3e-a66f-5b80-9878-3c09aab2749d with identifier: FC66995
2026-03-28 14:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 03bbcd3e-a66f-5b80-9878-3c09aab2749d with identifier: FC66995 to the API
2026-03-28 14:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:50 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:42:20Z',
 'fuel_type': 'diesel',
 'id': '03bbcd3e-a66f-5b80-9878-3c09aab2749d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC66995',
 'listing': 'auction',
 'location': 'ES, Girona',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 225149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_1f56356aabeae03ed7b36dc982ff669c.jpg',
                'https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_80cb0933db6c7d6e3c1e654797f310f1.jpg',
                'https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_064cd76696d05f07f1475a822ef56428.jpg',
                'https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_4c66aa0cb9f59cc04727f9550f29115a.jpg',
                'https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_ddfe1a761b35a9a6118c47ba056e1e58.jpg',
                'https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_bce2b9976c3f24b3efc4fee051a8dafc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03bbcd3e-a66f-5b80-9878-3c09aab2749d/03bbcd3e-a66f-5b80-9878-3c09aab2749d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_80cb0933db6c7d6e3c1e654797f310f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03bbcd3e-a66f-5b80-9878-3c09aab2749d/03bbcd3e-a66f-5b80-9878-3c09aab2749d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_064cd76696d05f07f1475a822ef56428.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03bbcd3e-a66f-5b80-9878-3c09aab2749d/03bbcd3e-a66f-5b80-9878-3c09aab2749d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_4c66aa0cb9f59cc04727f9550f29115a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03bbcd3e-a66f-5b80-9878-3c09aab2749d/03bbcd3e-a66f-5b80-9878-3c09aab2749d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/7d/337dcfcd4ca91d1e68c4f83b6f5ecc89/pa/FC66995_ddfe1a761b35a9a6118c47ba056e1e58.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC66995%27 HTTP/1.1" 200 None
2026-03-28 14:06:50 [auto1.es] INFO: Saving data for FC66995: {'created_time': 1774706810.208816, 'last_price_update_time': 1774706810.208824, 'auction_closing_time': 1774885340.0}
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FC66995') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 409b5ee9-4091-58ee-9701-c1b403a6533f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b4e1a10>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F1a%252Fef1a7bd337599ddfb1621bbe8eb9e0ea%252Fpa%252FCP18304_b796d251a0b1e82727896e3b8aa20159.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_b796d251a0b1e82727896e3b8aa20159.jpg saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5b0d519-cdda-5620-abfe-d674c80f5b6f
2026-03-28 14:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5b0d519-cdda-5620-abfe-d674c80f5b6f, skipping ID generation
2026-03-28 14:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5b0d519-cdda-5620-abfe-d674c80f5b6f with scrape type 1
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5b0d519-cdda-5620-abfe-d674c80f5b6f sending to next pipeline
2026-03-28 14:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b5b0d519-cdda-5620-abfe-d674c80f5b6f, identifier: CP18304
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_dcd0a4ff4902540d5162411ee5132985.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_87e66efe831f747991d83f2a28847743.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 03bbcd3e-a66f-5b80-9878-3c09aab2749d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b5b0d519-cdda-5620-abfe-d674c80f5b6f with identifier: CP18304
2026-03-28 14:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b5b0d519-cdda-5620-abfe-d674c80f5b6f with identifier: CP18304
2026-03-28 14:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b5b0d519-cdda-5620-abfe-d674c80f5b6f with identifier: CP18304 to the API
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_b796d251a0b1e82727896e3b8aa20159.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:32:03Z',
 'fuel_type': 'petrol',
 'id': 'b5b0d519-cdda-5620-abfe-d674c80f5b6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP18304',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 91229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_053d483e831f835d3f9e16ed36345a79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_5a0772c009a36a781656e7e5daabd350.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_748c3ae73a62e13f0d16ea275906b374.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_026659380f615d3f0c4ee9183d8d6a3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_39fc39a4cd0962119c225213187bebac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_5b9f96cc9ce06c84f28e2c19e95111ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_3644c22bb5cba9c17b00b97b81d2dc79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_726f9115685a9e53631894f3a4950311.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b0d519-cdda-5620-abfe-d674c80f5b6f/b5b0d519-cdda-5620-abfe-d674c80f5b6f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/1a/ef1a7bd337599ddfb1621bbe8eb9e0ea/pa/CP18304_b796d251a0b1e82727896e3b8aa20159.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP18304%27 HTTP/1.1" 200 None
2026-03-28 14:06:50 [auto1.es] INFO: Saving data for CP18304: {'created_time': 1774706810.746411, 'last_price_update_time': 1774706810.746421, 'auction_closing_time': 1774884723.0}
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CP18304') HTTP/1.1" 204 0
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b403210>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fcb%252Fe6cbad7b94a79868eb6719807c6b3934%252Fpa%252FDH26781_054f4b4df2c02086c4073907c33df9e0.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_054f4b4df2c02086c4073907c33df9e0.jpg saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fef3130c-a204-5fe0-9fcc-438cffc4ee50
2026-03-28 14:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fef3130c-a204-5fe0-9fcc-438cffc4ee50, skipping ID generation
2026-03-28 14:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fef3130c-a204-5fe0-9fcc-438cffc4ee50 with scrape type 1
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fef3130c-a204-5fe0-9fcc-438cffc4ee50 sending to next pipeline
2026-03-28 14:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fef3130c-a204-5fe0-9fcc-438cffc4ee50, identifier: DH26781
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aaad850>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_68c8afde38cee95fa34560473c17fc0b.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_68c8afde38cee95fa34560473c17fc0b.jpg saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 409b5ee9-4091-58ee-9701-c1b403a6533f
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b3a36d0>
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f20de1f-c905-5fcc-b1bf-916fa411b0f7/6f20de1f-c905-5fcc-b1bf-916fa411b0f7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F97%252F6d97693ca1fb958ad50ee2bd5dca94f8%252Fpa%252FPC32522_130832fae04c4dc5c5cd172ba811e21d.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_130832fae04c4dc5c5cd172ba811e21d.jpg saved to cache
2026-03-28 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f20de1f-c905-5fcc-b1bf-916fa411b0f7
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_2bf0534fe1ff5bf58b6333552cf371a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_fdb594579dcaf8b87e1eebbab408de48.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_7bbc9f2a0606b763bd6b3828227f8619.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fef3130c-a204-5fe0-9fcc-438cffc4ee50 with identifier: DH26781
2026-03-28 14:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fef3130c-a204-5fe0-9fcc-438cffc4ee50 with identifier: DH26781
2026-03-28 14:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fef3130c-a204-5fe0-9fcc-438cffc4ee50 with identifier: DH26781 to the API
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_054f4b4df2c02086c4073907c33df9e0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:28:51Z',
 'fuel_type': 'petrol',
 'id': 'fef3130c-a204-5fe0-9fcc-438cffc4ee50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH26781',
 'listing': 'auction',
 'location': 'ES, Valencia',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 54746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_a343975ba00fe8211e6ec5de08efc8f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_054f4b4df2c02086c4073907c33df9e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_24fcaf2751adddb6a30ff2cea0f2f074.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_3f3b56292f2a0e33868a88d0bc4128be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_6cc808b60357ea3ef72c88220901c2b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_384f4da33b1d4696c845bab167147d52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_4943a6c5ade2502ccbb714e1cf184d75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fef3130c-a204-5fe0-9fcc-438cffc4ee50/fef3130c-a204-5fe0-9fcc-438cffc4ee50_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/cb/e6cbad7b94a79868eb6719807c6b3934/pa/DH26781_1ddee27cd2675961c12064fe6872a83a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2022}
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH26781%27 HTTP/1.1" 200 None
2026-03-28 14:06:51 [auto1.es] INFO: Saving data for DH26781: {'created_time': 1774706811.365864, 'last_price_update_time': 1774706811.365875, 'auction_closing_time': 1774884531.0}
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DH26781') HTTP/1.1" 204 0
2026-03-28 14:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643aa18310>
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f20de1f-c905-5fcc-b1bf-916fa411b0f7/6f20de1f-c905-5fcc-b1bf-916fa411b0f7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F97%252F6d97693ca1fb958ad50ee2bd5dca94f8%252Fpa%252FPC32522_e291ed4bc1643d5a9d9133fbc3863a8a.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_e291ed4bc1643d5a9d9133fbc3863a8a.jpg saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f20de1f-c905-5fcc-b1bf-916fa411b0f7
2026-03-28 14:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f20de1f-c905-5fcc-b1bf-916fa411b0f7, skipping ID generation
2026-03-28 14:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f20de1f-c905-5fcc-b1bf-916fa411b0f7 with scrape type 1
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f20de1f-c905-5fcc-b1bf-916fa411b0f7 sending to next pipeline
2026-03-28 14:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f20de1f-c905-5fcc-b1bf-916fa411b0f7, identifier: PC32522
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9ef8d0>
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_900edecdaec2719daab3bfb61a8e7e28.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_900edecdaec2719daab3bfb61a8e7e28.jpg saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 318078c8-f979-517a-ac94-5bf7472a7f21
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b403f90>
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_5.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_dcd0a4ff4902540d5162411ee5132985.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_dcd0a4ff4902540d5162411ee5132985.jpg saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 318078c8-f979-517a-ac94-5bf7472a7f21
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f644f01de10>
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_87e66efe831f747991d83f2a28847743.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_87e66efe831f747991d83f2a28847743.jpg saved to cache
2026-03-28 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00
2026-03-28 14:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_b1d1bf1eeccbf44ab83d64289aa184a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_ca15e13353698eb9f6d20579be378ed0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f20de1f-c905-5fcc-b1bf-916fa411b0f7 with identifier: PC32522
2026-03-28 14:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f20de1f-c905-5fcc-b1bf-916fa411b0f7 with identifier: PC32522
2026-03-28 14:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f20de1f-c905-5fcc-b1bf-916fa411b0f7 with identifier: PC32522 to the API
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_e291ed4bc1643d5a9d9133fbc3863a8a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:26:16Z',
 'fuel_type': 'petrol',
 'id': '6f20de1f-c905-5fcc-b1bf-916fa411b0f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC32522',
 'listing': 'auction',
 'location': 'ES, Leioa',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 189657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f20de1f-c905-5fcc-b1bf-916fa411b0f7/6f20de1f-c905-5fcc-b1bf-916fa411b0f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_1f6381bebeefbf0d6e470ee33370861f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f20de1f-c905-5fcc-b1bf-916fa411b0f7/6f20de1f-c905-5fcc-b1bf-916fa411b0f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_e291ed4bc1643d5a9d9133fbc3863a8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f20de1f-c905-5fcc-b1bf-916fa411b0f7/6f20de1f-c905-5fcc-b1bf-916fa411b0f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_130832fae04c4dc5c5cd172ba811e21d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f20de1f-c905-5fcc-b1bf-916fa411b0f7/6f20de1f-c905-5fcc-b1bf-916fa411b0f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_46e55cbb1b3e09d6033620601781a37e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f20de1f-c905-5fcc-b1bf-916fa411b0f7/6f20de1f-c905-5fcc-b1bf-916fa411b0f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_20dff751c78b05269b6c6396fa1658b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f20de1f-c905-5fcc-b1bf-916fa411b0f7/6f20de1f-c905-5fcc-b1bf-916fa411b0f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/97/6d97693ca1fb958ad50ee2bd5dca94f8/pa/PC32522_9ba9b99484017401210ae7e5e88b53a6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2006}
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC32522%27 HTTP/1.1" 200 None
2026-03-28 14:06:52 [auto1.es] INFO: Saving data for PC32522: {'created_time': 1774706812.020177, 'last_price_update_time': 1774706812.020188, 'auction_closing_time': 1774884376.0}
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PC32522') HTTP/1.1" 204 0
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 318078c8-f979-517a-ac94-5bf7472a7f21 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 49c0a8c5-baca-557a-8b52-a59ad2f7573e with identifier: NG71405
2026-03-28 14:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 49c0a8c5-baca-557a-8b52-a59ad2f7573e with identifier: NG71405
2026-03-28 14:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 49c0a8c5-baca-557a-8b52-a59ad2f7573e with identifier: NG71405 to the API
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:52 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:25:55Z',
 'fuel_type': 'petrol',
 'id': '49c0a8c5-baca-557a-8b52-a59ad2f7573e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG71405',
 'listing': 'auction',
 'location': 'ES, Roces',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 146300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_25f4f8fa438740ad4326d580f3538d5a.jpg',
                'https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_93fff3fd133d817f82a8d53833cc3b6a.jpg',
                'https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_dfa86d9ae4d69c3dda90120cb5e97da1.jpg',
                'https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_40dd1cb01f650161d4056c9ac57ed89e.jpg',
                'https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_f245e22fa8431ba882c0d82740e5009b.jpg',
                'https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_bc326ab36e7495d8e6ec5ca19d2794b5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c0a8c5-baca-557a-8b52-a59ad2f7573e/49c0a8c5-baca-557a-8b52-a59ad2f7573e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_25f4f8fa438740ad4326d580f3538d5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c0a8c5-baca-557a-8b52-a59ad2f7573e/49c0a8c5-baca-557a-8b52-a59ad2f7573e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_93fff3fd133d817f82a8d53833cc3b6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c0a8c5-baca-557a-8b52-a59ad2f7573e/49c0a8c5-baca-557a-8b52-a59ad2f7573e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_dfa86d9ae4d69c3dda90120cb5e97da1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c0a8c5-baca-557a-8b52-a59ad2f7573e/49c0a8c5-baca-557a-8b52-a59ad2f7573e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_40dd1cb01f650161d4056c9ac57ed89e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49c0a8c5-baca-557a-8b52-a59ad2f7573e/49c0a8c5-baca-557a-8b52-a59ad2f7573e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f25cccf34e47d4dd49cda0dd1fe621/pa/NG71405_f245e22fa8431ba882c0d82740e5009b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 City',
 'transmission': 'manual',
 'trim': 'City',
 'year': 2013}
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG71405%27 HTTP/1.1" 200 None
2026-03-28 14:06:52 [auto1.es] INFO: Saving data for NG71405: {'created_time': 1774706812.384124, 'last_price_update_time': 1774706812.384137, 'auction_closing_time': 1774884355.0}
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NG71405') HTTP/1.1" 204 0
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b581750>
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F5b%252F8e5b0fc1219c615badb5f52b62a182c2%252Fpa%252FLK89400_2bf0534fe1ff5bf58b6333552cf371a3.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_2bf0534fe1ff5bf58b6333552cf371a3.jpg saved to cache
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 409b5ee9-4091-58ee-9701-c1b403a6533f
2026-03-28 14:06:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 409b5ee9-4091-58ee-9701-c1b403a6533f, skipping ID generation
2026-03-28 14:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 409b5ee9-4091-58ee-9701-c1b403a6533f with scrape type 1
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 409b5ee9-4091-58ee-9701-c1b403a6533f sending to next pipeline
2026-03-28 14:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 409b5ee9-4091-58ee-9701-c1b403a6533f, identifier: LK89400
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9959d0>
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_6.jpg HTTP/1.1" 201 0
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_fdb594579dcaf8b87e1eebbab408de48.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_fdb594579dcaf8b87e1eebbab408de48.jpg saved to cache
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 318078c8-f979-517a-ac94-5bf7472a7f21
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b49c350>
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_7bbc9f2a0606b763bd6b3828227f8619.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_7bbc9f2a0606b763bd6b3828227f8619.jpg saved to cache
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_b740f55ff7177a53e4452446a35614f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_6b4b2afffbc8ba361700606ac5f9275b.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_051649efdda4a42557d59cd2d4ee0831.jpg> (referer: https://www.auto1.com/)
2026-03-28 14:06:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 49c0a8c5-baca-557a-8b52-a59ad2f7573e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 409b5ee9-4091-58ee-9701-c1b403a6533f with identifier: LK89400
2026-03-28 14:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 409b5ee9-4091-58ee-9701-c1b403a6533f with identifier: LK89400
2026-03-28 14:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 409b5ee9-4091-58ee-9701-c1b403a6533f with identifier: LK89400 to the API
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_2bf0534fe1ff5bf58b6333552cf371a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:48:01Z',
 'fuel_type': 'diesel',
 'id': '409b5ee9-4091-58ee-9701-c1b403a6533f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK89400',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 140311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_bd6c95a76580db009f332a586dcfb3bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_c1b5428df786f4d0ba675912a97aa5bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_b61a5452690de6d3fc8cb0e8d955d71b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_02d7954a1a30080ed9558e699b044c63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_e8700331302c4d1de62612e2c17d29a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_2bf0534fe1ff5bf58b6333552cf371a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_409b5ee9-4091-58ee-9701-c1b403a6533f/409b5ee9-4091-58ee-9701-c1b403a6533f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/5b/8e5b0fc1219c615badb5f52b62a182c2/pa/LK89400_68c8afde38cee95fa34560473c17fc0b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper SD',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK89400%27 HTTP/1.1" 200 None
2026-03-28 14:06:52 [auto1.es] INFO: Saving data for LK89400: {'created_time': 1774706812.966381, 'last_price_update_time': 1774706812.966395, 'auction_closing_time': 1774885681.0}
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LK89400') HTTP/1.1" 204 0
2026-03-28 14:06:52 [auto1.es] INFO: Channel: 24h | Page: 9 | totalHits: 2696 | hits on page: 40
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a93d110>
2026-03-28 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_4.jpg HTTP/1.1" 201 0
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_b1d1bf1eeccbf44ab83d64289aa184a9.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_b1d1bf1eeccbf44ab83d64289aa184a9.jpg saved to cache
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 318078c8-f979-517a-ac94-5bf7472a7f21
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a93ca90>
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_1.jpg HTTP/1.1" 201 0
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_ca15e13353698eb9f6d20579be378ed0.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_ca15e13353698eb9f6d20579be378ed0.jpg saved to cache
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: YZ74298
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ74298%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for YZ74298: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: YK64988
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK64988%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for YK64988: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: YJ21148
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ21148%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for YJ21148: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: YC05678
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: XN99288
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN99288%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for XN99288: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: XJ10709
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: XA46112
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA46112%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for XA46112: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: WZ01367
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ01367%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for WZ01367: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: WY32728
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY32728%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for WY32728: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: WG12182
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: WB05226
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB05226%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for WB05226: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: UG63824
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: VV17373
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: VN92825
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN92825%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for VN92825: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: VJ45850
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: VE30170
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: ZF31827
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF31827%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for ZF31827: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: US42967
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US42967%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for US42967: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: UB14006
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: TG79405
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG79405%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for TG79405: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: TE76337
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE76337%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for TE76337: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: TA28107
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: SZ88467
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: ST22726
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST22726%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for ST22726: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: SP63286
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP63286%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for SP63286: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: RY07165
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY07165%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for RY07165: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: NV56765
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV56765%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for NV56765: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: NN81936
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN81936%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for NN81936: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: MY70573
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY70573%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for MY70573: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: MN37580
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: MK40110
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK40110%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for MK40110: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: MH26986
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH26986%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for MH26986: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: MD02288
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD02288%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for MD02288: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: LY48125
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: LB98236
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB98236%27 HTTP/1.1" 200 None
2026-03-28 14:06:53 [auto1.es] INFO: Scrape type for LB98236: 0
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: KS49101
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: BP62909
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: WX65667
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: KH66285
2026-03-28 14:06:53 [auto1.es] INFO: Found listing with ID: KG64862
2026-03-28 14:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a88ff90>
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_0.jpg HTTP/1.1" 201 0
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ffb%252Ffefb3a6da9f8edcf285683bd9e1d45f8%252Fpa%252FCC76703_b740f55ff7177a53e4452446a35614f0.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_b740f55ff7177a53e4452446a35614f0.jpg saved to cache
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00
2026-03-28 14:06:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00, skipping ID generation
2026-03-28 14:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00 with scrape type 1
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00 sending to next pipeline
2026-03-28 14:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00, identifier: CC76703
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643a9be290>
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_3.jpg HTTP/1.1" 201 0
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_6b4b2afffbc8ba361700606ac5f9275b.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_6b4b2afffbc8ba361700606ac5f9275b.jpg saved to cache
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 318078c8-f979-517a-ac94-5bf7472a7f21
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f643b392a90>
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_2.jpg HTTP/1.1" 201 0
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcf%252F70cfd63d010aa2d91b0bbac3d8c77aad%252Fpa%252FNH39190_051649efdda4a42557d59cd2d4ee0831.jpg') HTTP/1.1" 204 0
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_051649efdda4a42557d59cd2d4ee0831.jpg saved to cache
2026-03-28 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 318078c8-f979-517a-ac94-5bf7472a7f21
2026-03-28 14:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00 with identifier: CC76703
2026-03-28 14:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00 with identifier: CC76703
2026-03-28 14:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00 with identifier: CC76703 to the API
2026-03-28 14:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_b740f55ff7177a53e4452446a35614f0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:10:52Z',
 'fuel_type': 'diesel',
 'id': 'ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC76703',
 'listing': 'auction',
 'location': 'ES, Colmenar Viejo',
 'make': 'Ssangyong',
 'model': 'Korando',
 'odometer': 169299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_b740f55ff7177a53e4452446a35614f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_ca15e13353698eb9f6d20579be378ed0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_7bbc9f2a0606b763bd6b3828227f8619.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_87e66efe831f747991d83f2a28847743.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_4910668589878d68dda4d2a7e9d9b6c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_7901367f47109ec1abb2ab486baf7417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00/ff6fef27-9e8e-564f-ae73-4f8b8dfb7f00_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/fb/fefb3a6da9f8edcf285683bd9e1d45f8/pa/CC76703_7ff6be2fc4c1a9c56c4108c8f353e3cd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Korando 2.0 TD Limited Plus 4x2',
 'transmission': 'manual',
 'trim': 'Limited Plus 4x2',
 'year': 2013}
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC76703%27 HTTP/1.1" 200 None
2026-03-28 14:06:54 [auto1.es] INFO: Saving data for CC76703: {'created_time': 1774706814.199365, 'last_price_update_time': 1774706814.199376, 'auction_closing_time': 1774883452.0}
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CC76703') HTTP/1.1" 204 0
2026-03-28 14:06:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 318078c8-f979-517a-ac94-5bf7472a7f21 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 318078c8-f979-517a-ac94-5bf7472a7f21 with identifier: NH39190
2026-03-28 14:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 318078c8-f979-517a-ac94-5bf7472a7f21 with identifier: NH39190
2026-03-28 14:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 318078c8-f979-517a-ac94-5bf7472a7f21 with identifier: NH39190 to the API
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:06:54 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:31:37Z',
 'fuel_type': 'diesel',
 'id': '318078c8-f979-517a-ac94-5bf7472a7f21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH39190',
 'listing': 'auction',
 'location': 'ES, Atarfe, Granada',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 185481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_7661606a911472112a3928449523aad7.jpg',
                'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_c222c87c07da91843934d876c8056dee.jpg',
                'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_051649efdda4a42557d59cd2d4ee0831.jpg',
                'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_6b4b2afffbc8ba361700606ac5f9275b.jpg',
                'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_b1d1bf1eeccbf44ab83d64289aa184a9.jpg',
                'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_dcd0a4ff4902540d5162411ee5132985.jpg',
                'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_fdb594579dcaf8b87e1eebbab408de48.jpg',
                'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_900edecdaec2719daab3bfb61a8e7e28.jpg',
                'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_1fdb9c193517acf715c5b9157fc4f1e2.jpg',
                'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_6eb94d32c1294c2353fac8d07d84806f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_051649efdda4a42557d59cd2d4ee0831.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_6b4b2afffbc8ba361700606ac5f9275b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_b1d1bf1eeccbf44ab83d64289aa184a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_dcd0a4ff4902540d5162411ee5132985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_fdb594579dcaf8b87e1eebbab408de48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_900edecdaec2719daab3bfb61a8e7e28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_318078c8-f979-517a-ac94-5bf7472a7f21/318078c8-f979-517a-ac94-5bf7472a7f21_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cf/70cfd63d010aa2d91b0bbac3d8c77aad/pa/NH39190_1fdb9c193517acf715c5b9157fc4f1e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Advance BlueMotion',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion',
 'year': 2015}
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH39190%27 HTTP/1.1" 200 None
2026-03-28 14:06:54 [auto1.es] INFO: Saving data for NH39190: {'created_time': 1774706814.769476, 'last_price_update_time': 1774706814.769486, 'auction_closing_time': 1774884697.0}
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NH39190') HTTP/1.1" 204 0
2026-03-28 14:06:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 318078c8-f979-517a-ac94-5bf7472a7f21 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 14:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:06:56 [auto1.es] INFO: Channel: 24h | Page: 10 | totalHits: 2696 | hits on page: 40
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: JH20520
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: JG48293
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG48293%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for JG48293: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: HY05176
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY05176%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for HY05176: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: HS16783
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: GU63395
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU63395%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for GU63395: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: GG14242
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: FF03006
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF03006%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for FF03006: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: FE10852
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: FD45689
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: ZC89924
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC89924%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for ZC89924: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: EB04007
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: GG25367
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG25367%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for GG25367: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: DP25407
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: DK84530
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DK84530%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for DK84530: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: DA34645
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: CY99272
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: CJ82848
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: CC07404
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC07404%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for CC07404: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: ET28977
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET28977%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for ET28977: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: BZ61067
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: BP46886
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: BJ99702
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ99702%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for BJ99702: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: BE81339
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE81339%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for BE81339: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: AZ69629
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: AU19829
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: XB68205
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: FG81447
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG81447%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for FG81447: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: VV50506
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV50506%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for VV50506: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: VV40051
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: NZ10183
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ10183%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for NZ10183: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: EY94585
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY94585%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for EY94585: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: ZM37392
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM37392%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for ZM37392: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: YV41467
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV41467%27 HTTP/1.1" 200 None
2026-03-28 14:06:56 [auto1.es] INFO: Scrape type for YV41467: 0
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: VZ90970
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: MR39300
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: JR92140
2026-03-28 14:06:56 [auto1.es] INFO: Found listing with ID: HK98944
2026-03-28 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK98944%27 HTTP/1.1" 200 None
2026-03-28 14:06:57 [auto1.es] INFO: Scrape type for HK98944: 0
2026-03-28 14:06:57 [auto1.es] INFO: Found listing with ID: HD07972
2026-03-28 14:06:57 [auto1.es] INFO: Found listing with ID: GX01105
2026-03-28 14:06:57 [auto1.es] INFO: Found listing with ID: CW13778
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW13778%27 HTTP/1.1" 200 None
2026-03-28 14:06:57 [auto1.es] INFO: Scrape type for CW13778: 0
2026-03-28 14:06:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:07:10 [scrapy.extensions.logstats] INFO: Crawled 148 pages (at 49 pages/min), scraped 77 items (at 48 items/min)
2026-03-28 14:07:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-28 14:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:07:28 [auto1.es] INFO: Channel: 24h | Page: 11 | totalHits: 2696 | hits on page: 40
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: VG01013
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG01013%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for VG01013: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: MB17982
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB17982%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for MB17982: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: FK59567
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK59567%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for FK59567: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: UP38742
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP38742%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for UP38742: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: EP70954
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP70954%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for EP70954: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: CR30335
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: WJ83814
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ83814%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for WJ83814: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: XW01779
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: LA45475
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: KU66562
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: RU59463
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU59463%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for RU59463: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: DG65204
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: BA49361
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: ZY46738
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: JZ17995
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: YW58225
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: ND95475
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND95475%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for ND95475: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: FJ32938
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ32938%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for FJ32938: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: LZ97772
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ97772%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for LZ97772: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: NW02170
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW02170%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for NW02170: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: TW11063
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: BR53004
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR53004%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for BR53004: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: TD39535
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: AS54337
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS54337%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for AS54337: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: CV75612
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV75612%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for CV75612: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: TR12651
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR12651%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for TR12651: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: XS66014
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS66014%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for XS66014: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: RP64804
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: SZ95909
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ95909%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for SZ95909: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: LW26471
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: HJ68220
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ68220%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for HJ68220: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: ZZ18743
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ18743%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for ZZ18743: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: UF55082
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: RP55294
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: ZR84162
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: YG81758
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: XZ87449
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ87449%27 HTTP/1.1" 200 None
2026-03-28 14:07:28 [auto1.es] INFO: Scrape type for XZ87449: 0
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: VL98218
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: PF61621
2026-03-28 14:07:28 [auto1.es] INFO: Found listing with ID: BE62587
2026-03-28 14:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:07:29 [auto1.es] INFO: Channel: 24h | Page: 12 | totalHits: 2696 | hits on page: 40
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: SN94812
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN94812%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for SN94812: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: TS75802
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: TE16269
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE16269%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for TE16269: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: VH11492
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH11492%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for VH11492: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: XT74556
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: RK33204
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: HU25614
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU25614%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for HU25614: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: FC36055
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: UV92160
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV92160%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for UV92160: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: JX70017
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: ES45064
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES45064%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for ES45064: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: WH26152
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: NF35716
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF35716%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for NF35716: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: VU00284
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: BL83097
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL83097%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for BL83097: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: UB71741
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: KK78857
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: MW97614
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: YS92814
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS92814%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for YS92814: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: SN05978
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: AX08596
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX08596%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for AX08596: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: XC60196
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC60196%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for XC60196: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: ZG18454
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG18454%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for ZG18454: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: JD79732
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: ED57476
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: DK89612
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DK89612%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for DK89612: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: WW09022
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW09022%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for WW09022: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: GC12859
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC12859%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for GC12859: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: KF74515
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: EE62782
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE62782%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for EE62782: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: YT10361
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT10361%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for YT10361: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: MZ62170
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ62170%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for MZ62170: 0
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: XE30764
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: SB32545
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: DT02195
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: RH33829
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: RC06010
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: HA27882
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: HU12913
2026-03-28 14:07:29 [auto1.es] INFO: Found listing with ID: ZN02005
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN02005%27 HTTP/1.1" 200 None
2026-03-28 14:07:29 [auto1.es] INFO: Scrape type for ZN02005: 2
2026-03-28 14:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbb148b6-2906-51a2-999b-e84e9f5856fe with identifier: ZN02005
2026-03-28 14:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbb148b6-2906-51a2-999b-e84e9f5856fe with scrape type 2
2026-03-28 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbb148b6-2906-51a2-999b-e84e9f5856fe with scrape type 2
2026-03-28 14:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fbb148b6-2906-51a2-999b-e84e9f5856fe, identifier: ZN02005
2026-03-28 14:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fbb148b6-2906-51a2-999b-e84e9f5856fe with identifier: ZN02005
2026-03-28 14:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fbb148b6-2906-51a2-999b-e84e9f5856fe with identifier: ZN02005
2026-03-28 14:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fbb148b6-2906-51a2-999b-e84e9f5856fe with identifier: ZN02005 to the API
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:36:14Z',
 'fuel_type': 'diesel',
 'id': 'fbb148b6-2906-51a2-999b-e84e9f5856fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN02005',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 183788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-04',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Live Pack Business M',
 'transmission': 'manual',
 'trim': 'Live Pack Business M',
 'year': 2023}
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN02005%27 HTTP/1.1" 200 None
2026-03-28 14:07:30 [auto1.es] INFO: Saving data for ZN02005: {'auction_closing_time': 1774715774.0, 'created_time': 1773864758.248175, 'last_price_update_time': 1774706850.458357}
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZN02005') HTTP/1.1" 204 0
2026-03-28 14:07:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:04 [auto1.es] INFO: Channel: 24h | Page: 13 | totalHits: 2696 | hits on page: 40
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: FG15461
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: CK76032
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: MN42055
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: UD00521
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: AJ03756
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ03756%27 HTTP/1.1" 200 None
2026-03-28 14:08:04 [auto1.es] INFO: Scrape type for AJ03756: 0
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: YY10601
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: SN13846
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: UZ91236
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: GB32148
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB32148%27 HTTP/1.1" 200 None
2026-03-28 14:08:04 [auto1.es] INFO: Scrape type for GB32148: 0
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: SJ07079
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ07079%27 HTTP/1.1" 200 None
2026-03-28 14:08:04 [auto1.es] INFO: Scrape type for SJ07079: 0
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: HR31272
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: JK63504
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: DE75422
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: GJ16527
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: RN59573
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN59573%27 HTTP/1.1" 200 None
2026-03-28 14:08:04 [auto1.es] INFO: Scrape type for RN59573: 0
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: MS33551
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS33551%27 HTTP/1.1" 200 None
2026-03-28 14:08:04 [auto1.es] INFO: Scrape type for MS33551: 0
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: ZX65175
2026-03-28 14:08:04 [auto1.es] INFO: Found listing with ID: DW68520
2026-03-28 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW68520%27 HTTP/1.1" 200 None
2026-03-28 14:08:05 [auto1.es] INFO: Scrape type for DW68520: 0
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: JM60139
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM60139%27 HTTP/1.1" 200 None
2026-03-28 14:08:05 [auto1.es] INFO: Scrape type for JM60139: 0
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: HA89182
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA89182%27 HTTP/1.1" 200 None
2026-03-28 14:08:05 [auto1.es] INFO: Scrape type for HA89182: 0
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: CB84377
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: CV84892
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: XW18745
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: ZS64271
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS64271%27 HTTP/1.1" 200 None
2026-03-28 14:08:05 [auto1.es] INFO: Scrape type for ZS64271: 0
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: XF30199
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF30199%27 HTTP/1.1" 200 None
2026-03-28 14:08:05 [auto1.es] INFO: Scrape type for XF30199: 0
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: FD66244
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD66244%27 HTTP/1.1" 200 None
2026-03-28 14:08:05 [auto1.es] INFO: Scrape type for FD66244: 0
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: FT05886
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: PX41006
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: EK90431
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: XH71672
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH71672%27 HTTP/1.1" 200 None
2026-03-28 14:08:05 [auto1.es] INFO: Scrape type for XH71672: 0
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: GF68019
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: CV42772
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: KK76277
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: MJ67844
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ67844%27 HTTP/1.1" 200 None
2026-03-28 14:08:05 [auto1.es] INFO: Scrape type for MJ67844: 0
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: YK01379
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: YC35747
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: VU50837
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: TF90504
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF90504%27 HTTP/1.1" 200 None
2026-03-28 14:08:05 [auto1.es] INFO: Scrape type for TF90504: 0
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: SE93661
2026-03-28 14:08:05 [auto1.es] INFO: Found listing with ID: GH75768
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH75768%27 HTTP/1.1" 200 None
2026-03-28 14:08:05 [auto1.es] INFO: Scrape type for GH75768: 0
2026-03-28 14:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:06 [auto1.es] INFO: Channel: 24h | Page: 14 | totalHits: 2696 | hits on page: 40
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: CT45338
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT45338%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for CT45338: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: ZZ88385
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ88385%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for ZZ88385: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: MJ28673
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: VL89620
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: XU17862
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: BF43819
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: KB84639
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB84639%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for KB84639: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: KK74689
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK74689%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for KK74689: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: HL23580
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: FZ71320
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ71320%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for FZ71320: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: JV15285
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: GJ99683
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: YZ57313
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ57313%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for YZ57313: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: HA25095
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA25095%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for HA25095: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: LG37212
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: YK71465
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK71465%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for YK71465: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: NJ00425
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: HZ04358
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: NR06015
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: NB92875
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB92875%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for NB92875: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: JR86606
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: XU82709
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU82709%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for XU82709: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: ME40836
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: PL46605
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: KS53137
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: VY63133
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY63133%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for VY63133: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: LU70143
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU70143%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for LU70143: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: CR84391
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: TR46498
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: AZ98699
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ98699%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for AZ98699: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: RE19681
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE19681%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for RE19681: 0
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: CG55928
2026-03-28 14:08:06 [auto1.es] INFO: Found listing with ID: DC47971
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC47971%27 HTTP/1.1" 200 None
2026-03-28 14:08:06 [auto1.es] INFO: Scrape type for DC47971: 2
2026-03-28 14:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1375da00-a8e4-56b8-9f1d-928b562ee396 with identifier: DC47971
2026-03-28 14:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1375da00-a8e4-56b8-9f1d-928b562ee396 with scrape type 2
2026-03-28 14:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1375da00-a8e4-56b8-9f1d-928b562ee396 with scrape type 2
2026-03-28 14:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1375da00-a8e4-56b8-9f1d-928b562ee396, identifier: DC47971
2026-03-28 14:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1375da00-a8e4-56b8-9f1d-928b562ee396 with identifier: DC47971
2026-03-28 14:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1375da00-a8e4-56b8-9f1d-928b562ee396 with identifier: DC47971
2026-03-28 14:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1375da00-a8e4-56b8-9f1d-928b562ee396 with identifier: DC47971 to the API
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:08:24Z',
 'fuel_type': 'petrol',
 'id': '1375da00-a8e4-56b8-9f1d-928b562ee396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC47971',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka+',
 'odometer': 63288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-25',
 'seller_name': None,
 'title': 'Ford Ka+ 1.2 Ti-VCT Ultimate',
 'transmission': 'manual',
 'trim': 'Ultimate',
 'year': 2017}
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC47971%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [auto1.es] INFO: Saving data for DC47971: {'auction_closing_time': 1774714104.0, 'created_time': 1774523139.895893, 'last_price_update_time': 1774706887.04279}
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DC47971') HTTP/1.1" 204 0
2026-03-28 14:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:07 [auto1.es] INFO: Found listing with ID: ZZ18199
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ18199%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [auto1.es] INFO: Scrape type for ZZ18199: 0
2026-03-28 14:08:07 [auto1.es] INFO: Found listing with ID: LW73612
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW73612%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [auto1.es] INFO: Scrape type for LW73612: 2
2026-03-28 14:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0df7e054-f7df-57c2-a752-cc04cec9451e with identifier: LW73612
2026-03-28 14:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0df7e054-f7df-57c2-a752-cc04cec9451e with scrape type 2
2026-03-28 14:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0df7e054-f7df-57c2-a752-cc04cec9451e with scrape type 2
2026-03-28 14:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0df7e054-f7df-57c2-a752-cc04cec9451e, identifier: LW73612
2026-03-28 14:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0df7e054-f7df-57c2-a752-cc04cec9451e with identifier: LW73612
2026-03-28 14:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0df7e054-f7df-57c2-a752-cc04cec9451e with identifier: LW73612
2026-03-28 14:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0df7e054-f7df-57c2-a752-cc04cec9451e with identifier: LW73612 to the API
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:26:17Z',
 'fuel_type': 'petrol',
 'id': '0df7e054-f7df-57c2-a752-cc04cec9451e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW73612',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 67533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-08',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.2 PureTech Allure L1',
 'transmission': 'manual',
 'trim': 'Allure L1',
 'year': 2020}
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW73612%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [auto1.es] INFO: Saving data for LW73612: {'auction_closing_time': 1774715177.0, 'created_time': 1774523184.559178, 'last_price_update_time': 1774706887.677277}
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LW73612') HTTP/1.1" 204 0
2026-03-28 14:08:07 [auto1.es] INFO: Found listing with ID: MT83706
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT83706%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [auto1.es] INFO: Scrape type for MT83706: 0
2026-03-28 14:08:07 [auto1.es] INFO: Found listing with ID: FT39942
2026-03-28 14:08:07 [auto1.es] INFO: Found listing with ID: TL79249
2026-03-28 14:08:07 [auto1.es] INFO: Found listing with ID: NW09077
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW09077%27 HTTP/1.1" 200 None
2026-03-28 14:08:07 [auto1.es] INFO: Scrape type for NW09077: 2
2026-03-28 14:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3020176-0079-52a8-ad9f-efa2cd6e7ef3 with identifier: NW09077
2026-03-28 14:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3020176-0079-52a8-ad9f-efa2cd6e7ef3 with scrape type 2
2026-03-28 14:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3020176-0079-52a8-ad9f-efa2cd6e7ef3 with scrape type 2
2026-03-28 14:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f3020176-0079-52a8-ad9f-efa2cd6e7ef3, identifier: NW09077
2026-03-28 14:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f3020176-0079-52a8-ad9f-efa2cd6e7ef3 with identifier: NW09077
2026-03-28 14:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f3020176-0079-52a8-ad9f-efa2cd6e7ef3 with identifier: NW09077
2026-03-28 14:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f3020176-0079-52a8-ad9f-efa2cd6e7ef3 with identifier: NW09077 to the API
2026-03-28 14:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:30Z',
 'fuel_type': 'diesel',
 'id': 'f3020176-0079-52a8-ad9f-efa2cd6e7ef3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW09077',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 259797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T Classic',
 'transmission': 'automatic',
 'trim': 'T Classic',
 'year': 2004}
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW09077%27 HTTP/1.1" 200 None
2026-03-28 14:08:08 [auto1.es] INFO: Saving data for NW09077: {'auction_closing_time': 1774715550.0, 'created_time': 1774523158.674261, 'last_price_update_time': 1774706888.130437}
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NW09077') HTTP/1.1" 204 0
2026-03-28 14:08:08 [auto1.es] INFO: Found listing with ID: MD28950
2026-03-28 14:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:09 [auto1.es] INFO: Channel: 24h | Page: 15 | totalHits: 2696 | hits on page: 40
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: XN80961
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN80961%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [auto1.es] INFO: Scrape type for XN80961: 0
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: YT02265
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: PU95944
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU95944%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [auto1.es] INFO: Scrape type for PU95944: 0
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: BD22709
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD22709%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [auto1.es] INFO: Scrape type for BD22709: 2
2026-03-28 14:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c784afe3-1ee0-575d-9e9b-64917fd5e8d2 with identifier: BD22709
2026-03-28 14:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c784afe3-1ee0-575d-9e9b-64917fd5e8d2 with scrape type 2
2026-03-28 14:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c784afe3-1ee0-575d-9e9b-64917fd5e8d2 with scrape type 2
2026-03-28 14:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c784afe3-1ee0-575d-9e9b-64917fd5e8d2, identifier: BD22709
2026-03-28 14:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c784afe3-1ee0-575d-9e9b-64917fd5e8d2 with identifier: BD22709
2026-03-28 14:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c784afe3-1ee0-575d-9e9b-64917fd5e8d2 with identifier: BD22709
2026-03-28 14:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c784afe3-1ee0-575d-9e9b-64917fd5e8d2 with identifier: BD22709 to the API
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:58:11Z',
 'fuel_type': 'diesel',
 'id': 'c784afe3-1ee0-575d-9e9b-64917fd5e8d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD22709',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 130161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-20',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD22709%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [auto1.es] INFO: Saving data for BD22709: {'auction_closing_time': 1774717091.0, 'created_time': 1774523162.127565, 'last_price_update_time': 1774706889.84385}
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BD22709') HTTP/1.1" 204 0
2026-03-28 14:08:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: BK80752
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: JE80773
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: TT52004
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: GW48537
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: KL24436
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: JP19432
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: XG96311
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG96311%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [auto1.es] INFO: Scrape type for XG96311: 0
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: TV58646
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: CS77743
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS77743%27 HTTP/1.1" 200 None
2026-03-28 14:08:09 [auto1.es] INFO: Scrape type for CS77743: 0
2026-03-28 14:08:09 [auto1.es] INFO: Found listing with ID: RW68168
2026-03-28 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW68168%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [auto1.es] INFO: Scrape type for RW68168: 0
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: KM60868
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM60868%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [auto1.es] INFO: Scrape type for KM60868: 0
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: DL91172
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: NY08728
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: CH99472
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: AS02547
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: FZ98481
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ98481%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [auto1.es] INFO: Scrape type for FZ98481: 0
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: YK45669
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK45669%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [auto1.es] INFO: Scrape type for YK45669: 2
2026-03-28 14:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb with identifier: YK45669
2026-03-28 14:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb with scrape type 2
2026-03-28 14:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb with scrape type 2
2026-03-28 14:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb, identifier: YK45669
2026-03-28 14:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb with identifier: YK45669
2026-03-28 14:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb with identifier: YK45669
2026-03-28 14:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb with identifier: YK45669 to the API
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:06:09Z',
 'fuel_type': 'petrol',
 'id': '7bdc6c05-7666-5fbf-9e8f-d1841b37d8eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK45669',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 64930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-13',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK45669%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [auto1.es] INFO: Saving data for YK45669: {'auction_closing_time': 1774713969.0, 'created_time': 1774523150.115356, 'last_price_update_time': 1774706890.542059}
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YK45669') HTTP/1.1" 204 0
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: EM05471
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM05471%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [auto1.es] INFO: Scrape type for EM05471: 0
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: PM27944
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: NA38669
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA38669%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [auto1.es] INFO: Scrape type for NA38669: 0
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: EJ11744
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: EE23918
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: LL51979
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL51979%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [auto1.es] INFO: Scrape type for LL51979: 0
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: EW80297
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW80297%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [auto1.es] INFO: Scrape type for EW80297: 0
2026-03-28 14:08:10 [auto1.es] INFO: Found listing with ID: YL07915
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL07915%27 HTTP/1.1" 200 None
2026-03-28 14:08:10 [auto1.es] INFO: Scrape type for YL07915: 2
2026-03-28 14:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b63a0c-1de6-5725-b692-3081b0506955 with identifier: YL07915
2026-03-28 14:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b63a0c-1de6-5725-b692-3081b0506955 with scrape type 2
2026-03-28 14:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2b63a0c-1de6-5725-b692-3081b0506955 with scrape type 2
2026-03-28 14:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f2b63a0c-1de6-5725-b692-3081b0506955, identifier: YL07915
2026-03-28 14:08:10 [scrapy.extensions.logstats] INFO: Crawled 153 pages (at 5 pages/min), scraped 83 items (at 6 items/min)
2026-03-28 14:08:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-28 14:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f2b63a0c-1de6-5725-b692-3081b0506955 with identifier: YL07915
2026-03-28 14:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f2b63a0c-1de6-5725-b692-3081b0506955 with identifier: YL07915
2026-03-28 14:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f2b63a0c-1de6-5725-b692-3081b0506955 with identifier: YL07915 to the API
2026-03-28 14:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:21:35Z',
 'fuel_type': 'petrol',
 'id': 'f2b63a0c-1de6-5725-b692-3081b0506955',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL07915',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 106097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-29',
 'seller_name': None,
 'title': 'Renault Megane 1.2 GT-Style',
 'transmission': 'manual',
 'trim': 'GT-Style',
 'year': 2014}
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL07915%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [auto1.es] INFO: Saving data for YL07915: {'auction_closing_time': 1774714895.0, 'created_time': 1774123606.207108, 'last_price_update_time': 1774706891.152114}
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YL07915') HTTP/1.1" 204 0
2026-03-28 14:08:11 [auto1.es] INFO: Found listing with ID: DD22164
2026-03-28 14:08:11 [auto1.es] INFO: Found listing with ID: GV40212
2026-03-28 14:08:11 [auto1.es] INFO: Found listing with ID: TV69131
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV69131%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [auto1.es] INFO: Scrape type for TV69131: 0
2026-03-28 14:08:11 [auto1.es] INFO: Found listing with ID: AR64085
2026-03-28 14:08:11 [auto1.es] INFO: Found listing with ID: HS39015
2026-03-28 14:08:11 [auto1.es] INFO: Found listing with ID: UA50937
2026-03-28 14:08:11 [auto1.es] INFO: Found listing with ID: VF83817
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF83817%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [auto1.es] INFO: Scrape type for VF83817: 0
2026-03-28 14:08:11 [auto1.es] INFO: Found listing with ID: VY65813
2026-03-28 14:08:11 [auto1.es] INFO: Found listing with ID: LS09862
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS09862%27 HTTP/1.1" 200 None
2026-03-28 14:08:11 [auto1.es] INFO: Scrape type for LS09862: 0
2026-03-28 14:08:11 [auto1.es] INFO: Found listing with ID: WH92663
2026-03-28 14:08:11 [auto1.es] INFO: Found listing with ID: ZZ49032
2026-03-28 14:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:13 [auto1.es] INFO: Channel: 24h | Page: 16 | totalHits: 2696 | hits on page: 40
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: FL34452
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: DS30814
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: WB36611
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: RY26799
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY26799%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for RY26799: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: FC07978
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: UB97521
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB97521%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for UB97521: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: KY65056
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY65056%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for KY65056: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: SJ54538
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: BG90226
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG90226%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for BG90226: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: GZ75005
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: BN23460
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BN23460%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for BN23460: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: NW38370
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW38370%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for NW38370: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: AV31208
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV31208%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for AV31208: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: MR84623
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR84623%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for MR84623: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: BK60003
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: JP53710
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: LZ41727
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ41727%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for LZ41727: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: ZK36200
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK36200%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for ZK36200: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: LV38775
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV38775%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for LV38775: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: ZM37153
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM37153%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for ZM37153: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: DJ31563
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: KN17188
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN17188%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for KN17188: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: CD82527
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD82527%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for CD82527: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: EX33598
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: MN90156
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN90156%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for MN90156: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: FN32638
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN32638%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for FN32638: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: ZR72253
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR72253%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for ZR72253: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: ZD67493
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: AS98814
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS98814%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for AS98814: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: BK97783
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: KK12600
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK12600%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for KK12600: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: JG89903
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG89903%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for JG89903: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: PK49923
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: LM83979
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM83979%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for LM83979: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: GK87335
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK87335%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for GK87335: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: HV65502
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV65502%27 HTTP/1.1" 200 None
2026-03-28 14:08:13 [auto1.es] INFO: Scrape type for HV65502: 0
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: EM52584
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: WV15930
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: RJ73355
2026-03-28 14:08:13 [auto1.es] INFO: Found listing with ID: MX84470
2026-03-28 14:08:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:14 [auto1.es] INFO: Channel: 24h | Page: 17 | totalHits: 2696 | hits on page: 40
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: JL97970
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL97970%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for JL97970: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: ZM34932
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM34932%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for ZM34932: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: TR33339
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR33339%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for TR33339: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: WJ21268
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: HC75906
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: FW26627
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW26627%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for FW26627: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: WZ74914
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ74914%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for WZ74914: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: BY70112
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: TV99660
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: UF76170
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF76170%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for UF76170: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: GU11117
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU11117%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for GU11117: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: XE21936
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE21936%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for XE21936: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: XS40822
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS40822%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for XS40822: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: AN90905
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN90905%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for AN90905: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: AF12628
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: RE01246
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE01246%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for RE01246: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: SP11103
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP11103%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for SP11103: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: ME86804
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME86804%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for ME86804: 0
2026-03-28 14:08:14 [auto1.es] INFO: Found listing with ID: WC91216
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC91216%27 HTTP/1.1" 200 None
2026-03-28 14:08:14 [auto1.es] INFO: Scrape type for WC91216: 2
2026-03-28 14:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10924a1f-7e49-58ba-889e-09bf370de6c9 with identifier: WC91216
2026-03-28 14:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10924a1f-7e49-58ba-889e-09bf370de6c9 with scrape type 2
2026-03-28 14:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10924a1f-7e49-58ba-889e-09bf370de6c9 with scrape type 2
2026-03-28 14:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 10924a1f-7e49-58ba-889e-09bf370de6c9, identifier: WC91216
2026-03-28 14:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 10924a1f-7e49-58ba-889e-09bf370de6c9 with identifier: WC91216
2026-03-28 14:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 10924a1f-7e49-58ba-889e-09bf370de6c9 with identifier: WC91216
2026-03-28 14:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 10924a1f-7e49-58ba-889e-09bf370de6c9 with identifier: WC91216 to the API
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:26:27Z',
 'fuel_type': 'diesel',
 'id': '10924a1f-7e49-58ba-889e-09bf370de6c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC91216',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 324040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-20',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Tonic',
 'transmission': 'manual',
 'trim': 'Tonic',
 'year': 2014}
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC91216%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [auto1.es] INFO: Saving data for WC91216: {'auction_closing_time': 1774715187.0, 'created_time': 1774523176.893671, 'last_price_update_time': 1774706895.429899}
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WC91216') HTTP/1.1" 204 0
2026-03-28 14:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: DL38940
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: EE29510
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE29510%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [auto1.es] INFO: Scrape type for EE29510: 0
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: ED08036
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: SZ63462
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: RU33051
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU33051%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [auto1.es] INFO: Scrape type for RU33051: 0
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: VL31670
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: LL79483
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL79483%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [auto1.es] INFO: Scrape type for LL79483: 0
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: UX89995
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX89995%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [auto1.es] INFO: Scrape type for UX89995: 0
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: KB87901
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: WB10025
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB10025%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [auto1.es] INFO: Scrape type for WB10025: 0
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: AK86639
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK86639%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [auto1.es] INFO: Scrape type for AK86639: 0
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: UB42787
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: MB13391
2026-03-28 14:08:15 [auto1.es] INFO: Found listing with ID: YU77194
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU77194%27 HTTP/1.1" 200 None
2026-03-28 14:08:15 [auto1.es] INFO: Scrape type for YU77194: 2
2026-03-28 14:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4f6d1bb-6a91-558c-9f5d-7d7380487e54 with identifier: YU77194
2026-03-28 14:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4f6d1bb-6a91-558c-9f5d-7d7380487e54 with scrape type 2
2026-03-28 14:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4f6d1bb-6a91-558c-9f5d-7d7380487e54 with scrape type 2
2026-03-28 14:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d4f6d1bb-6a91-558c-9f5d-7d7380487e54, identifier: YU77194
2026-03-28 14:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d4f6d1bb-6a91-558c-9f5d-7d7380487e54 with identifier: YU77194
2026-03-28 14:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d4f6d1bb-6a91-558c-9f5d-7d7380487e54 with identifier: YU77194
2026-03-28 14:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d4f6d1bb-6a91-558c-9f5d-7d7380487e54 with identifier: YU77194 to the API
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:21:53Z',
 'fuel_type': 'diesel',
 'id': 'd4f6d1bb-6a91-558c-9f5d-7d7380487e54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU77194',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 132151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-29',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2016}
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU77194%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [auto1.es] INFO: Saving data for YU77194: {'auction_closing_time': 1774714913.0, 'created_time': 1774523145.793952, 'last_price_update_time': 1774706896.066485}
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YU77194') HTTP/1.1" 204 0
2026-03-28 14:08:16 [auto1.es] INFO: Found listing with ID: TU71868
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU71868%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [auto1.es] INFO: Scrape type for TU71868: 2
2026-03-28 14:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4706df4c-2d00-5984-8220-607550ce2e00 with identifier: TU71868
2026-03-28 14:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4706df4c-2d00-5984-8220-607550ce2e00 with scrape type 2
2026-03-28 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4706df4c-2d00-5984-8220-607550ce2e00 with scrape type 2
2026-03-28 14:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4706df4c-2d00-5984-8220-607550ce2e00, identifier: TU71868
2026-03-28 14:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4706df4c-2d00-5984-8220-607550ce2e00 with identifier: TU71868
2026-03-28 14:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4706df4c-2d00-5984-8220-607550ce2e00 with identifier: TU71868
2026-03-28 14:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4706df4c-2d00-5984-8220-607550ce2e00 with identifier: TU71868 to the API
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:20:07Z',
 'fuel_type': 'diesel',
 'id': '4706df4c-2d00-5984-8220-607550ce2e00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU71868',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 107594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Peugeot Expert 1.6 Blue-HDi L2',
 'transmission': 'manual',
 'trim': 'L2',
 'year': 2016}
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU71868%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [auto1.es] INFO: Saving data for TU71868: {'auction_closing_time': 1774714807.0, 'created_time': 1773127935.764781, 'last_price_update_time': 1774706896.6408}
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TU71868') HTTP/1.1" 204 0
2026-03-28 14:08:16 [auto1.es] INFO: Found listing with ID: XT49013
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT49013%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [auto1.es] INFO: Scrape type for XT49013: 0
2026-03-28 14:08:16 [auto1.es] INFO: Found listing with ID: TX70336
2026-03-28 14:08:16 [auto1.es] INFO: Found listing with ID: KD45513
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD45513%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [auto1.es] INFO: Scrape type for KD45513: 0
2026-03-28 14:08:16 [auto1.es] INFO: Found listing with ID: YD06518
2026-03-28 14:08:16 [auto1.es] INFO: Found listing with ID: UT62475
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT62475%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [auto1.es] INFO: Scrape type for UT62475: 0
2026-03-28 14:08:16 [auto1.es] INFO: Found listing with ID: VJ40184
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ40184%27 HTTP/1.1" 200 None
2026-03-28 14:08:16 [auto1.es] INFO: Scrape type for VJ40184: 0
2026-03-28 14:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:17 [auto1.es] INFO: Channel: 24h | Page: 18 | totalHits: 2696 | hits on page: 40
2026-03-28 14:08:17 [auto1.es] INFO: Found listing with ID: JF96117
2026-03-28 14:08:17 [auto1.es] INFO: Found listing with ID: VF82701
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF82701%27 HTTP/1.1" 200 None
2026-03-28 14:08:17 [auto1.es] INFO: Scrape type for VF82701: 2
2026-03-28 14:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a1884b1-48e3-5fc0-932c-9cc9ec466835 with identifier: VF82701
2026-03-28 14:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a1884b1-48e3-5fc0-932c-9cc9ec466835 with scrape type 2
2026-03-28 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a1884b1-48e3-5fc0-932c-9cc9ec466835 with scrape type 2
2026-03-28 14:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2a1884b1-48e3-5fc0-932c-9cc9ec466835, identifier: VF82701
2026-03-28 14:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2a1884b1-48e3-5fc0-932c-9cc9ec466835 with identifier: VF82701
2026-03-28 14:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2a1884b1-48e3-5fc0-932c-9cc9ec466835 with identifier: VF82701
2026-03-28 14:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2a1884b1-48e3-5fc0-932c-9cc9ec466835 with identifier: VF82701 to the API
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:33:09Z',
 'fuel_type': 'petrol',
 'id': '2a1884b1-48e3-5fc0-932c-9cc9ec466835',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF82701',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 192358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2018}
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF82701%27 HTTP/1.1" 200 None
2026-03-28 14:08:18 [auto1.es] INFO: Saving data for VF82701: {'auction_closing_time': 1774715589.0, 'created_time': 1774523164.803533, 'last_price_update_time': 1774706898.264782}
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VF82701') HTTP/1.1" 204 0
2026-03-28 14:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:18 [auto1.es] INFO: Found listing with ID: PE23246
2026-03-28 14:08:18 [auto1.es] INFO: Found listing with ID: DR94392
2026-03-28 14:08:18 [auto1.es] INFO: Found listing with ID: FP05442
2026-03-28 14:08:18 [auto1.es] INFO: Found listing with ID: HC55702
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC55702%27 HTTP/1.1" 200 None
2026-03-28 14:08:18 [auto1.es] INFO: Scrape type for HC55702: 0
2026-03-28 14:08:18 [auto1.es] INFO: Found listing with ID: HP42544
2026-03-28 14:08:18 [auto1.es] INFO: Found listing with ID: SR16333
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR16333%27 HTTP/1.1" 200 None
2026-03-28 14:08:18 [auto1.es] INFO: Scrape type for SR16333: 0
2026-03-28 14:08:18 [auto1.es] INFO: Found listing with ID: XL86918
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL86918%27 HTTP/1.1" 200 None
2026-03-28 14:08:18 [auto1.es] INFO: Scrape type for XL86918: 0
2026-03-28 14:08:18 [auto1.es] INFO: Found listing with ID: YB76254
2026-03-28 14:08:18 [auto1.es] INFO: Found listing with ID: LH51054
2026-03-28 14:08:18 [auto1.es] INFO: Found listing with ID: TZ65854
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ65854%27 HTTP/1.1" 200 None
2026-03-28 14:08:18 [auto1.es] INFO: Scrape type for TZ65854: 0
2026-03-28 14:08:18 [auto1.es] INFO: Found listing with ID: GT68357
2026-03-28 14:08:18 [auto1.es] INFO: Found listing with ID: XJ12820
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ12820%27 HTTP/1.1" 200 None
2026-03-28 14:08:18 [auto1.es] INFO: Scrape type for XJ12820: 2
2026-03-28 14:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d63914-929e-5e2f-8f95-1713aedf76ce with identifier: XJ12820
2026-03-28 14:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d63914-929e-5e2f-8f95-1713aedf76ce with scrape type 2
2026-03-28 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5d63914-929e-5e2f-8f95-1713aedf76ce with scrape type 2
2026-03-28 14:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e5d63914-929e-5e2f-8f95-1713aedf76ce, identifier: XJ12820
2026-03-28 14:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e5d63914-929e-5e2f-8f95-1713aedf76ce with identifier: XJ12820
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 14:08:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e5d63914-929e-5e2f-8f95-1713aedf76ce with identifier: XJ12820
2026-03-28 14:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e5d63914-929e-5e2f-8f95-1713aedf76ce with identifier: XJ12820 to the API
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-28T16:03:31Z',
 'fuel_type': 'electro',
 'id': 'e5d63914-929e-5e2f-8f95-1713aedf76ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ12820',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 71249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seller_name': None,
 'title': 'Fiat 500e electric drive 87 kW Icon',
 'transmission': 'automatic',
 'trim': 'Icon',
 'year': 2022}
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ12820%27 HTTP/1.1" 200 None
2026-03-28 14:08:18 [auto1.es] INFO: Saving data for XJ12820: {'auction_closing_time': 1774713811.0, 'created_time': 1774523182.048374, 'last_price_update_time': 1774706898.987018}
2026-03-28 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XJ12820') HTTP/1.1" 204 0
2026-03-28 14:08:19 [auto1.es] INFO: Found listing with ID: WZ30869
2026-03-28 14:08:19 [auto1.es] INFO: Found listing with ID: XZ41303
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ41303%27 HTTP/1.1" 200 None
2026-03-28 14:08:19 [auto1.es] INFO: Scrape type for XZ41303: 0
2026-03-28 14:08:19 [auto1.es] INFO: Found listing with ID: MG78931
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG78931%27 HTTP/1.1" 200 None
2026-03-28 14:08:19 [auto1.es] INFO: Scrape type for MG78931: 2
2026-03-28 14:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a0a96f5-e623-5fa6-a3b6-b3c5f1dbeab2 with identifier: MG78931
2026-03-28 14:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a0a96f5-e623-5fa6-a3b6-b3c5f1dbeab2 with scrape type 2
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a0a96f5-e623-5fa6-a3b6-b3c5f1dbeab2 with scrape type 2
2026-03-28 14:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3a0a96f5-e623-5fa6-a3b6-b3c5f1dbeab2, identifier: MG78931
2026-03-28 14:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3a0a96f5-e623-5fa6-a3b6-b3c5f1dbeab2 with identifier: MG78931
2026-03-28 14:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3a0a96f5-e623-5fa6-a3b6-b3c5f1dbeab2 with identifier: MG78931
2026-03-28 14:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3a0a96f5-e623-5fa6-a3b6-b3c5f1dbeab2 with identifier: MG78931 to the API
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:14:17Z',
 'fuel_type': 'diesel',
 'id': '3a0a96f5-e623-5fa6-a3b6-b3c5f1dbeab2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG78931',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 248552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2008}
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG78931%27 HTTP/1.1" 200 None
2026-03-28 14:08:19 [auto1.es] INFO: Saving data for MG78931: {'auction_closing_time': 1774714457.0, 'created_time': 1773778176.502859, 'last_price_update_time': 1774706899.550371}
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MG78931') HTTP/1.1" 204 0
2026-03-28 14:08:19 [auto1.es] INFO: Found listing with ID: HW09758
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW09758%27 HTTP/1.1" 200 None
2026-03-28 14:08:19 [auto1.es] INFO: Scrape type for HW09758: 0
2026-03-28 14:08:19 [auto1.es] INFO: Found listing with ID: AU55314
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU55314%27 HTTP/1.1" 200 None
2026-03-28 14:08:19 [auto1.es] INFO: Scrape type for AU55314: 0
2026-03-28 14:08:19 [auto1.es] INFO: Found listing with ID: LF34869
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF34869%27 HTTP/1.1" 200 None
2026-03-28 14:08:19 [auto1.es] INFO: Scrape type for LF34869: 2
2026-03-28 14:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd644c4-1d14-56be-8de7-8493339bc2a8 with identifier: LF34869
2026-03-28 14:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd644c4-1d14-56be-8de7-8493339bc2a8 with scrape type 2
2026-03-28 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fd644c4-1d14-56be-8de7-8493339bc2a8 with scrape type 2
2026-03-28 14:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5fd644c4-1d14-56be-8de7-8493339bc2a8, identifier: LF34869
2026-03-28 14:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5fd644c4-1d14-56be-8de7-8493339bc2a8 with identifier: LF34869
2026-03-28 14:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5fd644c4-1d14-56be-8de7-8493339bc2a8 with identifier: LF34869
2026-03-28 14:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5fd644c4-1d14-56be-8de7-8493339bc2a8 with identifier: LF34869 to the API
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:53:16Z',
 'fuel_type': 'petrol',
 'id': '5fd644c4-1d14-56be-8de7-8493339bc2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF34869',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 124173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Drive",
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2012}
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF34869%27 HTTP/1.1" 200 None
2026-03-28 14:08:19 [auto1.es] INFO: Saving data for LF34869: {'auction_closing_time': 1774716796.0, 'created_time': 1774523181.503057, 'last_price_update_time': 1774706899.995643}
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LF34869') HTTP/1.1" 204 0
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: ZD98631
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: CX01476
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: YW16377
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW16377%27 HTTP/1.1" 200 None
2026-03-28 14:08:20 [auto1.es] INFO: Scrape type for YW16377: 0
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: LK93242
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK93242%27 HTTP/1.1" 200 None
2026-03-28 14:08:20 [auto1.es] INFO: Scrape type for LK93242: 0
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: WH79460
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: BP77567
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: HF28057
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: HR03779
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: XH48089
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH48089%27 HTTP/1.1" 200 None
2026-03-28 14:08:20 [auto1.es] INFO: Scrape type for XH48089: 2
2026-03-28 14:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad6b8eef-b1d6-54ac-836f-d69d485fd0f3 with identifier: XH48089
2026-03-28 14:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad6b8eef-b1d6-54ac-836f-d69d485fd0f3 with scrape type 2
2026-03-28 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad6b8eef-b1d6-54ac-836f-d69d485fd0f3 with scrape type 2
2026-03-28 14:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ad6b8eef-b1d6-54ac-836f-d69d485fd0f3, identifier: XH48089
2026-03-28 14:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ad6b8eef-b1d6-54ac-836f-d69d485fd0f3 with identifier: XH48089
2026-03-28 14:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ad6b8eef-b1d6-54ac-836f-d69d485fd0f3 with identifier: XH48089
2026-03-28 14:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ad6b8eef-b1d6-54ac-836f-d69d485fd0f3 with identifier: XH48089 to the API
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:15:11Z',
 'fuel_type': 'petrol',
 'id': 'ad6b8eef-b1d6-54ac-836f-d69d485fd0f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH48089',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 24021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-26',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Live',
 'transmission': 'manual',
 'trim': 'Live',
 'year': 2011}
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH48089%27 HTTP/1.1" 200 None
2026-03-28 14:08:20 [auto1.es] INFO: Saving data for XH48089: {'auction_closing_time': 1774714511.0, 'created_time': 1774523167.51882, 'last_price_update_time': 1774706900.489509}
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XH48089') HTTP/1.1" 204 0
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: AM70674
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: WY37005
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY37005%27 HTTP/1.1" 200 None
2026-03-28 14:08:20 [auto1.es] INFO: Scrape type for WY37005: 0
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: YD82310
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD82310%27 HTTP/1.1" 200 None
2026-03-28 14:08:20 [auto1.es] INFO: Scrape type for YD82310: 0
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: NM83304
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: JY28028
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY28028%27 HTTP/1.1" 200 None
2026-03-28 14:08:20 [auto1.es] INFO: Scrape type for JY28028: 0
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: AK94783
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: KP85187
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: LM23612
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: ZJ79467
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ79467%27 HTTP/1.1" 200 None
2026-03-28 14:08:20 [auto1.es] INFO: Scrape type for ZJ79467: 0
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: YB91209
2026-03-28 14:08:20 [auto1.es] INFO: Found listing with ID: VM24550
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM24550%27 HTTP/1.1" 200 None
2026-03-28 14:08:20 [auto1.es] INFO: Scrape type for VM24550: 0
2026-03-28 14:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:21 [auto1.es] INFO: Channel: 24h | Page: 19 | totalHits: 2696 | hits on page: 40
2026-03-28 14:08:21 [auto1.es] INFO: Found listing with ID: YY16835
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY16835%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [auto1.es] INFO: Scrape type for YY16835: 0
2026-03-28 14:08:21 [auto1.es] INFO: Found listing with ID: PC46178
2026-03-28 14:08:21 [auto1.es] INFO: Found listing with ID: FN37558
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN37558%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [auto1.es] INFO: Scrape type for FN37558: 0
2026-03-28 14:08:21 [auto1.es] INFO: Found listing with ID: DB28446
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB28446%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [auto1.es] INFO: Scrape type for DB28446: 2
2026-03-28 14:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87aa2c7d-0746-57a3-92bb-7330f4a6c96f with identifier: DB28446
2026-03-28 14:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87aa2c7d-0746-57a3-92bb-7330f4a6c96f with scrape type 2
2026-03-28 14:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87aa2c7d-0746-57a3-92bb-7330f4a6c96f with scrape type 2
2026-03-28 14:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 87aa2c7d-0746-57a3-92bb-7330f4a6c96f, identifier: DB28446
2026-03-28 14:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 87aa2c7d-0746-57a3-92bb-7330f4a6c96f with identifier: DB28446
2026-03-28 14:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 87aa2c7d-0746-57a3-92bb-7330f4a6c96f with identifier: DB28446
2026-03-28 14:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 87aa2c7d-0746-57a3-92bb-7330f4a6c96f with identifier: DB28446 to the API
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:27:15Z',
 'fuel_type': 'petrol',
 'id': '87aa2c7d-0746-57a3-92bb-7330f4a6c96f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB28446',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 71578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-19',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB28446%27 HTTP/1.1" 200 None
2026-03-28 14:08:21 [auto1.es] INFO: Saving data for DB28446: {'auction_closing_time': 1774715235.0, 'created_time': 1774523178.924498, 'last_price_update_time': 1774706901.89436}
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DB28446') HTTP/1.1" 204 0
2026-03-28 14:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:22 [auto1.es] INFO: Found listing with ID: KS53937
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS53937%27 HTTP/1.1" 200 None
2026-03-28 14:08:22 [auto1.es] INFO: Scrape type for KS53937: 0
2026-03-28 14:08:22 [auto1.es] INFO: Found listing with ID: FX87163
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX87163%27 HTTP/1.1" 200 None
2026-03-28 14:08:22 [auto1.es] INFO: Scrape type for FX87163: 0
2026-03-28 14:08:22 [auto1.es] INFO: Found listing with ID: UK11838
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK11838%27 HTTP/1.1" 200 None
2026-03-28 14:08:22 [auto1.es] INFO: Scrape type for UK11838: 0
2026-03-28 14:08:22 [auto1.es] INFO: Found listing with ID: NW63422
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW63422%27 HTTP/1.1" 200 None
2026-03-28 14:08:22 [auto1.es] INFO: Scrape type for NW63422: 2
2026-03-28 14:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1255ee8d-8abd-5c3d-978e-5b1ded8fbaaa with identifier: NW63422
2026-03-28 14:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1255ee8d-8abd-5c3d-978e-5b1ded8fbaaa with scrape type 2
2026-03-28 14:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1255ee8d-8abd-5c3d-978e-5b1ded8fbaaa with scrape type 2
2026-03-28 14:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1255ee8d-8abd-5c3d-978e-5b1ded8fbaaa, identifier: NW63422
2026-03-28 14:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1255ee8d-8abd-5c3d-978e-5b1ded8fbaaa with identifier: NW63422
2026-03-28 14:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1255ee8d-8abd-5c3d-978e-5b1ded8fbaaa with identifier: NW63422
2026-03-28 14:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1255ee8d-8abd-5c3d-978e-5b1ded8fbaaa with identifier: NW63422 to the API
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:11:35Z',
 'fuel_type': 'diesel',
 'id': '1255ee8d-8abd-5c3d-978e-5b1ded8fbaaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW63422',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 661787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'BlueTEC AMG Line',
 'year': 2016}
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW63422%27 HTTP/1.1" 200 None
2026-03-28 14:08:22 [auto1.es] INFO: Saving data for NW63422: {'auction_closing_time': 1774714295.0, 'created_time': 1774101983.586721, 'last_price_update_time': 1774706902.512339}
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NW63422') HTTP/1.1" 204 0
2026-03-28 14:08:22 [auto1.es] INFO: Found listing with ID: GZ61403
2026-03-28 14:08:22 [auto1.es] INFO: Found listing with ID: BP61591
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP61591%27 HTTP/1.1" 200 None
2026-03-28 14:08:22 [auto1.es] INFO: Scrape type for BP61591: 0
2026-03-28 14:08:22 [auto1.es] INFO: Found listing with ID: SC27418
2026-03-28 14:08:22 [auto1.es] INFO: Found listing with ID: LS69638
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS69638%27 HTTP/1.1" 200 None
2026-03-28 14:08:22 [auto1.es] INFO: Scrape type for LS69638: 0
2026-03-28 14:08:22 [auto1.es] INFO: Found listing with ID: WF15705
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF15705%27 HTTP/1.1" 200 None
2026-03-28 14:08:22 [auto1.es] INFO: Scrape type for WF15705: 0
2026-03-28 14:08:22 [auto1.es] INFO: Found listing with ID: NJ68356
2026-03-28 14:08:22 [auto1.es] INFO: Found listing with ID: LC97484
2026-03-28 14:08:22 [auto1.es] INFO: Found listing with ID: NP49445
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP49445%27 HTTP/1.1" 200 None
2026-03-28 14:08:22 [auto1.es] INFO: Scrape type for NP49445: 2
2026-03-28 14:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d429b188-22fd-599d-be76-f44a89dbd4b5 with identifier: NP49445
2026-03-28 14:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d429b188-22fd-599d-be76-f44a89dbd4b5 with scrape type 2
2026-03-28 14:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d429b188-22fd-599d-be76-f44a89dbd4b5 with scrape type 2
2026-03-28 14:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d429b188-22fd-599d-be76-f44a89dbd4b5, identifier: NP49445
2026-03-28 14:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d429b188-22fd-599d-be76-f44a89dbd4b5 with identifier: NP49445
2026-03-28 14:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d429b188-22fd-599d-be76-f44a89dbd4b5 with identifier: NP49445
2026-03-28 14:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d429b188-22fd-599d-be76-f44a89dbd4b5 with identifier: NP49445 to the API
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:14:18Z',
 'fuel_type': 'diesel',
 'id': 'd429b188-22fd-599d-be76-f44a89dbd4b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP49445',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 82769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-12',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP49445%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Saving data for NP49445: {'auction_closing_time': 1774714458.0, 'created_time': 1774523196.431648, 'last_price_update_time': 1774706903.016486}
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NP49445') HTTP/1.1" 204 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: FR82793
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: HJ26610
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ26610%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for HJ26610: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: LF82591
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF82591%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for LF82591: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: HW63971
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW63971%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for HW63971: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: GU42237
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: RH35807
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH35807%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for RH35807: 2
2026-03-28 14:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea27dd70-c045-5567-87ca-ff282ebbe48c with identifier: RH35807
2026-03-28 14:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea27dd70-c045-5567-87ca-ff282ebbe48c with scrape type 2
2026-03-28 14:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea27dd70-c045-5567-87ca-ff282ebbe48c with scrape type 2
2026-03-28 14:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ea27dd70-c045-5567-87ca-ff282ebbe48c, identifier: RH35807
2026-03-28 14:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ea27dd70-c045-5567-87ca-ff282ebbe48c with identifier: RH35807
2026-03-28 14:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ea27dd70-c045-5567-87ca-ff282ebbe48c with identifier: RH35807
2026-03-28 14:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ea27dd70-c045-5567-87ca-ff282ebbe48c with identifier: RH35807 to the API
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:45:47Z',
 'fuel_type': 'petrol',
 'id': 'ea27dd70-c045-5567-87ca-ff282ebbe48c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH35807',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 107533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH35807%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Saving data for RH35807: {'auction_closing_time': 1774716347.0, 'created_time': 1774523199.061651, 'last_price_update_time': 1774706903.646255}
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RH35807') HTTP/1.1" 204 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: HN32774
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN32774%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for HN32774: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: LC37713
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: MZ99822
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: YS28184
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS28184%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for YS28184: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: VR49277
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR49277%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for VR49277: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: FJ90358
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ90358%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for FJ90358: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: TU72594
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU72594%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for TU72594: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: CR48575
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR48575%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for CR48575: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: WR24367
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR24367%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for WR24367: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: VL94048
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL94048%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for VL94048: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: TW02627
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: AE32204
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE32204%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for AE32204: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: JE65744
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: PF77952
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF77952%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for PF77952: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: HR81146
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: YD06754
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD06754%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for YD06754: 0
2026-03-28 14:08:23 [auto1.es] INFO: Found listing with ID: WD69770
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD69770%27 HTTP/1.1" 200 None
2026-03-28 14:08:23 [auto1.es] INFO: Scrape type for WD69770: 2
2026-03-28 14:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20eb27e7-bdf7-5339-bf8e-d0ef743775dd with identifier: WD69770
2026-03-28 14:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20eb27e7-bdf7-5339-bf8e-d0ef743775dd with scrape type 2
2026-03-28 14:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20eb27e7-bdf7-5339-bf8e-d0ef743775dd with scrape type 2
2026-03-28 14:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 20eb27e7-bdf7-5339-bf8e-d0ef743775dd, identifier: WD69770
2026-03-28 14:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 20eb27e7-bdf7-5339-bf8e-d0ef743775dd with identifier: WD69770
2026-03-28 14:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 20eb27e7-bdf7-5339-bf8e-d0ef743775dd with identifier: WD69770
2026-03-28 14:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 20eb27e7-bdf7-5339-bf8e-d0ef743775dd with identifier: WD69770 to the API
2026-03-28 14:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:42:57Z',
 'fuel_type': 'diesel',
 'id': '20eb27e7-bdf7-5339-bf8e-d0ef743775dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD69770',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 183942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2019}
2026-03-28 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD69770%27 HTTP/1.1" 200 None
2026-03-28 14:08:24 [auto1.es] INFO: Saving data for WD69770: {'auction_closing_time': 1774716177.0, 'created_time': 1773918516.121751, 'last_price_update_time': 1774706904.298728}
2026-03-28 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WD69770') HTTP/1.1" 204 0
2026-03-28 14:08:24 [auto1.es] INFO: Found listing with ID: JG96257
2026-03-28 14:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:25 [auto1.es] INFO: Channel: 24h | Page: 20 | totalHits: 2696 | hits on page: 40
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: JZ51794
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: RB01014
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: LK62452
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK62452%27 HTTP/1.1" 200 None
2026-03-28 14:08:25 [auto1.es] INFO: Scrape type for LK62452: 2
2026-03-28 14:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd91dfbe-f369-5f7a-a03a-ff00fc2bb3e7 with identifier: LK62452
2026-03-28 14:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd91dfbe-f369-5f7a-a03a-ff00fc2bb3e7 with scrape type 2
2026-03-28 14:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd91dfbe-f369-5f7a-a03a-ff00fc2bb3e7 with scrape type 2
2026-03-28 14:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dd91dfbe-f369-5f7a-a03a-ff00fc2bb3e7, identifier: LK62452
2026-03-28 14:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dd91dfbe-f369-5f7a-a03a-ff00fc2bb3e7 with identifier: LK62452
2026-03-28 14:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dd91dfbe-f369-5f7a-a03a-ff00fc2bb3e7 with identifier: LK62452
2026-03-28 14:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dd91dfbe-f369-5f7a-a03a-ff00fc2bb3e7 with identifier: LK62452 to the API
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:21:05Z',
 'fuel_type': 'diesel',
 'id': 'dd91dfbe-f369-5f7a-a03a-ff00fc2bb3e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK62452',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 288998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-31',
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2007}
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK62452%27 HTTP/1.1" 200 None
2026-03-28 14:08:25 [auto1.es] INFO: Saving data for LK62452: {'auction_closing_time': 1774714865.0, 'created_time': 1774523125.530391, 'last_price_update_time': 1774706905.843136}
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LK62452') HTTP/1.1" 204 0
2026-03-28 14:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: RL13967
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: PG01286
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: YT35531
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT35531%27 HTTP/1.1" 200 None
2026-03-28 14:08:25 [auto1.es] INFO: Scrape type for YT35531: 0
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: JF42327
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: UR00464
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR00464%27 HTTP/1.1" 200 None
2026-03-28 14:08:25 [auto1.es] INFO: Scrape type for UR00464: 0
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: WV47930
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV47930%27 HTTP/1.1" 200 None
2026-03-28 14:08:25 [auto1.es] INFO: Scrape type for WV47930: 0
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: SH75312
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: DM90018
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM90018%27 HTTP/1.1" 200 None
2026-03-28 14:08:25 [auto1.es] INFO: Scrape type for DM90018: 0
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: WM47601
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM47601%27 HTTP/1.1" 200 None
2026-03-28 14:08:25 [auto1.es] INFO: Scrape type for WM47601: 0
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: LS55149
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: TD48491
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD48491%27 HTTP/1.1" 200 None
2026-03-28 14:08:25 [auto1.es] INFO: Scrape type for TD48491: 0
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: ZJ95453
2026-03-28 14:08:25 [auto1.es] INFO: Found listing with ID: FC13262
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC13262%27 HTTP/1.1" 200 None
2026-03-28 14:08:25 [auto1.es] INFO: Scrape type for FC13262: 2
2026-03-28 14:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f9721b-f495-58a9-92a9-e1047e0ababa with identifier: FC13262
2026-03-28 14:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f9721b-f495-58a9-92a9-e1047e0ababa with scrape type 2
2026-03-28 14:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89f9721b-f495-58a9-92a9-e1047e0ababa with scrape type 2
2026-03-28 14:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 89f9721b-f495-58a9-92a9-e1047e0ababa, identifier: FC13262
2026-03-28 14:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 89f9721b-f495-58a9-92a9-e1047e0ababa with identifier: FC13262
2026-03-28 14:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 89f9721b-f495-58a9-92a9-e1047e0ababa with identifier: FC13262
2026-03-28 14:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 89f9721b-f495-58a9-92a9-e1047e0ababa with identifier: FC13262 to the API
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:03:24Z',
 'fuel_type': 'diesel',
 'id': '89f9721b-f495-58a9-92a9-e1047e0ababa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC13262',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 69568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-02',
 'seller_name': None,
 'title': 'MINI Cooper SD',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC13262%27 HTTP/1.1" 200 None
2026-03-28 14:08:26 [auto1.es] INFO: Saving data for FC13262: {'auction_closing_time': 1774713804.0, 'created_time': 1774523152.011103, 'last_price_update_time': 1774706906.342655}
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FC13262') HTTP/1.1" 204 0
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: RP86418
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: SM64355
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM64355%27 HTTP/1.1" 200 None
2026-03-28 14:08:26 [auto1.es] INFO: Scrape type for SM64355: 0
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: NU52184
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NU52184%27 HTTP/1.1" 200 None
2026-03-28 14:08:26 [auto1.es] INFO: Scrape type for NU52184: 0
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: FY50963
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: NN48613
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: AZ28710
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: TC59600
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC59600%27 HTTP/1.1" 200 None
2026-03-28 14:08:26 [auto1.es] INFO: Scrape type for TC59600: 0
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: VP39561
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: EU66649
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU66649%27 HTTP/1.1" 200 None
2026-03-28 14:08:26 [auto1.es] INFO: Scrape type for EU66649: 0
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: FY66249
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY66249%27 HTTP/1.1" 200 None
2026-03-28 14:08:26 [auto1.es] INFO: Scrape type for FY66249: 0
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: PR87201
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR87201%27 HTTP/1.1" 200 None
2026-03-28 14:08:26 [auto1.es] INFO: Scrape type for PR87201: 0
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: FK50092
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: ZJ44850
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ44850%27 HTTP/1.1" 200 None
2026-03-28 14:08:26 [auto1.es] INFO: Scrape type for ZJ44850: 0
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: PZ33789
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ33789%27 HTTP/1.1" 200 None
2026-03-28 14:08:26 [auto1.es] INFO: Scrape type for PZ33789: 0
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: WZ85087
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: LP06915
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: GD92135
2026-03-28 14:08:26 [auto1.es] INFO: Found listing with ID: ZE71239
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE71239%27 HTTP/1.1" 200 None
2026-03-28 14:08:26 [auto1.es] INFO: Scrape type for ZE71239: 2
2026-03-28 14:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 234d78a8-41d2-5daa-8cb4-1e0c99acc1ae with identifier: ZE71239
2026-03-28 14:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 234d78a8-41d2-5daa-8cb4-1e0c99acc1ae with scrape type 2
2026-03-28 14:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 234d78a8-41d2-5daa-8cb4-1e0c99acc1ae with scrape type 2
2026-03-28 14:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 234d78a8-41d2-5daa-8cb4-1e0c99acc1ae, identifier: ZE71239
2026-03-28 14:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 234d78a8-41d2-5daa-8cb4-1e0c99acc1ae with identifier: ZE71239
2026-03-28 14:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 234d78a8-41d2-5daa-8cb4-1e0c99acc1ae with identifier: ZE71239
2026-03-28 14:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 234d78a8-41d2-5daa-8cb4-1e0c99acc1ae with identifier: ZE71239 to the API
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:38:58Z',
 'fuel_type': 'petrol',
 'id': '234d78a8-41d2-5daa-8cb4-1e0c99acc1ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE71239',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-TYPE',
 'odometer': 47568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-16',
 'seller_name': None,
 'title': 'Jaguar F-TYPE 30t R-Dynamic',
 'transmission': 'automatic',
 'trim': 'R-Dynamic',
 'year': 2019}
2026-03-28 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE71239%27 HTTP/1.1" 200 None
2026-03-28 14:08:27 [auto1.es] INFO: Saving data for ZE71239: {'auction_closing_time': 1774715938.0, 'created_time': 1773691623.43739, 'last_price_update_time': 1774706907.0312}
2026-03-28 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZE71239') HTTP/1.1" 204 0
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: RK72644
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: AC50024
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: JK92446
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: UP55531
2026-03-28 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP55531%27 HTTP/1.1" 200 None
2026-03-28 14:08:27 [auto1.es] INFO: Scrape type for UP55531: 0
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: WD98300
2026-03-28 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD98300%27 HTTP/1.1" 200 None
2026-03-28 14:08:27 [auto1.es] INFO: Scrape type for WD98300: 0
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: DR19910
2026-03-28 14:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:27 [auto1.es] INFO: Channel: 24h | Page: 21 | totalHits: 2696 | hits on page: 40
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: WA10977
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: BF22404
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: MF04433
2026-03-28 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF04433%27 HTTP/1.1" 200 None
2026-03-28 14:08:27 [auto1.es] INFO: Scrape type for MF04433: 0
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: VV66247
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: BK72591
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: NV84448
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: FH30373
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: TB24356
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: TA73897
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: WG98827
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: TF48403
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: EV89270
2026-03-28 14:08:27 [auto1.es] INFO: Found listing with ID: GA27189
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA27189%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for GA27189: 0
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: UG25415
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: XG18917
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: WJ72825
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: YN66456
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN66456%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for YN66456: 0
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: UT89838
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT89838%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for UT89838: 0
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: DW22650
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: WL78686
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL78686%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for WL78686: 0
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: ZL13799
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: GU11449
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU11449%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for GU11449: 0
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: DG38450
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG38450%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for DG38450: 0
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: MR72452
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: KF98963
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: BT14659
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: EK65360
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: WC72839
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC72839%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for WC72839: 0
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: ZK05634
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: LM00276
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM00276%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for LM00276: 2
2026-03-28 14:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32543542-f779-5288-89f9-c540962c41e7 with identifier: LM00276
2026-03-28 14:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32543542-f779-5288-89f9-c540962c41e7 with scrape type 2
2026-03-28 14:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32543542-f779-5288-89f9-c540962c41e7 with scrape type 2
2026-03-28 14:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 32543542-f779-5288-89f9-c540962c41e7, identifier: LM00276
2026-03-28 14:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 32543542-f779-5288-89f9-c540962c41e7 with identifier: LM00276
2026-03-28 14:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 32543542-f779-5288-89f9-c540962c41e7 with identifier: LM00276
2026-03-28 14:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 32543542-f779-5288-89f9-c540962c41e7 with identifier: LM00276 to the API
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:03:51Z',
 'fuel_type': 'diesel',
 'id': '32543542-f779-5288-89f9-c540962c41e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM00276',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 207906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-02-19',
 'seller_name': None,
 'title': 'Seat Leon 1.9 TDI Sports Limited',
 'transmission': 'manual',
 'trim': 'Sports Limited',
 'year': 2004}
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM00276%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Saving data for LM00276: {'auction_closing_time': 1774713831.0, 'created_time': 1774523125.933246, 'last_price_update_time': 1774706908.708503}
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LM00276') HTTP/1.1" 204 0
2026-03-28 14:08:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: GZ25501
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: AP64708
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP64708%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for AP64708: 0
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: SE84848
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE84848%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for SE84848: 0
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: KW07393
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW07393%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for KW07393: 0
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: EH84467
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH84467%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for EH84467: 0
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: ZW00345
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: SZ42428
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ42428%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for SZ42428: 0
2026-03-28 14:08:28 [auto1.es] INFO: Found listing with ID: WH24419
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH24419%27 HTTP/1.1" 200 None
2026-03-28 14:08:28 [auto1.es] INFO: Scrape type for WH24419: 2
2026-03-28 14:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f924903-711c-55aa-be5d-6227e627e7d4 with identifier: WH24419
2026-03-28 14:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f924903-711c-55aa-be5d-6227e627e7d4 with scrape type 2
2026-03-28 14:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f924903-711c-55aa-be5d-6227e627e7d4 with scrape type 2
2026-03-28 14:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f924903-711c-55aa-be5d-6227e627e7d4, identifier: WH24419
2026-03-28 14:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f924903-711c-55aa-be5d-6227e627e7d4 with identifier: WH24419
2026-03-28 14:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f924903-711c-55aa-be5d-6227e627e7d4 with identifier: WH24419
2026-03-28 14:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f924903-711c-55aa-be5d-6227e627e7d4 with identifier: WH24419 to the API
2026-03-28 14:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-28T16:45:29Z',
 'fuel_type': 'hybrid',
 'id': '2f924903-711c-55aa-be5d-6227e627e7d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH24419',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 191480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-09',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2019}
2026-03-28 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH24419%27 HTTP/1.1" 200 None
2026-03-28 14:08:29 [auto1.es] INFO: Saving data for WH24419: {'auction_closing_time': 1774716329.0, 'created_time': 1773659758.358223, 'last_price_update_time': 1774706909.338882}
2026-03-28 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WH24419') HTTP/1.1" 204 0
2026-03-28 14:08:29 [auto1.es] INFO: Found listing with ID: YG93174
2026-03-28 14:08:29 [auto1.es] INFO: Found listing with ID: EH99000
2026-03-28 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH99000%27 HTTP/1.1" 200 None
2026-03-28 14:08:29 [auto1.es] INFO: Scrape type for EH99000: 0
2026-03-28 14:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:30 [auto1.es] INFO: Channel: 24h | Page: 22 | totalHits: 2696 | hits on page: 40
2026-03-28 14:08:30 [auto1.es] INFO: Found listing with ID: FX85730
2026-03-28 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX85730%27 HTTP/1.1" 200 None
2026-03-28 14:08:30 [auto1.es] INFO: Scrape type for FX85730: 0
2026-03-28 14:08:30 [auto1.es] INFO: Found listing with ID: TN34966
2026-03-28 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN34966%27 HTTP/1.1" 200 None
2026-03-28 14:08:30 [auto1.es] INFO: Scrape type for TN34966: 2
2026-03-28 14:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec7696a0-a849-5a91-8903-04c803103912 with identifier: TN34966
2026-03-28 14:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec7696a0-a849-5a91-8903-04c803103912 with scrape type 2
2026-03-28 14:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec7696a0-a849-5a91-8903-04c803103912 with scrape type 2
2026-03-28 14:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ec7696a0-a849-5a91-8903-04c803103912, identifier: TN34966
2026-03-28 14:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ec7696a0-a849-5a91-8903-04c803103912 with identifier: TN34966
2026-03-28 14:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ec7696a0-a849-5a91-8903-04c803103912 with identifier: TN34966
2026-03-28 14:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ec7696a0-a849-5a91-8903-04c803103912 with identifier: TN34966 to the API
2026-03-28 14:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:33:56Z',
 'fuel_type': 'diesel',
 'id': 'ec7696a0-a849-5a91-8903-04c803103912',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN34966',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 207391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-31',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-28 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN34966%27 HTTP/1.1" 200 None
2026-03-28 14:08:30 [auto1.es] INFO: Saving data for TN34966: {'auction_closing_time': 1774715636.0, 'created_time': 1774523208.027768, 'last_price_update_time': 1774706910.906402}
2026-03-28 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TN34966') HTTP/1.1" 204 0
2026-03-28 14:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: SH03418
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: EV20244
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: NA23399
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: DV59548
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: YG50456
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG50456%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for YG50456: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: TU21075
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU21075%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for TU21075: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: AV16131
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV16131%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for AV16131: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: JW81079
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: PS31871
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: BE63337
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: XJ28313
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ28313%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for XJ28313: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: FJ85779
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ85779%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for FJ85779: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: MJ22041
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: BV18028
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV18028%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for BV18028: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: HG47154
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: SN53081
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN53081%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for SN53081: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: RC21123
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC21123%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for RC21123: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: ZX16676
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: FZ38414
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: LH19294
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH19294%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for LH19294: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: XE96184
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE96184%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for XE96184: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: GY33906
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY33906%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for GY33906: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: HY73546
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY73546%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for HY73546: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: MK12831
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK12831%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for MK12831: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: WS59204
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS59204%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for WS59204: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: PT59425
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT59425%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for PT59425: 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: TX02408
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: YG37812
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG37812%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for YG37812: 2
2026-03-28 14:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ae868d6-6c9a-5535-a6b9-2cc2626f36c9 with identifier: YG37812
2026-03-28 14:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ae868d6-6c9a-5535-a6b9-2cc2626f36c9 with scrape type 2
2026-03-28 14:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ae868d6-6c9a-5535-a6b9-2cc2626f36c9 with scrape type 2
2026-03-28 14:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9ae868d6-6c9a-5535-a6b9-2cc2626f36c9, identifier: YG37812
2026-03-28 14:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9ae868d6-6c9a-5535-a6b9-2cc2626f36c9 with identifier: YG37812
2026-03-28 14:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9ae868d6-6c9a-5535-a6b9-2cc2626f36c9 with identifier: YG37812
2026-03-28 14:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9ae868d6-6c9a-5535-a6b9-2cc2626f36c9 with identifier: YG37812 to the API
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:28:30Z',
 'fuel_type': 'diesel',
 'id': '9ae868d6-6c9a-5535-a6b9-2cc2626f36c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG37812',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 317154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-29',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2013}
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG37812%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Saving data for YG37812: {'auction_closing_time': 1774715310.0, 'created_time': 1774523141.943049, 'last_price_update_time': 1774706911.777714}
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YG37812') HTTP/1.1" 204 0
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: DE32472
2026-03-28 14:08:31 [auto1.es] INFO: Found listing with ID: PJ49539
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ49539%27 HTTP/1.1" 200 None
2026-03-28 14:08:31 [auto1.es] INFO: Scrape type for PJ49539: 2
2026-03-28 14:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd4ed6aa-2855-5738-974a-8f13b3e21e9e with identifier: PJ49539
2026-03-28 14:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd4ed6aa-2855-5738-974a-8f13b3e21e9e with scrape type 2
2026-03-28 14:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd4ed6aa-2855-5738-974a-8f13b3e21e9e with scrape type 2
2026-03-28 14:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bd4ed6aa-2855-5738-974a-8f13b3e21e9e, identifier: PJ49539
2026-03-28 14:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bd4ed6aa-2855-5738-974a-8f13b3e21e9e with identifier: PJ49539
2026-03-28 14:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bd4ed6aa-2855-5738-974a-8f13b3e21e9e with identifier: PJ49539
2026-03-28 14:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bd4ed6aa-2855-5738-974a-8f13b3e21e9e with identifier: PJ49539 to the API
2026-03-28 14:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:40:54Z',
 'fuel_type': 'petrol',
 'id': 'bd4ed6aa-2855-5738-974a-8f13b3e21e9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ49539',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 77432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seller_name': None,
 'title': 'Dacia Dokker 1.3 TCe Essentiel',
 'transmission': 'manual',
 'trim': 'Essentiel',
 'year': 2020}
2026-03-28 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ49539%27 HTTP/1.1" 200 None
2026-03-28 14:08:32 [auto1.es] INFO: Saving data for PJ49539: {'auction_closing_time': 1774716054.0, 'created_time': 1774523152.866409, 'last_price_update_time': 1774706912.264803}
2026-03-28 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PJ49539') HTTP/1.1" 204 0
2026-03-28 14:08:32 [auto1.es] INFO: Found listing with ID: PP21573
2026-03-28 14:08:32 [auto1.es] INFO: Found listing with ID: RJ04030
2026-03-28 14:08:32 [auto1.es] INFO: Found listing with ID: LK18237
2026-03-28 14:08:32 [auto1.es] INFO: Found listing with ID: GS46060
2026-03-28 14:08:32 [auto1.es] INFO: Found listing with ID: JJ86148
2026-03-28 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ86148%27 HTTP/1.1" 200 None
2026-03-28 14:08:32 [auto1.es] INFO: Scrape type for JJ86148: 0
2026-03-28 14:08:32 [auto1.es] INFO: Found listing with ID: HW81498
2026-03-28 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW81498%27 HTTP/1.1" 200 None
2026-03-28 14:08:32 [auto1.es] INFO: Scrape type for HW81498: 0
2026-03-28 14:08:32 [auto1.es] INFO: Found listing with ID: JX49148
2026-03-28 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX49148%27 HTTP/1.1" 200 None
2026-03-28 14:08:32 [auto1.es] INFO: Scrape type for JX49148: 0
2026-03-28 14:08:32 [auto1.es] INFO: Found listing with ID: AF00025
2026-03-28 14:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:33 [auto1.es] INFO: Channel: 24h | Page: 23 | totalHits: 2697 | hits on page: 40
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: AF00025
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: NM59518
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM59518%27 HTTP/1.1" 200 None
2026-03-28 14:08:33 [auto1.es] INFO: Scrape type for NM59518: 0
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: RJ55423
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: TU32370
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU32370%27 HTTP/1.1" 200 None
2026-03-28 14:08:33 [auto1.es] INFO: Scrape type for TU32370: 0
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: RS43039
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: FF66391
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: TU27127
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: TU02735
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU02735%27 HTTP/1.1" 200 None
2026-03-28 14:08:33 [auto1.es] INFO: Scrape type for TU02735: 0
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: KT63961
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT63961%27 HTTP/1.1" 200 None
2026-03-28 14:08:33 [auto1.es] INFO: Scrape type for KT63961: 0
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: KG64326
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG64326%27 HTTP/1.1" 200 None
2026-03-28 14:08:33 [auto1.es] INFO: Scrape type for KG64326: 0
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: WV75018
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV75018%27 HTTP/1.1" 200 None
2026-03-28 14:08:33 [auto1.es] INFO: Scrape type for WV75018: 2
2026-03-28 14:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9937057-f2a5-5bf0-89be-eb63583b2597 with identifier: WV75018
2026-03-28 14:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9937057-f2a5-5bf0-89be-eb63583b2597 with scrape type 2
2026-03-28 14:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9937057-f2a5-5bf0-89be-eb63583b2597 with scrape type 2
2026-03-28 14:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9937057-f2a5-5bf0-89be-eb63583b2597, identifier: WV75018
2026-03-28 14:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9937057-f2a5-5bf0-89be-eb63583b2597 with identifier: WV75018
2026-03-28 14:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9937057-f2a5-5bf0-89be-eb63583b2597 with identifier: WV75018
2026-03-28 14:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f9937057-f2a5-5bf0-89be-eb63583b2597 with identifier: WV75018 to the API
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:58:41Z',
 'fuel_type': 'diesel',
 'id': 'f9937057-f2a5-5bf0-89be-eb63583b2597',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV75018',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 353438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-29',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV75018%27 HTTP/1.1" 200 None
2026-03-28 14:08:33 [auto1.es] INFO: Saving data for WV75018: {'auction_closing_time': 1774717121.0, 'created_time': 1774523205.261646, 'last_price_update_time': 1774706913.681059}
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WV75018') HTTP/1.1" 204 0
2026-03-28 14:08:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: XD33524
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: MH48496
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: TX48554
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX48554%27 HTTP/1.1" 200 None
2026-03-28 14:08:33 [auto1.es] INFO: Scrape type for TX48554: 0
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: DW56939
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW56939%27 HTTP/1.1" 200 None
2026-03-28 14:08:33 [auto1.es] INFO: Scrape type for DW56939: 0
2026-03-28 14:08:33 [auto1.es] INFO: Found listing with ID: WA73685
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA73685%27 HTTP/1.1" 200 None
2026-03-28 14:08:33 [auto1.es] INFO: Scrape type for WA73685: 2
2026-03-28 14:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 520ac7bb-c86c-5e51-8258-24fb5cda4aa3 with identifier: WA73685
2026-03-28 14:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520ac7bb-c86c-5e51-8258-24fb5cda4aa3 with scrape type 2
2026-03-28 14:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 520ac7bb-c86c-5e51-8258-24fb5cda4aa3 with scrape type 2
2026-03-28 14:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 520ac7bb-c86c-5e51-8258-24fb5cda4aa3, identifier: WA73685
2026-03-28 14:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 520ac7bb-c86c-5e51-8258-24fb5cda4aa3 with identifier: WA73685
2026-03-28 14:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 520ac7bb-c86c-5e51-8258-24fb5cda4aa3 with identifier: WA73685
2026-03-28 14:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 520ac7bb-c86c-5e51-8258-24fb5cda4aa3 with identifier: WA73685 to the API
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:43Z',
 'fuel_type': 'petrol',
 'id': '520ac7bb-c86c-5e51-8258-24fb5cda4aa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA73685',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 89879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-10',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 PureTech Feel Business',
 'transmission': 'manual',
 'trim': 'Feel Business',
 'year': 2016}
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA73685%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Saving data for WA73685: {'auction_closing_time': 1774713883.0, 'created_time': 1773864661.795086, 'last_price_update_time': 1774706914.242483}
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WA73685') HTTP/1.1" 204 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: AG21540
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG21540%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for AG21540: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: RE29588
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE29588%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for RE29588: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: KG74250
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG74250%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for KG74250: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: XV71103
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV71103%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for XV71103: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: ZG15911
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: ZL22233
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: WL57224
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: SA46382
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: HS16028
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS16028%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for HS16028: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: AK39798
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK39798%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for AK39798: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: GA00375
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: ER64575
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: PD85443
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD85443%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for PD85443: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: FR28511
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR28511%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for FR28511: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: CK41460
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CK41460%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for CK41460: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: BC07750
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC07750%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for BC07750: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: YR87797
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR87797%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for YR87797: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: NN09509
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: US86710
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: AS83743
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS83743%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for AS83743: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: ML55356
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML55356%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for ML55356: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: FG99809
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: WY05538
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY05538%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for WY05538: 0
2026-03-28 14:08:34 [auto1.es] INFO: Found listing with ID: FF26714
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF26714%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Scrape type for FF26714: 2
2026-03-28 14:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a44aa5-2b39-5b40-9ebf-8900b90ded2d with identifier: FF26714
2026-03-28 14:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a44aa5-2b39-5b40-9ebf-8900b90ded2d with scrape type 2
2026-03-28 14:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a44aa5-2b39-5b40-9ebf-8900b90ded2d with scrape type 2
2026-03-28 14:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 96a44aa5-2b39-5b40-9ebf-8900b90ded2d, identifier: FF26714
2026-03-28 14:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 96a44aa5-2b39-5b40-9ebf-8900b90ded2d with identifier: FF26714
2026-03-28 14:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 96a44aa5-2b39-5b40-9ebf-8900b90ded2d with identifier: FF26714
2026-03-28 14:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 96a44aa5-2b39-5b40-9ebf-8900b90ded2d with identifier: FF26714 to the API
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:38:59Z',
 'fuel_type': 'petrol',
 'id': '96a44aa5-2b39-5b40-9ebf-8900b90ded2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF26714',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 144939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-20',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF26714%27 HTTP/1.1" 200 None
2026-03-28 14:08:34 [auto1.es] INFO: Saving data for FF26714: {'auction_closing_time': 1774715939.0, 'created_time': 1774523122.441046, 'last_price_update_time': 1774706914.950596}
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FF26714') HTTP/1.1" 204 0
2026-03-28 14:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:46 [auto1.es] INFO: Channel: 24h | Page: 24 | totalHits: 2697 | hits on page: 40
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: JB16763
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: KY38332
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY38332%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for KY38332: 0
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: MN54657
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN54657%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for MN54657: 0
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: MV29713
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV29713%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for MV29713: 0
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: FL07647
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL07647%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for FL07647: 0
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: ZJ56625
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: XB50501
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB50501%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for XB50501: 0
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: XH86580
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: RM85615
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: AG32524
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: WF53807
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: US15459
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: KE50509
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: NX73421
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX73421%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for NX73421: 0
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: YY12745
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY12745%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for YY12745: 0
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: LD17478
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD17478%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for LD17478: 0
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: FH07549
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH07549%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for FH07549: 0
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: PF82044
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF82044%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for PF82044: 0
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: BY63311
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY63311%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for BY63311: 0
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: DR60635
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: CY33639
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY33639%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for CY33639: 0
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: YH86623
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: LH99658
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH99658%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for LH99658: 2
2026-03-28 14:08:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5698eaf7-6563-588c-b9a1-5063e94913f9 with identifier: LH99658
2026-03-28 14:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5698eaf7-6563-588c-b9a1-5063e94913f9 with scrape type 2
2026-03-28 14:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5698eaf7-6563-588c-b9a1-5063e94913f9 with scrape type 2
2026-03-28 14:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5698eaf7-6563-588c-b9a1-5063e94913f9, identifier: LH99658
2026-03-28 14:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5698eaf7-6563-588c-b9a1-5063e94913f9 with identifier: LH99658
2026-03-28 14:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5698eaf7-6563-588c-b9a1-5063e94913f9 with identifier: LH99658
2026-03-28 14:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5698eaf7-6563-588c-b9a1-5063e94913f9 with identifier: LH99658 to the API
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:17:11Z',
 'fuel_type': 'diesel',
 'id': '5698eaf7-6563-588c-b9a1-5063e94913f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH99658',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 231342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-05-31',
 'seller_name': None,
 'title': 'Audi A4 1.9 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH99658%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Saving data for LH99658: {'auction_closing_time': 1774714631.0, 'created_time': 1774425955.224507, 'last_price_update_time': 1774706926.810379}
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LH99658') HTTP/1.1" 204 0
2026-03-28 14:08:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:46 [auto1.es] INFO: Found listing with ID: PD45625
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD45625%27 HTTP/1.1" 200 None
2026-03-28 14:08:46 [auto1.es] INFO: Scrape type for PD45625: 2
2026-03-28 14:08:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26a2db87-5af6-563a-bfd9-dcc2fb360fb5 with identifier: PD45625
2026-03-28 14:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26a2db87-5af6-563a-bfd9-dcc2fb360fb5 with scrape type 2
2026-03-28 14:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26a2db87-5af6-563a-bfd9-dcc2fb360fb5 with scrape type 2
2026-03-28 14:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 26a2db87-5af6-563a-bfd9-dcc2fb360fb5, identifier: PD45625
2026-03-28 14:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 26a2db87-5af6-563a-bfd9-dcc2fb360fb5 with identifier: PD45625
2026-03-28 14:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 26a2db87-5af6-563a-bfd9-dcc2fb360fb5 with identifier: PD45625
2026-03-28 14:08:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 26a2db87-5af6-563a-bfd9-dcc2fb360fb5 with identifier: PD45625 to the API
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:03Z',
 'fuel_type': 'diesel',
 'id': '26a2db87-5af6-563a-bfd9-dcc2fb360fb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD45625',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 193458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-27',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2014}
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD45625%27 HTTP/1.1" 200 None
2026-03-28 14:08:47 [auto1.es] INFO: Saving data for PD45625: {'auction_closing_time': 1774714383.0, 'created_time': 1773127428.846812, 'last_price_update_time': 1774706927.381914}
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PD45625') HTTP/1.1" 204 0
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: GD38057
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD38057%27 HTTP/1.1" 200 None
2026-03-28 14:08:47 [auto1.es] INFO: Scrape type for GD38057: 0
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: RK74623
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK74623%27 HTTP/1.1" 200 None
2026-03-28 14:08:47 [auto1.es] INFO: Scrape type for RK74623: 0
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: PT78708
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT78708%27 HTTP/1.1" 200 None
2026-03-28 14:08:47 [auto1.es] INFO: Scrape type for PT78708: 0
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: WF38269
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: SP90051
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP90051%27 HTTP/1.1" 200 None
2026-03-28 14:08:47 [auto1.es] INFO: Scrape type for SP90051: 0
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: ZT52456
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT52456%27 HTTP/1.1" 200 None
2026-03-28 14:08:47 [auto1.es] INFO: Scrape type for ZT52456: 0
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: YP26589
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP26589%27 HTTP/1.1" 200 None
2026-03-28 14:08:47 [auto1.es] INFO: Scrape type for YP26589: 0
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: BM87438
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: LD07198
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: RB88414
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: RD88147
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD88147%27 HTTP/1.1" 200 None
2026-03-28 14:08:47 [auto1.es] INFO: Scrape type for RD88147: 0
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: NF50225
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF50225%27 HTTP/1.1" 200 None
2026-03-28 14:08:47 [auto1.es] INFO: Scrape type for NF50225: 0
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: HK38908
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: BF57593
2026-03-28 14:08:47 [auto1.es] INFO: Found listing with ID: DL26730
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL26730%27 HTTP/1.1" 200 None
2026-03-28 14:08:47 [auto1.es] INFO: Scrape type for DL26730: 2
2026-03-28 14:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 180b90b5-8f56-548a-8c29-146f3091fedc with identifier: DL26730
2026-03-28 14:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 180b90b5-8f56-548a-8c29-146f3091fedc with scrape type 2
2026-03-28 14:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 180b90b5-8f56-548a-8c29-146f3091fedc with scrape type 2
2026-03-28 14:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 180b90b5-8f56-548a-8c29-146f3091fedc, identifier: DL26730
2026-03-28 14:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 180b90b5-8f56-548a-8c29-146f3091fedc with identifier: DL26730
2026-03-28 14:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 180b90b5-8f56-548a-8c29-146f3091fedc with identifier: DL26730
2026-03-28 14:08:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 180b90b5-8f56-548a-8c29-146f3091fedc with identifier: DL26730 to the API
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:26:11Z',
 'fuel_type': 'petrol',
 'id': '180b90b5-8f56-548a-8c29-146f3091fedc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL26730',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 44022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-21',
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL26730%27 HTTP/1.1" 200 None
2026-03-28 14:08:48 [auto1.es] INFO: Saving data for DL26730: {'auction_closing_time': 1774715171.0, 'created_time': 1774425956.412278, 'last_price_update_time': 1774706928.01336}
2026-03-28 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DL26730') HTTP/1.1" 204 0
2026-03-28 14:08:48 [auto1.es] INFO: Found listing with ID: JR29098
2026-03-28 14:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:49 [auto1.es] INFO: Channel: 24h | Page: 25 | totalHits: 2697 | hits on page: 40
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: JB62304
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB62304%27 HTTP/1.1" 200 None
2026-03-28 14:08:49 [auto1.es] INFO: Scrape type for JB62304: 0
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: SP20451
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP20451%27 HTTP/1.1" 200 None
2026-03-28 14:08:49 [auto1.es] INFO: Scrape type for SP20451: 0
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: YE50848
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE50848%27 HTTP/1.1" 200 None
2026-03-28 14:08:49 [auto1.es] INFO: Scrape type for YE50848: 0
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: VG19882
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: YK51395
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK51395%27 HTTP/1.1" 200 None
2026-03-28 14:08:49 [auto1.es] INFO: Scrape type for YK51395: 0
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: AG66489
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG66489%27 HTTP/1.1" 200 None
2026-03-28 14:08:49 [auto1.es] INFO: Scrape type for AG66489: 2
2026-03-28 14:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e352ed36-4f93-5d70-8e49-e4db2a7e780f with identifier: AG66489
2026-03-28 14:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e352ed36-4f93-5d70-8e49-e4db2a7e780f with scrape type 2
2026-03-28 14:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e352ed36-4f93-5d70-8e49-e4db2a7e780f with scrape type 2
2026-03-28 14:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e352ed36-4f93-5d70-8e49-e4db2a7e780f, identifier: AG66489
2026-03-28 14:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e352ed36-4f93-5d70-8e49-e4db2a7e780f with identifier: AG66489
2026-03-28 14:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e352ed36-4f93-5d70-8e49-e4db2a7e780f with identifier: AG66489
2026-03-28 14:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e352ed36-4f93-5d70-8e49-e4db2a7e780f with identifier: AG66489 to the API
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:36:44Z',
 'fuel_type': 'diesel',
 'id': 'e352ed36-4f93-5d70-8e49-e4db2a7e780f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG66489',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 218429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-02-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2001}
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG66489%27 HTTP/1.1" 200 None
2026-03-28 14:08:49 [auto1.es] INFO: Saving data for AG66489: {'auction_closing_time': 1774715804.0, 'created_time': 1774523198.304538, 'last_price_update_time': 1774706929.855895}
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AG66489') HTTP/1.1" 204 0
2026-03-28 14:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: HY26691
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY26691%27 HTTP/1.1" 200 None
2026-03-28 14:08:49 [auto1.es] INFO: Scrape type for HY26691: 0
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: XB87201
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: BX65620
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: BF21105
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: HT23405
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT23405%27 HTTP/1.1" 200 None
2026-03-28 14:08:49 [auto1.es] INFO: Scrape type for HT23405: 0
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: ST42885
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST42885%27 HTTP/1.1" 200 None
2026-03-28 14:08:49 [auto1.es] INFO: Scrape type for ST42885: 0
2026-03-28 14:08:49 [auto1.es] INFO: Found listing with ID: GF99536
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF99536%27 HTTP/1.1" 200 None
2026-03-28 14:08:49 [auto1.es] INFO: Scrape type for GF99536: 2
2026-03-28 14:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9502ecd-840c-57bf-a157-4532dad6945b with identifier: GF99536
2026-03-28 14:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9502ecd-840c-57bf-a157-4532dad6945b with scrape type 2
2026-03-28 14:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9502ecd-840c-57bf-a157-4532dad6945b with scrape type 2
2026-03-28 14:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a9502ecd-840c-57bf-a157-4532dad6945b, identifier: GF99536
2026-03-28 14:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a9502ecd-840c-57bf-a157-4532dad6945b with identifier: GF99536
2026-03-28 14:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a9502ecd-840c-57bf-a157-4532dad6945b with identifier: GF99536
2026-03-28 14:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a9502ecd-840c-57bf-a157-4532dad6945b with identifier: GF99536 to the API
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:45:23Z',
 'fuel_type': 'diesel',
 'id': 'a9502ecd-840c-57bf-a157-4532dad6945b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF99536',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 231087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF99536%27 HTTP/1.1" 200 None
2026-03-28 14:08:50 [auto1.es] INFO: Saving data for GF99536: {'auction_closing_time': 1774716323.0, 'created_time': 1774523178.057511, 'last_price_update_time': 1774706930.336734}
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GF99536') HTTP/1.1" 204 0
2026-03-28 14:08:50 [auto1.es] INFO: Found listing with ID: UJ65320
2026-03-28 14:08:50 [auto1.es] INFO: Found listing with ID: RU65769
2026-03-28 14:08:50 [auto1.es] INFO: Found listing with ID: WW31091
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW31091%27 HTTP/1.1" 200 None
2026-03-28 14:08:50 [auto1.es] INFO: Scrape type for WW31091: 0
2026-03-28 14:08:50 [auto1.es] INFO: Found listing with ID: PT77544
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT77544%27 HTTP/1.1" 200 None
2026-03-28 14:08:50 [auto1.es] INFO: Scrape type for PT77544: 0
2026-03-28 14:08:50 [auto1.es] INFO: Found listing with ID: YG72070
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG72070%27 HTTP/1.1" 200 None
2026-03-28 14:08:50 [auto1.es] INFO: Scrape type for YG72070: 0
2026-03-28 14:08:50 [auto1.es] INFO: Found listing with ID: MM73463
2026-03-28 14:08:50 [auto1.es] INFO: Found listing with ID: ZD58886
2026-03-28 14:08:50 [auto1.es] INFO: Found listing with ID: BX60688
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX60688%27 HTTP/1.1" 200 None
2026-03-28 14:08:50 [auto1.es] INFO: Scrape type for BX60688: 2
2026-03-28 14:08:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2185dfa-f1b7-5768-928f-0671108319ed with identifier: BX60688
2026-03-28 14:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2185dfa-f1b7-5768-928f-0671108319ed with scrape type 2
2026-03-28 14:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2185dfa-f1b7-5768-928f-0671108319ed with scrape type 2
2026-03-28 14:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d2185dfa-f1b7-5768-928f-0671108319ed, identifier: BX60688
2026-03-28 14:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d2185dfa-f1b7-5768-928f-0671108319ed with identifier: BX60688
2026-03-28 14:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d2185dfa-f1b7-5768-928f-0671108319ed with identifier: BX60688
2026-03-28 14:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d2185dfa-f1b7-5768-928f-0671108319ed with identifier: BX60688 to the API
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:56:32Z',
 'fuel_type': 'diesel',
 'id': 'd2185dfa-f1b7-5768-928f-0671108319ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX60688',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 312115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-15',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 270 CDI Final Edition',
 'transmission': 'automatic',
 'trim': 'Final Edition',
 'year': 2004}
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX60688%27 HTTP/1.1" 200 None
2026-03-28 14:08:50 [auto1.es] INFO: Saving data for BX60688: {'auction_closing_time': 1774716992.0, 'created_time': 1774101959.468748, 'last_price_update_time': 1774706930.957312}
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BX60688') HTTP/1.1" 204 0
2026-03-28 14:08:50 [auto1.es] INFO: Found listing with ID: DW27035
2026-03-28 14:08:50 [auto1.es] INFO: Found listing with ID: EB96855
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB96855%27 HTTP/1.1" 200 None
2026-03-28 14:08:50 [auto1.es] INFO: Scrape type for EB96855: 0
2026-03-28 14:08:50 [auto1.es] INFO: Found listing with ID: XJ69303
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ69303%27 HTTP/1.1" 200 None
2026-03-28 14:08:51 [auto1.es] INFO: Scrape type for XJ69303: 0
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: UY47592
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: HH46764
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH46764%27 HTTP/1.1" 200 None
2026-03-28 14:08:51 [auto1.es] INFO: Scrape type for HH46764: 0
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: YB94347
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB94347%27 HTTP/1.1" 200 None
2026-03-28 14:08:51 [auto1.es] INFO: Scrape type for YB94347: 2
2026-03-28 14:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46f4e673-ed70-5d49-8e8c-8af3e9d1749a with identifier: YB94347
2026-03-28 14:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46f4e673-ed70-5d49-8e8c-8af3e9d1749a with scrape type 2
2026-03-28 14:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46f4e673-ed70-5d49-8e8c-8af3e9d1749a with scrape type 2
2026-03-28 14:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 46f4e673-ed70-5d49-8e8c-8af3e9d1749a, identifier: YB94347
2026-03-28 14:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 46f4e673-ed70-5d49-8e8c-8af3e9d1749a with identifier: YB94347
2026-03-28 14:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 46f4e673-ed70-5d49-8e8c-8af3e9d1749a with identifier: YB94347
2026-03-28 14:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 46f4e673-ed70-5d49-8e8c-8af3e9d1749a with identifier: YB94347 to the API
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:23:39Z',
 'fuel_type': 'diesel',
 'id': '46f4e673-ed70-5d49-8e8c-8af3e9d1749a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB94347',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 220694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-29',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB94347%27 HTTP/1.1" 200 None
2026-03-28 14:08:51 [auto1.es] INFO: Saving data for YB94347: {'auction_closing_time': 1774715019.0, 'created_time': 1774523200.888313, 'last_price_update_time': 1774706931.459911}
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YB94347') HTTP/1.1" 204 0
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: NZ09379
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: XY25635
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY25635%27 HTTP/1.1" 200 None
2026-03-28 14:08:51 [auto1.es] INFO: Scrape type for XY25635: 0
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: MN96118
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: SL72652
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: JP30275
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP30275%27 HTTP/1.1" 200 None
2026-03-28 14:08:51 [auto1.es] INFO: Scrape type for JP30275: 0
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: BW95892
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: HX96572
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: JX80621
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: SF77258
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF77258%27 HTTP/1.1" 200 None
2026-03-28 14:08:51 [auto1.es] INFO: Scrape type for SF77258: 0
2026-03-28 14:08:51 [auto1.es] INFO: Found listing with ID: XR92407
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR92407%27 HTTP/1.1" 200 None
2026-03-28 14:08:51 [auto1.es] INFO: Scrape type for XR92407: 2
2026-03-28 14:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a1ebb5c-8fb4-5ca5-ac13-84e6da87d6bb with identifier: XR92407
2026-03-28 14:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a1ebb5c-8fb4-5ca5-ac13-84e6da87d6bb with scrape type 2
2026-03-28 14:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a1ebb5c-8fb4-5ca5-ac13-84e6da87d6bb with scrape type 2
2026-03-28 14:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2a1ebb5c-8fb4-5ca5-ac13-84e6da87d6bb, identifier: XR92407
2026-03-28 14:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2a1ebb5c-8fb4-5ca5-ac13-84e6da87d6bb with identifier: XR92407
2026-03-28 14:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2a1ebb5c-8fb4-5ca5-ac13-84e6da87d6bb with identifier: XR92407
2026-03-28 14:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2a1ebb5c-8fb4-5ca5-ac13-84e6da87d6bb with identifier: XR92407 to the API
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:25:30Z',
 'fuel_type': 'diesel',
 'id': '2a1ebb5c-8fb4-5ca5-ac13-84e6da87d6bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR92407',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 151455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-12',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2014}
2026-03-28 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR92407%27 HTTP/1.1" 200 None
2026-03-28 14:08:52 [auto1.es] INFO: Saving data for XR92407: {'auction_closing_time': 1774715130.0, 'created_time': 1773130338.249671, 'last_price_update_time': 1774706932.088808}
2026-03-28 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XR92407') HTTP/1.1" 204 0
2026-03-28 14:08:52 [auto1.es] INFO: Found listing with ID: NT36194
2026-03-28 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT36194%27 HTTP/1.1" 200 None
2026-03-28 14:08:52 [auto1.es] INFO: Scrape type for NT36194: 0
2026-03-28 14:08:52 [auto1.es] INFO: Found listing with ID: PU11377
2026-03-28 14:08:52 [auto1.es] INFO: Found listing with ID: PC22199
2026-03-28 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC22199%27 HTTP/1.1" 200 None
2026-03-28 14:08:52 [auto1.es] INFO: Scrape type for PC22199: 0
2026-03-28 14:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:52 [auto1.es] INFO: Channel: 24h | Page: 26 | totalHits: 2697 | hits on page: 40
2026-03-28 14:08:52 [auto1.es] INFO: Found listing with ID: AG75766
2026-03-28 14:08:52 [auto1.es] INFO: Found listing with ID: XY83185
2026-03-28 14:08:52 [auto1.es] INFO: Found listing with ID: MW26851
2026-03-28 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW26851%27 HTTP/1.1" 200 None
2026-03-28 14:08:52 [auto1.es] INFO: Scrape type for MW26851: 0
2026-03-28 14:08:52 [auto1.es] INFO: Found listing with ID: ML17412
2026-03-28 14:08:52 [auto1.es] INFO: Found listing with ID: BZ29136
2026-03-28 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ29136%27 HTTP/1.1" 200 None
2026-03-28 14:08:52 [auto1.es] INFO: Scrape type for BZ29136: 0
2026-03-28 14:08:52 [auto1.es] INFO: Found listing with ID: BU72892
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU72892%27 HTTP/1.1" 200 None
2026-03-28 14:08:53 [auto1.es] INFO: Scrape type for BU72892: 0
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: AB84528
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: RC36042
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: MK04112
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: JX17367
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX17367%27 HTTP/1.1" 200 None
2026-03-28 14:08:53 [auto1.es] INFO: Scrape type for JX17367: 0
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: KM36431
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM36431%27 HTTP/1.1" 200 None
2026-03-28 14:08:53 [auto1.es] INFO: Scrape type for KM36431: 2
2026-03-28 14:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 447a6d5a-0d0e-53b1-a63e-c87505cc09c9 with identifier: KM36431
2026-03-28 14:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 447a6d5a-0d0e-53b1-a63e-c87505cc09c9 with scrape type 2
2026-03-28 14:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 447a6d5a-0d0e-53b1-a63e-c87505cc09c9 with scrape type 2
2026-03-28 14:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 447a6d5a-0d0e-53b1-a63e-c87505cc09c9, identifier: KM36431
2026-03-28 14:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 447a6d5a-0d0e-53b1-a63e-c87505cc09c9 with identifier: KM36431
2026-03-28 14:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 447a6d5a-0d0e-53b1-a63e-c87505cc09c9 with identifier: KM36431
2026-03-28 14:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 447a6d5a-0d0e-53b1-a63e-c87505cc09c9 with identifier: KM36431 to the API
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:04:46Z',
 'fuel_type': 'diesel',
 'id': '447a6d5a-0d0e-53b1-a63e-c87505cc09c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM36431',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 148047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-28',
 'seller_name': None,
 'title': 'Renault Laguna 2.0 dCi GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2012}
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM36431%27 HTTP/1.1" 200 None
2026-03-28 14:08:53 [auto1.es] INFO: Saving data for KM36431: {'auction_closing_time': 1774713886.0, 'created_time': 1774436792.186163, 'last_price_update_time': 1774706933.478296}
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KM36431') HTTP/1.1" 204 0
2026-03-28 14:08:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: WC35260
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: PX21457
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: ZF10967
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF10967%27 HTTP/1.1" 200 None
2026-03-28 14:08:53 [auto1.es] INFO: Scrape type for ZF10967: 0
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: JK64156
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK64156%27 HTTP/1.1" 200 None
2026-03-28 14:08:53 [auto1.es] INFO: Scrape type for JK64156: 0
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: RW45199
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: BA78017
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: WT17927
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: JM88117
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: NL01564
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: GG08550
2026-03-28 14:08:53 [auto1.es] INFO: Found listing with ID: VJ61689
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ61689%27 HTTP/1.1" 200 None
2026-03-28 14:08:53 [auto1.es] INFO: Scrape type for VJ61689: 2
2026-03-28 14:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d597efec-448d-56c3-a86f-a6c8f8e2ce76 with identifier: VJ61689
2026-03-28 14:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d597efec-448d-56c3-a86f-a6c8f8e2ce76 with scrape type 2
2026-03-28 14:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d597efec-448d-56c3-a86f-a6c8f8e2ce76 with scrape type 2
2026-03-28 14:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d597efec-448d-56c3-a86f-a6c8f8e2ce76, identifier: VJ61689
2026-03-28 14:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d597efec-448d-56c3-a86f-a6c8f8e2ce76 with identifier: VJ61689
2026-03-28 14:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d597efec-448d-56c3-a86f-a6c8f8e2ce76 with identifier: VJ61689
2026-03-28 14:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d597efec-448d-56c3-a86f-a6c8f8e2ce76 with identifier: VJ61689 to the API
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:55:12Z',
 'fuel_type': 'petrol',
 'id': 'd597efec-448d-56c3-a86f-a6c8f8e2ce76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ61689',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 17339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-30',
 'seller_name': None,
 'title': 'BMW 1er 118i Edition M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'Edition M Sport Shadow',
 'year': 2019}
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ61689%27 HTTP/1.1" 200 None
2026-03-28 14:08:54 [auto1.es] INFO: Saving data for VJ61689: {'auction_closing_time': 1774716912.0, 'created_time': 1773918446.655448, 'last_price_update_time': 1774706934.045076}
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VJ61689') HTTP/1.1" 204 0
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: MA92923
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: MG47386
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: UD80780
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: BF82327
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: MH30055
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH30055%27 HTTP/1.1" 200 None
2026-03-28 14:08:54 [auto1.es] INFO: Scrape type for MH30055: 0
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: CE45579
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: KS98335
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: YL06778
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL06778%27 HTTP/1.1" 200 None
2026-03-28 14:08:54 [auto1.es] INFO: Scrape type for YL06778: 0
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: SK01159
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK01159%27 HTTP/1.1" 200 None
2026-03-28 14:08:54 [auto1.es] INFO: Scrape type for SK01159: 0
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: SS95298
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: PZ99435
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ99435%27 HTTP/1.1" 200 None
2026-03-28 14:08:54 [auto1.es] INFO: Scrape type for PZ99435: 0
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: AA63946
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA63946%27 HTTP/1.1" 200 None
2026-03-28 14:08:54 [auto1.es] INFO: Scrape type for AA63946: 0
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: LL40861
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: YL34665
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL34665%27 HTTP/1.1" 200 None
2026-03-28 14:08:54 [auto1.es] INFO: Scrape type for YL34665: 0
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: VJ44998
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: XX41183
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX41183%27 HTTP/1.1" 200 None
2026-03-28 14:08:54 [auto1.es] INFO: Scrape type for XX41183: 0
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: YH27551
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH27551%27 HTTP/1.1" 200 None
2026-03-28 14:08:54 [auto1.es] INFO: Scrape type for YH27551: 2
2026-03-28 14:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b695171-964d-5c99-9b2b-7b0e3068aa07 with identifier: YH27551
2026-03-28 14:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b695171-964d-5c99-9b2b-7b0e3068aa07 with scrape type 2
2026-03-28 14:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b695171-964d-5c99-9b2b-7b0e3068aa07 with scrape type 2
2026-03-28 14:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5b695171-964d-5c99-9b2b-7b0e3068aa07, identifier: YH27551
2026-03-28 14:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5b695171-964d-5c99-9b2b-7b0e3068aa07 with identifier: YH27551
2026-03-28 14:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5b695171-964d-5c99-9b2b-7b0e3068aa07 with identifier: YH27551
2026-03-28 14:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5b695171-964d-5c99-9b2b-7b0e3068aa07 with identifier: YH27551 to the API
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:44:04Z',
 'fuel_type': 'diesel',
 'id': '5b695171-964d-5c99-9b2b-7b0e3068aa07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH27551',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 207309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-06',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi GT Line Essential 2WD',
 'transmission': 'automatic',
 'trim': 'GT Line Essential 2WD',
 'year': 2018}
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH27551%27 HTTP/1.1" 200 None
2026-03-28 14:08:54 [auto1.es] INFO: Saving data for YH27551: {'auction_closing_time': 1774716244.0, 'created_time': 1774523173.436151, 'last_price_update_time': 1774706934.716925}
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YH27551') HTTP/1.1" 204 0
2026-03-28 14:08:54 [auto1.es] INFO: Found listing with ID: SE78782
2026-03-28 14:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:08:55 [auto1.es] INFO: Channel: 24h | Page: 27 | totalHits: 2697 | hits on page: 40
2026-03-28 14:08:55 [auto1.es] INFO: Found listing with ID: RR55958
2026-03-28 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR55958%27 HTTP/1.1" 200 None
2026-03-28 14:08:55 [auto1.es] INFO: Scrape type for RR55958: 0
2026-03-28 14:08:55 [auto1.es] INFO: Found listing with ID: PD17011
2026-03-28 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD17011%27 HTTP/1.1" 200 None
2026-03-28 14:08:55 [auto1.es] INFO: Scrape type for PD17011: 2
2026-03-28 14:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e8d2779-d48a-5306-8410-1d6322f7dbac with identifier: PD17011
2026-03-28 14:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e8d2779-d48a-5306-8410-1d6322f7dbac with scrape type 2
2026-03-28 14:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e8d2779-d48a-5306-8410-1d6322f7dbac with scrape type 2
2026-03-28 14:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0e8d2779-d48a-5306-8410-1d6322f7dbac, identifier: PD17011
2026-03-28 14:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0e8d2779-d48a-5306-8410-1d6322f7dbac with identifier: PD17011
2026-03-28 14:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0e8d2779-d48a-5306-8410-1d6322f7dbac with identifier: PD17011
2026-03-28 14:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0e8d2779-d48a-5306-8410-1d6322f7dbac with identifier: PD17011 to the API
2026-03-28 14:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:45:20Z',
 'fuel_type': 'petrol',
 'id': '0e8d2779-d48a-5306-8410-1d6322f7dbac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD17011',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 45018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-23',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-28 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD17011%27 HTTP/1.1" 200 None
2026-03-28 14:08:55 [auto1.es] INFO: Saving data for PD17011: {'auction_closing_time': 1774716320.0, 'created_time': 1774523164.046228, 'last_price_update_time': 1774706935.933994}
2026-03-28 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PD17011') HTTP/1.1" 204 0
2026-03-28 14:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:08:55 [auto1.es] INFO: Found listing with ID: EA52375
2026-03-28 14:08:55 [auto1.es] INFO: Found listing with ID: GG28459
2026-03-28 14:08:55 [auto1.es] INFO: Found listing with ID: HK75942
2026-03-28 14:08:55 [auto1.es] INFO: Found listing with ID: CZ94183
2026-03-28 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ94183%27 HTTP/1.1" 200 None
2026-03-28 14:08:55 [auto1.es] INFO: Scrape type for CZ94183: 2
2026-03-28 14:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92a98ef9-a829-512f-a7bf-bf6646d24117 with identifier: CZ94183
2026-03-28 14:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92a98ef9-a829-512f-a7bf-bf6646d24117 with scrape type 2
2026-03-28 14:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92a98ef9-a829-512f-a7bf-bf6646d24117 with scrape type 2
2026-03-28 14:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92a98ef9-a829-512f-a7bf-bf6646d24117, identifier: CZ94183
2026-03-28 14:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92a98ef9-a829-512f-a7bf-bf6646d24117 with identifier: CZ94183
2026-03-28 14:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92a98ef9-a829-512f-a7bf-bf6646d24117 with identifier: CZ94183
2026-03-28 14:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92a98ef9-a829-512f-a7bf-bf6646d24117 with identifier: CZ94183 to the API
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:33:37Z',
 'fuel_type': 'petrol',
 'id': '92a98ef9-a829-512f-a7bf-bf6646d24117',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ94183',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 44748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ94183%27 HTTP/1.1" 200 None
2026-03-28 14:08:56 [auto1.es] INFO: Saving data for CZ94183: {'auction_closing_time': 1774715617.0, 'created_time': 1774523123.888612, 'last_price_update_time': 1774706936.363117}
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CZ94183') HTTP/1.1" 204 0
2026-03-28 14:08:56 [auto1.es] INFO: Found listing with ID: ZA55994
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA55994%27 HTTP/1.1" 200 None
2026-03-28 14:08:56 [auto1.es] INFO: Scrape type for ZA55994: 0
2026-03-28 14:08:56 [auto1.es] INFO: Found listing with ID: PC51622
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC51622%27 HTTP/1.1" 200 None
2026-03-28 14:08:56 [auto1.es] INFO: Scrape type for PC51622: 0
2026-03-28 14:08:56 [auto1.es] INFO: Found listing with ID: SN64789
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN64789%27 HTTP/1.1" 200 None
2026-03-28 14:08:56 [auto1.es] INFO: Scrape type for SN64789: 0
2026-03-28 14:08:56 [auto1.es] INFO: Found listing with ID: HK12855
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK12855%27 HTTP/1.1" 200 None
2026-03-28 14:08:56 [auto1.es] INFO: Scrape type for HK12855: 0
2026-03-28 14:08:56 [auto1.es] INFO: Found listing with ID: JH04975
2026-03-28 14:08:56 [auto1.es] INFO: Found listing with ID: EN87990
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN87990%27 HTTP/1.1" 200 None
2026-03-28 14:08:56 [auto1.es] INFO: Scrape type for EN87990: 0
2026-03-28 14:08:56 [auto1.es] INFO: Found listing with ID: XH57732
2026-03-28 14:08:56 [auto1.es] INFO: Found listing with ID: AK39366
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK39366%27 HTTP/1.1" 200 None
2026-03-28 14:08:56 [auto1.es] INFO: Scrape type for AK39366: 0
2026-03-28 14:08:56 [auto1.es] INFO: Found listing with ID: KH58468
2026-03-28 14:08:56 [auto1.es] INFO: Found listing with ID: MG44284
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG44284%27 HTTP/1.1" 200 None
2026-03-28 14:08:56 [auto1.es] INFO: Scrape type for MG44284: 2
2026-03-28 14:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a98d20e-6eb8-51ff-a217-d4fa586c0c42 with identifier: MG44284
2026-03-28 14:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a98d20e-6eb8-51ff-a217-d4fa586c0c42 with scrape type 2
2026-03-28 14:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a98d20e-6eb8-51ff-a217-d4fa586c0c42 with scrape type 2
2026-03-28 14:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6a98d20e-6eb8-51ff-a217-d4fa586c0c42, identifier: MG44284
2026-03-28 14:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6a98d20e-6eb8-51ff-a217-d4fa586c0c42 with identifier: MG44284
2026-03-28 14:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6a98d20e-6eb8-51ff-a217-d4fa586c0c42 with identifier: MG44284
2026-03-28 14:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6a98d20e-6eb8-51ff-a217-d4fa586c0c42 with identifier: MG44284 to the API
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:36:12Z',
 'fuel_type': 'petrol',
 'id': '6a98d20e-6eb8-51ff-a217-d4fa586c0c42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG44284',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 74673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-27',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG44284%27 HTTP/1.1" 200 None
2026-03-28 14:08:56 [auto1.es] INFO: Saving data for MG44284: {'auction_closing_time': 1774715772.0, 'created_time': 1774523191.558727, 'last_price_update_time': 1774706936.918365}
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MG44284') HTTP/1.1" 204 0
2026-03-28 14:08:57 [auto1.es] INFO: Found listing with ID: SL52436
2026-03-28 14:08:57 [auto1.es] INFO: Found listing with ID: SR43030
2026-03-28 14:08:57 [auto1.es] INFO: Found listing with ID: KA53373
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA53373%27 HTTP/1.1" 200 None
2026-03-28 14:08:57 [auto1.es] INFO: Scrape type for KA53373: 0
2026-03-28 14:08:57 [auto1.es] INFO: Found listing with ID: PF81025
2026-03-28 14:08:57 [auto1.es] INFO: Found listing with ID: ZP63371
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP63371%27 HTTP/1.1" 200 None
2026-03-28 14:08:57 [auto1.es] INFO: Scrape type for ZP63371: 0
2026-03-28 14:08:57 [auto1.es] INFO: Found listing with ID: YF13100
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF13100%27 HTTP/1.1" 200 None
2026-03-28 14:08:57 [auto1.es] INFO: Scrape type for YF13100: 0
2026-03-28 14:08:57 [auto1.es] INFO: Found listing with ID: YR71719
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR71719%27 HTTP/1.1" 200 None
2026-03-28 14:08:57 [auto1.es] INFO: Scrape type for YR71719: 2
2026-03-28 14:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92d26b0f-56b3-52d1-abf7-af5e7985cdaf with identifier: YR71719
2026-03-28 14:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92d26b0f-56b3-52d1-abf7-af5e7985cdaf with scrape type 2
2026-03-28 14:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92d26b0f-56b3-52d1-abf7-af5e7985cdaf with scrape type 2
2026-03-28 14:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92d26b0f-56b3-52d1-abf7-af5e7985cdaf, identifier: YR71719
2026-03-28 14:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92d26b0f-56b3-52d1-abf7-af5e7985cdaf with identifier: YR71719
2026-03-28 14:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92d26b0f-56b3-52d1-abf7-af5e7985cdaf with identifier: YR71719
2026-03-28 14:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92d26b0f-56b3-52d1-abf7-af5e7985cdaf with identifier: YR71719 to the API
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:44:25Z',
 'fuel_type': 'petrol',
 'id': '92d26b0f-56b3-52d1-abf7-af5e7985cdaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR71719',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 147485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seller_name': None,
 'title': 'Kia XCeed 1.0 TGDI Tech',
 'transmission': 'manual',
 'trim': 'Tech',
 'year': 2019}
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR71719%27 HTTP/1.1" 200 None
2026-03-28 14:08:57 [auto1.es] INFO: Saving data for YR71719: {'auction_closing_time': 1774716265.0, 'created_time': 1774523173.786202, 'last_price_update_time': 1774706937.525999}
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YR71719') HTTP/1.1" 204 0
2026-03-28 14:08:57 [auto1.es] INFO: Found listing with ID: YW89108
2026-03-28 14:08:57 [auto1.es] INFO: Found listing with ID: DW38851
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW38851%27 HTTP/1.1" 200 None
2026-03-28 14:08:57 [auto1.es] INFO: Scrape type for DW38851: 2
2026-03-28 14:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d599a1b-f03f-50f4-ad28-fec4b037493c with identifier: DW38851
2026-03-28 14:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d599a1b-f03f-50f4-ad28-fec4b037493c with scrape type 2
2026-03-28 14:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d599a1b-f03f-50f4-ad28-fec4b037493c with scrape type 2
2026-03-28 14:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2d599a1b-f03f-50f4-ad28-fec4b037493c, identifier: DW38851
2026-03-28 14:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2d599a1b-f03f-50f4-ad28-fec4b037493c with identifier: DW38851
2026-03-28 14:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2d599a1b-f03f-50f4-ad28-fec4b037493c with identifier: DW38851
2026-03-28 14:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2d599a1b-f03f-50f4-ad28-fec4b037493c with identifier: DW38851 to the API
2026-03-28 14:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:07:26Z',
 'fuel_type': 'diesel',
 'id': '2d599a1b-f03f-50f4-ad28-fec4b037493c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW38851',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 514878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-08-02',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 320 CDI Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2004}
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW38851%27 HTTP/1.1" 200 None
2026-03-28 14:08:58 [auto1.es] INFO: Saving data for DW38851: {'auction_closing_time': 1774714046.0, 'created_time': 1774101980.879475, 'last_price_update_time': 1774706938.885042}
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DW38851') HTTP/1.1" 204 0
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: GU69943
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: YU31002
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: NA15103
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA15103%27 HTTP/1.1" 200 None
2026-03-28 14:08:58 [auto1.es] INFO: Scrape type for NA15103: 0
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: AV80298
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: WX54724
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: LC77404
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC77404%27 HTTP/1.1" 200 None
2026-03-28 14:08:58 [auto1.es] INFO: Scrape type for LC77404: 0
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: NC39762
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC39762%27 HTTP/1.1" 200 None
2026-03-28 14:08:58 [auto1.es] INFO: Scrape type for NC39762: 0
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: UJ64573
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: PZ51501
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: EV89991
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: YZ29146
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: UD79775
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: LL26626
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: EG32676
2026-03-28 14:08:58 [auto1.es] INFO: Found listing with ID: LJ17075
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ17075%27 HTTP/1.1" 200 None
2026-03-28 14:08:58 [auto1.es] INFO: Scrape type for LJ17075: 0
2026-03-28 14:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:00 [auto1.es] INFO: Channel: 24h | Page: 28 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: CN46922
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN46922%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Scrape type for CN46922: 0
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: PU35155
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU35155%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Scrape type for PU35155: 0
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: GT40833
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT40833%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Scrape type for GT40833: 2
2026-03-28 14:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8389b1a-ac70-5bef-92fd-5f46e06fba15 with identifier: GT40833
2026-03-28 14:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8389b1a-ac70-5bef-92fd-5f46e06fba15 with scrape type 2
2026-03-28 14:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8389b1a-ac70-5bef-92fd-5f46e06fba15 with scrape type 2
2026-03-28 14:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8389b1a-ac70-5bef-92fd-5f46e06fba15, identifier: GT40833
2026-03-28 14:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8389b1a-ac70-5bef-92fd-5f46e06fba15 with identifier: GT40833
2026-03-28 14:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8389b1a-ac70-5bef-92fd-5f46e06fba15 with identifier: GT40833
2026-03-28 14:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c8389b1a-ac70-5bef-92fd-5f46e06fba15 with identifier: GT40833 to the API
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 111,
 'expiration_date': '2026-03-28T16:08:03Z',
 'fuel_type': 'petrol',
 'id': 'c8389b1a-ac70-5bef-92fd-5f46e06fba15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT40833',
 'listing': 'auction',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 39491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-31',
 'seller_name': None,
 'title': 'MG ZS 1.0 T-GDI Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2023}
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT40833%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Saving data for GT40833: {'auction_closing_time': 1774714083.0, 'created_time': 1774436750.826268, 'last_price_update_time': 1774706940.625542}
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GT40833') HTTP/1.1" 204 0
2026-03-28 14:09:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: XZ52900
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ52900%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Scrape type for XZ52900: 0
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: US62841
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: NF79265
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: WT21682
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: CN05073
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: VP11478
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP11478%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Scrape type for VP11478: 0
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: VG29597
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG29597%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Scrape type for VG29597: 0
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: GT09442
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: AY69334
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: ZT32060
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: PK17062
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: YX85928
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: JW07247
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW07247%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Scrape type for JW07247: 0
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: RE64316
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE64316%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Scrape type for RE64316: 0
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: RA16154
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: AR88261
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: YH68644
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH68644%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Scrape type for YH68644: 0
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: WA88394
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA88394%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Scrape type for WA88394: 0
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: PH91048
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: AK44201
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: FH27641
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH27641%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Scrape type for FH27641: 0
2026-03-28 14:09:00 [auto1.es] INFO: Found listing with ID: EV12094
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV12094%27 HTTP/1.1" 200 None
2026-03-28 14:09:00 [auto1.es] INFO: Scrape type for EV12094: 2
2026-03-28 14:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcbe6577-2029-5f95-af87-a07cea5f8daf with identifier: EV12094
2026-03-28 14:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcbe6577-2029-5f95-af87-a07cea5f8daf with scrape type 2
2026-03-28 14:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcbe6577-2029-5f95-af87-a07cea5f8daf with scrape type 2
2026-03-28 14:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fcbe6577-2029-5f95-af87-a07cea5f8daf, identifier: EV12094
2026-03-28 14:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fcbe6577-2029-5f95-af87-a07cea5f8daf with identifier: EV12094
2026-03-28 14:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fcbe6577-2029-5f95-af87-a07cea5f8daf with identifier: EV12094
2026-03-28 14:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fcbe6577-2029-5f95-af87-a07cea5f8daf with identifier: EV12094 to the API
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:53:52Z',
 'fuel_type': 'petrol',
 'id': 'fcbe6577-2029-5f95-af87-a07cea5f8daf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV12094',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Grand Vitara',
 'odometer': 61544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-04',
 'seller_name': None,
 'title': 'Suzuki Grand Vitara 1.6 3 portes VVT',
 'transmission': 'manual',
 'trim': '3 portes VVT',
 'year': 2006}
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV12094%27 HTTP/1.1" 200 None
2026-03-28 14:09:01 [auto1.es] INFO: Saving data for EV12094: {'auction_closing_time': 1774716832.0, 'created_time': 1774425958.524383, 'last_price_update_time': 1774706941.316934}
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EV12094') HTTP/1.1" 204 0
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: UY91237
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: AE81863
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: CH38483
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH38483%27 HTTP/1.1" 200 None
2026-03-28 14:09:01 [auto1.es] INFO: Scrape type for CH38483: 0
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: KJ28856
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ28856%27 HTTP/1.1" 200 None
2026-03-28 14:09:01 [auto1.es] INFO: Scrape type for KJ28856: 2
2026-03-28 14:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab22bb8-0038-5971-b78a-f2be5317f489 with identifier: KJ28856
2026-03-28 14:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab22bb8-0038-5971-b78a-f2be5317f489 with scrape type 2
2026-03-28 14:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ab22bb8-0038-5971-b78a-f2be5317f489 with scrape type 2
2026-03-28 14:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4ab22bb8-0038-5971-b78a-f2be5317f489, identifier: KJ28856
2026-03-28 14:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4ab22bb8-0038-5971-b78a-f2be5317f489 with identifier: KJ28856
2026-03-28 14:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4ab22bb8-0038-5971-b78a-f2be5317f489 with identifier: KJ28856
2026-03-28 14:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4ab22bb8-0038-5971-b78a-f2be5317f489 with identifier: KJ28856 to the API
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:27:02Z',
 'fuel_type': 'petrol',
 'id': '4ab22bb8-0038-5971-b78a-f2be5317f489',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ28856',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 183207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-26',
 'seller_name': None,
 'title': 'Citroen C4 1.2 e-THP Feel Edition',
 'transmission': 'manual',
 'trim': 'Feel Edition',
 'year': 2016}
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ28856%27 HTTP/1.1" 200 None
2026-03-28 14:09:01 [auto1.es] INFO: Saving data for KJ28856: {'auction_closing_time': 1774715222.0, 'created_time': 1774425982.294958, 'last_price_update_time': 1774706941.866066}
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KJ28856') HTTP/1.1" 204 0
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: FE33802
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: JC17966
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC17966%27 HTTP/1.1" 200 None
2026-03-28 14:09:01 [auto1.es] INFO: Scrape type for JC17966: 0
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: XZ06121
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: HA53879
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: KG68296
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: AJ93581
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: UR41471
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: LL30707
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: CN83416
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: DE85844
2026-03-28 14:09:01 [auto1.es] INFO: Found listing with ID: KX46751
2026-03-28 14:09:10 [scrapy.extensions.logstats] INFO: Crawled 166 pages (at 13 pages/min), scraped 127 items (at 44 items/min)
2026-03-28 14:09:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-28 14:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:10 [auto1.es] INFO: Channel: 24h | Page: 29 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: VV79755
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: BV16371
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: WL52368
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL52368%27 HTTP/1.1" 200 None
2026-03-28 14:09:10 [auto1.es] INFO: Scrape type for WL52368: 0
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: SJ53715
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: SM68144
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: RC81564
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: RJ81343
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ81343%27 HTTP/1.1" 200 None
2026-03-28 14:09:10 [auto1.es] INFO: Scrape type for RJ81343: 0
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: LK68537
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK68537%27 HTTP/1.1" 200 None
2026-03-28 14:09:10 [auto1.es] INFO: Scrape type for LK68537: 0
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: VU28227
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU28227%27 HTTP/1.1" 200 None
2026-03-28 14:09:10 [auto1.es] INFO: Scrape type for VU28227: 0
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: ZA80784
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA80784%27 HTTP/1.1" 200 None
2026-03-28 14:09:10 [auto1.es] INFO: Scrape type for ZA80784: 0
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: PN97483
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: YZ97545
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: BY18698
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY18698%27 HTTP/1.1" 200 None
2026-03-28 14:09:10 [auto1.es] INFO: Scrape type for BY18698: 0
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: DR12042
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: EG74552
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: UH51284
2026-03-28 14:09:10 [auto1.es] INFO: Found listing with ID: MJ33537
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ33537%27 HTTP/1.1" 200 None
2026-03-28 14:09:10 [auto1.es] INFO: Scrape type for MJ33537: 2
2026-03-28 14:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf960948-eab0-52b6-ad80-be9d96a2785c with identifier: MJ33537
2026-03-28 14:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf960948-eab0-52b6-ad80-be9d96a2785c with scrape type 2
2026-03-28 14:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf960948-eab0-52b6-ad80-be9d96a2785c with scrape type 2
2026-03-28 14:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf960948-eab0-52b6-ad80-be9d96a2785c, identifier: MJ33537
2026-03-28 14:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf960948-eab0-52b6-ad80-be9d96a2785c with identifier: MJ33537
2026-03-28 14:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf960948-eab0-52b6-ad80-be9d96a2785c with identifier: MJ33537
2026-03-28 14:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cf960948-eab0-52b6-ad80-be9d96a2785c with identifier: MJ33537 to the API
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:29:06Z',
 'fuel_type': 'petrol',
 'id': 'cf960948-eab0-52b6-ad80-be9d96a2785c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ33537',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 42034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2010}
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ33537%27 HTTP/1.1" 200 None
2026-03-28 14:09:11 [auto1.es] INFO: Saving data for MJ33537: {'auction_closing_time': 1774715346.0, 'created_time': 1774523138.140274, 'last_price_update_time': 1774706951.378921}
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MJ33537') HTTP/1.1" 204 0
2026-03-28 14:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: EB93661
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: HJ75824
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ75824%27 HTTP/1.1" 200 None
2026-03-28 14:09:11 [auto1.es] INFO: Scrape type for HJ75824: 2
2026-03-28 14:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e420c982-5771-543e-80ec-a8e0687d788f with identifier: HJ75824
2026-03-28 14:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e420c982-5771-543e-80ec-a8e0687d788f with scrape type 2
2026-03-28 14:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e420c982-5771-543e-80ec-a8e0687d788f with scrape type 2
2026-03-28 14:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e420c982-5771-543e-80ec-a8e0687d788f, identifier: HJ75824
2026-03-28 14:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e420c982-5771-543e-80ec-a8e0687d788f with identifier: HJ75824
2026-03-28 14:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e420c982-5771-543e-80ec-a8e0687d788f with identifier: HJ75824
2026-03-28 14:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e420c982-5771-543e-80ec-a8e0687d788f with identifier: HJ75824 to the API
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:46:36Z',
 'fuel_type': 'diesel',
 'id': 'e420c982-5771-543e-80ec-a8e0687d788f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ75824',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 222401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'T BlueTEC AMG Line',
 'year': 2016}
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ75824%27 HTTP/1.1" 200 None
2026-03-28 14:09:11 [auto1.es] INFO: Saving data for HJ75824: {'auction_closing_time': 1774716396.0, 'created_time': 1774523128.822196, 'last_price_update_time': 1774706951.912564}
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HJ75824') HTTP/1.1" 204 0
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: DJ31574
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: MX73277
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX73277%27 HTTP/1.1" 200 None
2026-03-28 14:09:11 [auto1.es] INFO: Scrape type for MX73277: 0
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: KC46578
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: HC34911
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: RV14392
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV14392%27 HTTP/1.1" 200 None
2026-03-28 14:09:11 [auto1.es] INFO: Scrape type for RV14392: 0
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: PN16892
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: SY91056
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: DH89256
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH89256%27 HTTP/1.1" 200 None
2026-03-28 14:09:11 [auto1.es] INFO: Scrape type for DH89256: 0
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: YS60567
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: VL93613
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: ZR59289
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: WA75456
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: PU00730
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: GJ83927
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ83927%27 HTTP/1.1" 200 None
2026-03-28 14:09:11 [auto1.es] INFO: Scrape type for GJ83927: 0
2026-03-28 14:09:11 [auto1.es] INFO: Found listing with ID: PK46399
2026-03-28 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK46399%27 HTTP/1.1" 200 None
2026-03-28 14:09:12 [auto1.es] INFO: Scrape type for PK46399: 0
2026-03-28 14:09:12 [auto1.es] INFO: Found listing with ID: CZ41335
2026-03-28 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ41335%27 HTTP/1.1" 200 None
2026-03-28 14:09:12 [auto1.es] INFO: Scrape type for CZ41335: 0
2026-03-28 14:09:12 [auto1.es] INFO: Found listing with ID: XJ15260
2026-03-28 14:09:12 [auto1.es] INFO: Found listing with ID: TL40717
2026-03-28 14:09:12 [auto1.es] INFO: Found listing with ID: MR15790
2026-03-28 14:09:12 [auto1.es] INFO: Found listing with ID: SG19170
2026-03-28 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG19170%27 HTTP/1.1" 200 None
2026-03-28 14:09:12 [auto1.es] INFO: Scrape type for SG19170: 0
2026-03-28 14:09:12 [auto1.es] INFO: Found listing with ID: JB47197
2026-03-28 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB47197%27 HTTP/1.1" 200 None
2026-03-28 14:09:12 [auto1.es] INFO: Scrape type for JB47197: 0
2026-03-28 14:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:12 [auto1.es] INFO: Channel: 24h | Page: 30 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:12 [auto1.es] INFO: Found listing with ID: LS97770
2026-03-28 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS97770%27 HTTP/1.1" 200 None
2026-03-28 14:09:12 [auto1.es] INFO: Scrape type for LS97770: 0
2026-03-28 14:09:12 [auto1.es] INFO: Found listing with ID: ME02001
2026-03-28 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME02001%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for ME02001: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: AV97332
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: YC67931
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: TM54521
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM54521%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for TM54521: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: NE32180
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE32180%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for NE32180: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: EW19678
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW19678%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for EW19678: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: CJ74975
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ74975%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for CJ74975: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: CW02489
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW02489%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for CW02489: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: UX78126
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: VV06777
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV06777%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for VV06777: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: ZM36181
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM36181%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for ZM36181: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: NJ25414
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ25414%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for NJ25414: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: CP72287
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: ES00256
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: WG83508
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG83508%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for WG83508: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: JG83987
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG83987%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for JG83987: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: LE44410
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE44410%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for LE44410: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: VC68158
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC68158%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for VC68158: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: WW30264
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW30264%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for WW30264: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: SK17439
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK17439%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for SK17439: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: FC08911
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: TJ87450
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: JY07683
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: ET27583
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET27583%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for ET27583: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: RF10879
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: SR01470
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR01470%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for SR01470: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: JC88561
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC88561%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for JC88561: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: ZV35449
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: DL51279
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL51279%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for DL51279: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: UC09258
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC09258%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for UC09258: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: HK88265
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: CX27112
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: DG13081
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG13081%27 HTTP/1.1" 200 None
2026-03-28 14:09:13 [auto1.es] INFO: Scrape type for DG13081: 0
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: YH51861
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: YD66722
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: UB76587
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: YU72281
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: TW45528
2026-03-28 14:09:13 [auto1.es] INFO: Found listing with ID: CD57804
2026-03-28 14:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:14 [auto1.es] INFO: Channel: 24h | Page: 31 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:14 [auto1.es] INFO: Found listing with ID: GZ44252
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ44252%27 HTTP/1.1" 200 None
2026-03-28 14:09:14 [auto1.es] INFO: Scrape type for GZ44252: 0
2026-03-28 14:09:14 [auto1.es] INFO: Found listing with ID: RT90695
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT90695%27 HTTP/1.1" 200 None
2026-03-28 14:09:14 [auto1.es] INFO: Scrape type for RT90695: 0
2026-03-28 14:09:14 [auto1.es] INFO: Found listing with ID: BC37690
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC37690%27 HTTP/1.1" 200 None
2026-03-28 14:09:14 [auto1.es] INFO: Scrape type for BC37690: 0
2026-03-28 14:09:14 [auto1.es] INFO: Found listing with ID: YH03872
2026-03-28 14:09:14 [auto1.es] INFO: Found listing with ID: AD89683
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD89683%27 HTTP/1.1" 200 None
2026-03-28 14:09:14 [auto1.es] INFO: Scrape type for AD89683: 0
2026-03-28 14:09:14 [auto1.es] INFO: Found listing with ID: TH72342
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH72342%27 HTTP/1.1" 200 None
2026-03-28 14:09:14 [auto1.es] INFO: Scrape type for TH72342: 0
2026-03-28 14:09:14 [auto1.es] INFO: Found listing with ID: GW16894
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW16894%27 HTTP/1.1" 200 None
2026-03-28 14:09:14 [auto1.es] INFO: Scrape type for GW16894: 2
2026-03-28 14:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb857195-9db6-536a-a53e-52e8998f1f32 with identifier: GW16894
2026-03-28 14:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb857195-9db6-536a-a53e-52e8998f1f32 with scrape type 2
2026-03-28 14:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb857195-9db6-536a-a53e-52e8998f1f32 with scrape type 2
2026-03-28 14:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cb857195-9db6-536a-a53e-52e8998f1f32, identifier: GW16894
2026-03-28 14:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cb857195-9db6-536a-a53e-52e8998f1f32 with identifier: GW16894
2026-03-28 14:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cb857195-9db6-536a-a53e-52e8998f1f32 with identifier: GW16894
2026-03-28 14:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cb857195-9db6-536a-a53e-52e8998f1f32 with identifier: GW16894 to the API
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:40:22Z',
 'fuel_type': 'diesel',
 'id': 'cb857195-9db6-536a-a53e-52e8998f1f32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW16894',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 162180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-13',
 'seller_name': None,
 'title': 'Jaguar E-Pace D200 Mild-Hybrid AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2021}
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW16894%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Saving data for GW16894: {'auction_closing_time': 1774716022.0, 'created_time': 1774523205.664038, 'last_price_update_time': 1774706955.038177}
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GW16894') HTTP/1.1" 204 0
2026-03-28 14:09:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: TA62942
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA62942%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for TA62942: 0
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: XY35870
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: WK84423
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: NL09405
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: VY26684
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: DG34195
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: YF57320
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF57320%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for YF57320: 0
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: DP90373
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP90373%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for DP90373: 0
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: CY07348
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY07348%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for CY07348: 0
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: SX15472
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: BF55946
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF55946%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for BF55946: 0
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: SN05044
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN05044%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for SN05044: 0
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: PD75300
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD75300%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for PD75300: 0
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: ZL27133
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: VR01411
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR01411%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for VR01411: 0
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: GA11784
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA11784%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for GA11784: 0
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: XN31464
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN31464%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for XN31464: 0
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: AG74382
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG74382%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for AG74382: 2
2026-03-28 14:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d4f4d18-dab4-5935-a5a0-38a899c42f7a with identifier: AG74382
2026-03-28 14:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d4f4d18-dab4-5935-a5a0-38a899c42f7a with scrape type 2
2026-03-28 14:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d4f4d18-dab4-5935-a5a0-38a899c42f7a with scrape type 2
2026-03-28 14:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9d4f4d18-dab4-5935-a5a0-38a899c42f7a, identifier: AG74382
2026-03-28 14:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9d4f4d18-dab4-5935-a5a0-38a899c42f7a with identifier: AG74382
2026-03-28 14:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9d4f4d18-dab4-5935-a5a0-38a899c42f7a with identifier: AG74382
2026-03-28 14:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9d4f4d18-dab4-5935-a5a0-38a899c42f7a with identifier: AG74382 to the API
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:47:18Z',
 'fuel_type': 'petrol',
 'id': '9d4f4d18-dab4-5935-a5a0-38a899c42f7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG74382',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 68102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-28',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2021}
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG74382%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Saving data for AG74382: {'auction_closing_time': 1774716438.0, 'created_time': 1773248640.482133, 'last_price_update_time': 1774706955.731293}
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AG74382') HTTP/1.1" 204 0
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: FA05527
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: KD95768
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD95768%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for KD95768: 0
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: ZC95482
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: EY10319
2026-03-28 14:09:15 [auto1.es] INFO: Found listing with ID: KN38404
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN38404%27 HTTP/1.1" 200 None
2026-03-28 14:09:15 [auto1.es] INFO: Scrape type for KN38404: 2
2026-03-28 14:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb7751b2-0ab5-5549-b026-347f1b33c10f with identifier: KN38404
2026-03-28 14:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb7751b2-0ab5-5549-b026-347f1b33c10f with scrape type 2
2026-03-28 14:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb7751b2-0ab5-5549-b026-347f1b33c10f with scrape type 2
2026-03-28 14:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eb7751b2-0ab5-5549-b026-347f1b33c10f, identifier: KN38404
2026-03-28 14:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eb7751b2-0ab5-5549-b026-347f1b33c10f with identifier: KN38404
2026-03-28 14:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eb7751b2-0ab5-5549-b026-347f1b33c10f with identifier: KN38404
2026-03-28 14:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eb7751b2-0ab5-5549-b026-347f1b33c10f with identifier: KN38404 to the API
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:43:01Z',
 'fuel_type': 'diesel',
 'id': 'eb7751b2-0ab5-5549-b026-347f1b33c10f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN38404',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 116741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-23',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN38404%27 HTTP/1.1" 200 None
2026-03-28 14:09:16 [auto1.es] INFO: Saving data for KN38404: {'auction_closing_time': 1774716181.0, 'created_time': 1774436789.085289, 'last_price_update_time': 1774706956.259035}
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KN38404') HTTP/1.1" 204 0
2026-03-28 14:09:16 [auto1.es] INFO: Found listing with ID: MY11525
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY11525%27 HTTP/1.1" 200 None
2026-03-28 14:09:16 [auto1.es] INFO: Scrape type for MY11525: 0
2026-03-28 14:09:16 [auto1.es] INFO: Found listing with ID: WC31368
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC31368%27 HTTP/1.1" 200 None
2026-03-28 14:09:16 [auto1.es] INFO: Scrape type for WC31368: 0
2026-03-28 14:09:16 [auto1.es] INFO: Found listing with ID: GY52926
2026-03-28 14:09:16 [auto1.es] INFO: Found listing with ID: PK04858
2026-03-28 14:09:16 [auto1.es] INFO: Found listing with ID: YC45232
2026-03-28 14:09:16 [auto1.es] INFO: Found listing with ID: RN76428
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN76428%27 HTTP/1.1" 200 None
2026-03-28 14:09:16 [auto1.es] INFO: Scrape type for RN76428: 0
2026-03-28 14:09:16 [auto1.es] INFO: Found listing with ID: VZ27900
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ27900%27 HTTP/1.1" 200 None
2026-03-28 14:09:16 [auto1.es] INFO: Scrape type for VZ27900: 0
2026-03-28 14:09:16 [auto1.es] INFO: Found listing with ID: MW68540
2026-03-28 14:09:16 [auto1.es] INFO: Found listing with ID: VM02811
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM02811%27 HTTP/1.1" 200 None
2026-03-28 14:09:16 [auto1.es] INFO: Scrape type for VM02811: 0
2026-03-28 14:09:16 [auto1.es] INFO: Found listing with ID: SA97364
2026-03-28 14:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:17 [auto1.es] INFO: Channel: 24h | Page: 32 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: UN48469
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN48469%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Scrape type for UN48469: 0
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: NA86164
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA86164%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Scrape type for NA86164: 0
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: SW69088
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: BW81200
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW81200%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Scrape type for BW81200: 0
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: AR07470
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: FD93505
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD93505%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Scrape type for FD93505: 0
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: VC05043
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: PW99692
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW99692%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Scrape type for PW99692: 0
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: VY79156
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY79156%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Scrape type for VY79156: 2
2026-03-28 14:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d49ddb1-6c0c-5740-885b-2ce7908a9857 with identifier: VY79156
2026-03-28 14:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d49ddb1-6c0c-5740-885b-2ce7908a9857 with scrape type 2
2026-03-28 14:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d49ddb1-6c0c-5740-885b-2ce7908a9857 with scrape type 2
2026-03-28 14:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7d49ddb1-6c0c-5740-885b-2ce7908a9857, identifier: VY79156
2026-03-28 14:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7d49ddb1-6c0c-5740-885b-2ce7908a9857 with identifier: VY79156
2026-03-28 14:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7d49ddb1-6c0c-5740-885b-2ce7908a9857 with identifier: VY79156
2026-03-28 14:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7d49ddb1-6c0c-5740-885b-2ce7908a9857 with identifier: VY79156 to the API
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:52:58Z',
 'fuel_type': 'diesel',
 'id': '7d49ddb1-6c0c-5740-885b-2ce7908a9857',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY79156',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 118914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-23',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2014}
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY79156%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Saving data for VY79156: {'auction_closing_time': 1774716778.0, 'created_time': 1774523211.226574, 'last_price_update_time': 1774706957.794216}
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VY79156') HTTP/1.1" 204 0
2026-03-28 14:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: MV66149
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: GR78945
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: SJ56624
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: ZL69555
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL69555%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Scrape type for ZL69555: 0
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: JC19208
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC19208%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Scrape type for JC19208: 0
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: VS82741
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VS82741%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Scrape type for VS82741: 0
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: NY33487
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: CH02568
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH02568%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Scrape type for CH02568: 0
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: YA31535
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: KD09714
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: RW57284
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW57284%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Scrape type for RW57284: 0
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: MJ10048
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ10048%27 HTTP/1.1" 200 None
2026-03-28 14:09:17 [auto1.es] INFO: Scrape type for MJ10048: 0
2026-03-28 14:09:17 [auto1.es] INFO: Found listing with ID: TF35206
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF35206%27 HTTP/1.1" 200 None
2026-03-28 14:09:18 [auto1.es] INFO: Scrape type for TF35206: 0
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: YL41788
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: CC73171
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: EN74570
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: BM81559
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: KY27191
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY27191%27 HTTP/1.1" 200 None
2026-03-28 14:09:18 [auto1.es] INFO: Scrape type for KY27191: 0
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: GY66563
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: EW34917
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: WC51146
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: EX52175
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: KL17939
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL17939%27 HTTP/1.1" 200 None
2026-03-28 14:09:18 [auto1.es] INFO: Scrape type for KL17939: 2
2026-03-28 14:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ece8be1-4e0e-51b6-9623-060c5fc1b10b with identifier: KL17939
2026-03-28 14:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ece8be1-4e0e-51b6-9623-060c5fc1b10b with scrape type 2
2026-03-28 14:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ece8be1-4e0e-51b6-9623-060c5fc1b10b with scrape type 2
2026-03-28 14:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2ece8be1-4e0e-51b6-9623-060c5fc1b10b, identifier: KL17939
2026-03-28 14:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2ece8be1-4e0e-51b6-9623-060c5fc1b10b with identifier: KL17939
2026-03-28 14:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2ece8be1-4e0e-51b6-9623-060c5fc1b10b with identifier: KL17939
2026-03-28 14:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2ece8be1-4e0e-51b6-9623-060c5fc1b10b with identifier: KL17939 to the API
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:08Z',
 'fuel_type': 'diesel',
 'id': '2ece8be1-4e0e-51b6-9623-060c5fc1b10b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL17939',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 240980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-16',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Laurin & Klement',
 'transmission': 'manual',
 'trim': 'Laurin & Klement',
 'year': 2015}
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL17939%27 HTTP/1.1" 200 None
2026-03-28 14:09:18 [auto1.es] INFO: Saving data for KL17939: {'auction_closing_time': 1774716968.0, 'created_time': 1774523136.828204, 'last_price_update_time': 1774706958.465219}
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KL17939') HTTP/1.1" 204 0
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: YG24338
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG24338%27 HTTP/1.1" 200 None
2026-03-28 14:09:18 [auto1.es] INFO: Scrape type for YG24338: 0
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: NB11190
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: FH47587
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH47587%27 HTTP/1.1" 200 None
2026-03-28 14:09:18 [auto1.es] INFO: Scrape type for FH47587: 0
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: FS24848
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS24848%27 HTTP/1.1" 200 None
2026-03-28 14:09:18 [auto1.es] INFO: Scrape type for FS24848: 0
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: JB29857
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: ZN14981
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: VE17467
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE17467%27 HTTP/1.1" 200 None
2026-03-28 14:09:18 [auto1.es] INFO: Scrape type for VE17467: 0
2026-03-28 14:09:18 [auto1.es] INFO: Found listing with ID: ZB98870
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB98870%27 HTTP/1.1" 200 None
2026-03-28 14:09:18 [auto1.es] INFO: Scrape type for ZB98870: 0
2026-03-28 14:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:19 [auto1.es] INFO: Channel: 24h | Page: 33 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: RR37131
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR37131%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for RR37131: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: TX53008
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX53008%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for TX53008: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: AD15625
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: KX23330
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX23330%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for KX23330: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: UG82758
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: DA46223
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: GY39157
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY39157%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for GY39157: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: TV93426
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV93426%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for TV93426: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: VH23688
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: MU93951
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU93951%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for MU93951: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: VU67275
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU67275%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for VU67275: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: VL75431
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: PB35716
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: WC06824
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC06824%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for WC06824: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: HV93146
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: KK58093
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: NR52566
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR52566%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for NR52566: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: WH83968
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: VB99654
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: TD60260
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD60260%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for TD60260: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: WJ41546
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: XA12312
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA12312%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for XA12312: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: FT73766
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: YM72054
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM72054%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for YM72054: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: UX12381
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX12381%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for UX12381: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: PP93305
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: BK24148
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: YA45169
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: RK45787
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: CE82736
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: AE24734
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE24734%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for AE24734: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: AC91156
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: FH72535
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH72535%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for FH72535: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: PX22333
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: BH69278
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: CR04544
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: DS93846
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS93846%27 HTTP/1.1" 200 None
2026-03-28 14:09:19 [auto1.es] INFO: Scrape type for DS93846: 0
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: AF99504
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: KL41152
2026-03-28 14:09:19 [auto1.es] INFO: Found listing with ID: YE09930
2026-03-28 14:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:20 [auto1.es] INFO: Channel: 24h | Page: 34 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: XB61397
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB61397%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for XB61397: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: CV87260
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV87260%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for CV87260: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: LX51563
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: ZW73484
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW73484%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for ZW73484: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: FG12610
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: TY35729
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: BV26369
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV26369%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for BV26369: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: TN84578
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: SC59966
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC59966%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for SC59966: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: EF44253
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF44253%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for EF44253: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: XD15291
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD15291%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for XD15291: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: NT29011
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: TW93253
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: ZR33369
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: WC19502
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC19502%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for WC19502: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: UP08407
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP08407%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for UP08407: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: TD30983
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: SH43107
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH43107%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for SH43107: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: KV39877
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV39877%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for KV39877: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: YN87603
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: TT78731
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT78731%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for TT78731: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: CD98275
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: DC35826
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC35826%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for DC35826: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: JN26439
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN26439%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for JN26439: 0
2026-03-28 14:09:20 [auto1.es] INFO: Found listing with ID: YS21780
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS21780%27 HTTP/1.1" 200 None
2026-03-28 14:09:20 [auto1.es] INFO: Scrape type for YS21780: 2
2026-03-28 14:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 154376a5-c993-5227-b645-db067f66bf8e with identifier: YS21780
2026-03-28 14:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 154376a5-c993-5227-b645-db067f66bf8e with scrape type 2
2026-03-28 14:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 154376a5-c993-5227-b645-db067f66bf8e with scrape type 2
2026-03-28 14:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 154376a5-c993-5227-b645-db067f66bf8e, identifier: YS21780
2026-03-28 14:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 154376a5-c993-5227-b645-db067f66bf8e with identifier: YS21780
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 14:09:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 154376a5-c993-5227-b645-db067f66bf8e with identifier: YS21780
2026-03-28 14:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 154376a5-c993-5227-b645-db067f66bf8e with identifier: YS21780 to the API
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:20:55Z',
 'fuel_type': 'diesel',
 'id': '154376a5-c993-5227-b645-db067f66bf8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS21780',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 181378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-06',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi Classic 2WD',
 'transmission': 'manual',
 'trim': 'Classic 2WD',
 'year': 2011}
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS21780%27 HTTP/1.1" 200 None
2026-03-28 14:09:21 [auto1.es] INFO: Saving data for YS21780: {'auction_closing_time': 1774714855.0, 'created_time': 1774523167.048165, 'last_price_update_time': 1774706961.684462}
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YS21780') HTTP/1.1" 204 0
2026-03-28 14:09:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: BG05674
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG05674%27 HTTP/1.1" 200 None
2026-03-28 14:09:21 [auto1.es] INFO: Scrape type for BG05674: 0
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: DH23772
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: HH68332
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: EH02657
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: ME41297
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME41297%27 HTTP/1.1" 200 None
2026-03-28 14:09:21 [auto1.es] INFO: Scrape type for ME41297: 0
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: BW06558
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: LC05327
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: NV73082
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV73082%27 HTTP/1.1" 200 None
2026-03-28 14:09:21 [auto1.es] INFO: Scrape type for NV73082: 0
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: MA08789
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA08789%27 HTTP/1.1" 200 None
2026-03-28 14:09:21 [auto1.es] INFO: Scrape type for MA08789: 0
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: VC32257
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC32257%27 HTTP/1.1" 200 None
2026-03-28 14:09:21 [auto1.es] INFO: Scrape type for VC32257: 0
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: XH30785
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH30785%27 HTTP/1.1" 200 None
2026-03-28 14:09:21 [auto1.es] INFO: Scrape type for XH30785: 0
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: RL96289
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: WB94881
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB94881%27 HTTP/1.1" 200 None
2026-03-28 14:09:21 [auto1.es] INFO: Scrape type for WB94881: 0
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: BS00293
2026-03-28 14:09:21 [auto1.es] INFO: Found listing with ID: MR84448
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR84448%27 HTTP/1.1" 200 None
2026-03-28 14:09:21 [auto1.es] INFO: Scrape type for MR84448: 0
2026-03-28 14:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:22 [auto1.es] INFO: Channel: 24h | Page: 35 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:22 [auto1.es] INFO: Found listing with ID: ET53098
2026-03-28 14:09:22 [auto1.es] INFO: Found listing with ID: FA94127
2026-03-28 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA94127%27 HTTP/1.1" 200 None
2026-03-28 14:09:22 [auto1.es] INFO: Scrape type for FA94127: 2
2026-03-28 14:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f4aafa-3764-59b7-8809-ab429e8a2a4c with identifier: FA94127
2026-03-28 14:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f4aafa-3764-59b7-8809-ab429e8a2a4c with scrape type 2
2026-03-28 14:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95f4aafa-3764-59b7-8809-ab429e8a2a4c with scrape type 2
2026-03-28 14:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 95f4aafa-3764-59b7-8809-ab429e8a2a4c, identifier: FA94127
2026-03-28 14:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 95f4aafa-3764-59b7-8809-ab429e8a2a4c with identifier: FA94127
2026-03-28 14:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 95f4aafa-3764-59b7-8809-ab429e8a2a4c with identifier: FA94127
2026-03-28 14:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 95f4aafa-3764-59b7-8809-ab429e8a2a4c with identifier: FA94127 to the API
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:20:22Z',
 'fuel_type': 'diesel',
 'id': '95f4aafa-3764-59b7-8809-ab429e8a2a4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA94127',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 221699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-19',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA94127%27 HTTP/1.1" 200 None
2026-03-28 14:09:23 [auto1.es] INFO: Saving data for FA94127: {'auction_closing_time': 1774714822.0, 'created_time': 1774425954.000606, 'last_price_update_time': 1774706963.350318}
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FA94127') HTTP/1.1" 204 0
2026-03-28 14:09:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:23 [auto1.es] INFO: Found listing with ID: YP93952
2026-03-28 14:09:23 [auto1.es] INFO: Found listing with ID: FB20792
2026-03-28 14:09:23 [auto1.es] INFO: Found listing with ID: HZ26587
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ26587%27 HTTP/1.1" 200 None
2026-03-28 14:09:23 [auto1.es] INFO: Scrape type for HZ26587: 0
2026-03-28 14:09:23 [auto1.es] INFO: Found listing with ID: RH85625
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH85625%27 HTTP/1.1" 200 None
2026-03-28 14:09:23 [auto1.es] INFO: Scrape type for RH85625: 2
2026-03-28 14:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11adc443-e56c-521e-ac43-69a0cf0cdcc5 with identifier: RH85625
2026-03-28 14:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11adc443-e56c-521e-ac43-69a0cf0cdcc5 with scrape type 2
2026-03-28 14:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11adc443-e56c-521e-ac43-69a0cf0cdcc5 with scrape type 2
2026-03-28 14:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 11adc443-e56c-521e-ac43-69a0cf0cdcc5, identifier: RH85625
2026-03-28 14:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 11adc443-e56c-521e-ac43-69a0cf0cdcc5 with identifier: RH85625
2026-03-28 14:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 11adc443-e56c-521e-ac43-69a0cf0cdcc5 with identifier: RH85625
2026-03-28 14:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 11adc443-e56c-521e-ac43-69a0cf0cdcc5 with identifier: RH85625 to the API
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:29:34Z',
 'fuel_type': 'diesel',
 'id': '11adc443-e56c-521e-ac43-69a0cf0cdcc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH85625',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 282209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-09',
 'seller_name': None,
 'title': 'BMW 7er 730d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH85625%27 HTTP/1.1" 200 None
2026-03-28 14:09:23 [auto1.es] INFO: Saving data for RH85625: {'auction_closing_time': 1774715374.0, 'created_time': 1774523194.589237, 'last_price_update_time': 1774706963.896126}
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RH85625') HTTP/1.1" 204 0
2026-03-28 14:09:23 [auto1.es] INFO: Found listing with ID: DG40190
2026-03-28 14:09:23 [auto1.es] INFO: Found listing with ID: MP04292
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP04292%27 HTTP/1.1" 200 None
2026-03-28 14:09:23 [auto1.es] INFO: Scrape type for MP04292: 0
2026-03-28 14:09:23 [auto1.es] INFO: Found listing with ID: LJ64414
2026-03-28 14:09:23 [auto1.es] INFO: Found listing with ID: YW02554
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW02554%27 HTTP/1.1" 200 None
2026-03-28 14:09:23 [auto1.es] INFO: Scrape type for YW02554: 0
2026-03-28 14:09:23 [auto1.es] INFO: Found listing with ID: RR71682
2026-03-28 14:09:23 [auto1.es] INFO: Found listing with ID: WY33726
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY33726%27 HTTP/1.1" 200 None
2026-03-28 14:09:23 [auto1.es] INFO: Scrape type for WY33726: 2
2026-03-28 14:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3991b781-cb44-582b-8b3f-1ec9b1ff32b0 with identifier: WY33726
2026-03-28 14:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3991b781-cb44-582b-8b3f-1ec9b1ff32b0 with scrape type 2
2026-03-28 14:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3991b781-cb44-582b-8b3f-1ec9b1ff32b0 with scrape type 2
2026-03-28 14:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3991b781-cb44-582b-8b3f-1ec9b1ff32b0, identifier: WY33726
2026-03-28 14:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3991b781-cb44-582b-8b3f-1ec9b1ff32b0 with identifier: WY33726
2026-03-28 14:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3991b781-cb44-582b-8b3f-1ec9b1ff32b0 with identifier: WY33726
2026-03-28 14:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3991b781-cb44-582b-8b3f-1ec9b1ff32b0 with identifier: WY33726 to the API
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:41:52Z',
 'fuel_type': 'diesel',
 'id': '3991b781-cb44-582b-8b3f-1ec9b1ff32b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY33726',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 123091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-04',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2009}
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY33726%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Saving data for WY33726: {'auction_closing_time': 1774716112.0, 'created_time': 1774523196.004387, 'last_price_update_time': 1774706964.381961}
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WY33726') HTTP/1.1" 204 0
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: AR59073
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR59073%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Scrape type for AR59073: 0
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: NH73319
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: MV76420
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV76420%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Scrape type for MV76420: 0
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: TZ42213
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: MA84687
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA84687%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Scrape type for MA84687: 0
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: TY81479
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: NL32920
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: HL39596
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL39596%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Scrape type for HL39596: 0
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: VT03580
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: AS19038
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: BY33283
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: JF88454
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF88454%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Scrape type for JF88454: 0
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: EZ85260
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ85260%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Scrape type for EZ85260: 0
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: RM57308
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM57308%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Scrape type for RM57308: 0
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: UF70444
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: PL43950
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL43950%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Scrape type for PL43950: 0
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: KL28800
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL28800%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Scrape type for KL28800: 0
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: TZ81028
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: NB98056
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: GR21814
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR21814%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Scrape type for GR21814: 0
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: GK19760
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: KU93995
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU93995%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Scrape type for KU93995: 0
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: CH33556
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: RX23320
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: PJ00608
2026-03-28 14:09:24 [auto1.es] INFO: Found listing with ID: LU54456
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU54456%27 HTTP/1.1" 200 None
2026-03-28 14:09:24 [auto1.es] INFO: Scrape type for LU54456: 2
2026-03-28 14:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a01ba0b-fc62-5f23-8c87-62f86a5bcaf8 with identifier: LU54456
2026-03-28 14:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a01ba0b-fc62-5f23-8c87-62f86a5bcaf8 with scrape type 2
2026-03-28 14:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a01ba0b-fc62-5f23-8c87-62f86a5bcaf8 with scrape type 2
2026-03-28 14:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4a01ba0b-fc62-5f23-8c87-62f86a5bcaf8, identifier: LU54456
2026-03-28 14:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4a01ba0b-fc62-5f23-8c87-62f86a5bcaf8 with identifier: LU54456
2026-03-28 14:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4a01ba0b-fc62-5f23-8c87-62f86a5bcaf8 with identifier: LU54456
2026-03-28 14:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4a01ba0b-fc62-5f23-8c87-62f86a5bcaf8 with identifier: LU54456 to the API
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:27:08Z',
 'fuel_type': 'petrol',
 'id': '4a01ba0b-fc62-5f23-8c87-62f86a5bcaf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU54456',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 125809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-20',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-28 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU54456%27 HTTP/1.1" 200 None
2026-03-28 14:09:25 [auto1.es] INFO: Saving data for LU54456: {'auction_closing_time': 1774715228.0, 'created_time': 1774523164.431835, 'last_price_update_time': 1774706965.057505}
2026-03-28 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LU54456') HTTP/1.1" 204 0
2026-03-28 14:09:25 [auto1.es] INFO: Found listing with ID: EX28567
2026-03-28 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX28567%27 HTTP/1.1" 200 None
2026-03-28 14:09:25 [auto1.es] INFO: Scrape type for EX28567: 0
2026-03-28 14:09:25 [auto1.es] INFO: Found listing with ID: RA35463
2026-03-28 14:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:26 [auto1.es] INFO: Channel: 24h | Page: 36 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: CV55647
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: PA43540
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA43540%27 HTTP/1.1" 200 None
2026-03-28 14:09:26 [auto1.es] INFO: Scrape type for PA43540: 2
2026-03-28 14:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82f29a19-14e6-5580-8e67-cde0298ae46b with identifier: PA43540
2026-03-28 14:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82f29a19-14e6-5580-8e67-cde0298ae46b with scrape type 2
2026-03-28 14:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82f29a19-14e6-5580-8e67-cde0298ae46b with scrape type 2
2026-03-28 14:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 82f29a19-14e6-5580-8e67-cde0298ae46b, identifier: PA43540
2026-03-28 14:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 82f29a19-14e6-5580-8e67-cde0298ae46b with identifier: PA43540
2026-03-28 14:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 82f29a19-14e6-5580-8e67-cde0298ae46b with identifier: PA43540
2026-03-28 14:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 82f29a19-14e6-5580-8e67-cde0298ae46b with identifier: PA43540 to the API
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:42Z',
 'fuel_type': 'diesel',
 'id': '82f29a19-14e6-5580-8e67-cde0298ae46b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA43540',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 75549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-30',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2016}
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA43540%27 HTTP/1.1" 200 None
2026-03-28 14:09:26 [auto1.es] INFO: Saving data for PA43540: {'auction_closing_time': 1774717122.0, 'created_time': 1773821130.754025, 'last_price_update_time': 1774706966.490885}
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PA43540') HTTP/1.1" 204 0
2026-03-28 14:09:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: KW12372
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: XT42288
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: HA98182
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA98182%27 HTTP/1.1" 200 None
2026-03-28 14:09:26 [auto1.es] INFO: Scrape type for HA98182: 2
2026-03-28 14:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91ddb2d7-e976-507e-8a4b-c5192ba455c7 with identifier: HA98182
2026-03-28 14:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91ddb2d7-e976-507e-8a4b-c5192ba455c7 with scrape type 2
2026-03-28 14:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91ddb2d7-e976-507e-8a4b-c5192ba455c7 with scrape type 2
2026-03-28 14:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 91ddb2d7-e976-507e-8a4b-c5192ba455c7, identifier: HA98182
2026-03-28 14:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 91ddb2d7-e976-507e-8a4b-c5192ba455c7 with identifier: HA98182
2026-03-28 14:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 91ddb2d7-e976-507e-8a4b-c5192ba455c7 with identifier: HA98182
2026-03-28 14:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 91ddb2d7-e976-507e-8a4b-c5192ba455c7 with identifier: HA98182 to the API
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:45:38Z',
 'fuel_type': 'diesel',
 'id': '91ddb2d7-e976-507e-8a4b-c5192ba455c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA98182',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 159242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-01',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Sport by R-Line',
 'transmission': 'manual',
 'trim': 'Sport by R-Line',
 'year': 2014}
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA98182%27 HTTP/1.1" 200 None
2026-03-28 14:09:26 [auto1.es] INFO: Saving data for HA98182: {'auction_closing_time': 1774716338.0, 'created_time': 1774523186.066568, 'last_price_update_time': 1774706966.912688}
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HA98182') HTTP/1.1" 204 0
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: VY50847
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY50847%27 HTTP/1.1" 200 None
2026-03-28 14:09:26 [auto1.es] INFO: Scrape type for VY50847: 0
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: TS51738
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: JA52917
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA52917%27 HTTP/1.1" 200 None
2026-03-28 14:09:26 [auto1.es] INFO: Scrape type for JA52917: 0
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: KK03288
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: NX72938
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX72938%27 HTTP/1.1" 200 None
2026-03-28 14:09:26 [auto1.es] INFO: Scrape type for NX72938: 0
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: WM80180
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: FM79545
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM79545%27 HTTP/1.1" 200 None
2026-03-28 14:09:26 [auto1.es] INFO: Scrape type for FM79545: 0
2026-03-28 14:09:26 [auto1.es] INFO: Found listing with ID: UR77276
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR77276%27 HTTP/1.1" 200 None
2026-03-28 14:09:27 [auto1.es] INFO: Scrape type for UR77276: 2
2026-03-28 14:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e874b95-0d01-522d-9db2-7a4faea4d454 with identifier: UR77276
2026-03-28 14:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e874b95-0d01-522d-9db2-7a4faea4d454 with scrape type 2
2026-03-28 14:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e874b95-0d01-522d-9db2-7a4faea4d454 with scrape type 2
2026-03-28 14:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0e874b95-0d01-522d-9db2-7a4faea4d454, identifier: UR77276
2026-03-28 14:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0e874b95-0d01-522d-9db2-7a4faea4d454 with identifier: UR77276
2026-03-28 14:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0e874b95-0d01-522d-9db2-7a4faea4d454 with identifier: UR77276
2026-03-28 14:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0e874b95-0d01-522d-9db2-7a4faea4d454 with identifier: UR77276 to the API
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:55:44Z',
 'fuel_type': 'diesel',
 'id': '0e874b95-0d01-522d-9db2-7a4faea4d454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR77276',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 297615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-28',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR77276%27 HTTP/1.1" 200 None
2026-03-28 14:09:27 [auto1.es] INFO: Saving data for UR77276: {'auction_closing_time': 1774716944.0, 'created_time': 1774425959.663014, 'last_price_update_time': 1774706967.419587}
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UR77276') HTTP/1.1" 204 0
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: FG51952
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG51952%27 HTTP/1.1" 200 None
2026-03-28 14:09:27 [auto1.es] INFO: Scrape type for FG51952: 0
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: BR63324
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR63324%27 HTTP/1.1" 200 None
2026-03-28 14:09:27 [auto1.es] INFO: Scrape type for BR63324: 0
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: LV60077
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: VL50797
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL50797%27 HTTP/1.1" 200 None
2026-03-28 14:09:27 [auto1.es] INFO: Scrape type for VL50797: 0
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: SW23101
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: TF28365
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: FB55193
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB55193%27 HTTP/1.1" 200 None
2026-03-28 14:09:27 [auto1.es] INFO: Scrape type for FB55193: 0
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: NM57742
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: BS14602
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BS14602%27 HTTP/1.1" 200 None
2026-03-28 14:09:27 [auto1.es] INFO: Scrape type for BS14602: 0
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: SZ63984
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: XU33886
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: FD79630
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD79630%27 HTTP/1.1" 200 None
2026-03-28 14:09:27 [auto1.es] INFO: Scrape type for FD79630: 0
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: NV08430
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: ES89527
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES89527%27 HTTP/1.1" 200 None
2026-03-28 14:09:27 [auto1.es] INFO: Scrape type for ES89527: 0
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: ZL78219
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: KE44681
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: XY74308
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: JN45905
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: MT58185
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: XZ34869
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: DW24133
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: SG11403
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: BR35184
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: WD04556
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD04556%27 HTTP/1.1" 200 None
2026-03-28 14:09:27 [auto1.es] INFO: Scrape type for WD04556: 0
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: UC81403
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: CG34681
2026-03-28 14:09:27 [auto1.es] INFO: Found listing with ID: UF24863
2026-03-28 14:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:28 [auto1.es] INFO: Channel: 24h | Page: 37 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: BZ30519
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ30519%27 HTTP/1.1" 200 None
2026-03-28 14:09:28 [auto1.es] INFO: Scrape type for BZ30519: 0
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: WW50429
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: LL75884
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: ZB37818
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB37818%27 HTTP/1.1" 200 None
2026-03-28 14:09:28 [auto1.es] INFO: Scrape type for ZB37818: 0
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: DY77667
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: BB64860
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB64860%27 HTTP/1.1" 200 None
2026-03-28 14:09:28 [auto1.es] INFO: Scrape type for BB64860: 0
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: XR73155
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: RZ31529
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: EW95234
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: ZS73380
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS73380%27 HTTP/1.1" 200 None
2026-03-28 14:09:28 [auto1.es] INFO: Scrape type for ZS73380: 0
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: YV96776
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV96776%27 HTTP/1.1" 200 None
2026-03-28 14:09:28 [auto1.es] INFO: Scrape type for YV96776: 0
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: GA63026
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: VD82224
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: ZT77590
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: VF01083
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF01083%27 HTTP/1.1" 200 None
2026-03-28 14:09:28 [auto1.es] INFO: Scrape type for VF01083: 0
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: UU89702
2026-03-28 14:09:28 [auto1.es] INFO: Found listing with ID: ZY52551
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY52551%27 HTTP/1.1" 200 None
2026-03-28 14:09:28 [auto1.es] INFO: Scrape type for ZY52551: 2
2026-03-28 14:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d791597a-11a1-54b2-90fe-8b0d2b7009ef with identifier: ZY52551
2026-03-28 14:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d791597a-11a1-54b2-90fe-8b0d2b7009ef with scrape type 2
2026-03-28 14:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d791597a-11a1-54b2-90fe-8b0d2b7009ef with scrape type 2
2026-03-28 14:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d791597a-11a1-54b2-90fe-8b0d2b7009ef, identifier: ZY52551
2026-03-28 14:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d791597a-11a1-54b2-90fe-8b0d2b7009ef with identifier: ZY52551
2026-03-28 14:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d791597a-11a1-54b2-90fe-8b0d2b7009ef with identifier: ZY52551
2026-03-28 14:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d791597a-11a1-54b2-90fe-8b0d2b7009ef with identifier: ZY52551 to the API
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:42:59Z',
 'fuel_type': 'diesel',
 'id': 'd791597a-11a1-54b2-90fe-8b0d2b7009ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY52551',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Freemont',
 'odometer': 250632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-18',
 'seller_name': None,
 'title': 'Fiat Freemont 2.0 Multijet Lounge 4WD',
 'transmission': 'automatic',
 'trim': 'Lounge 4WD',
 'year': 2013}
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY52551%27 HTTP/1.1" 200 None
2026-03-28 14:09:29 [auto1.es] INFO: Saving data for ZY52551: {'auction_closing_time': 1774716179.0, 'created_time': 1774523201.851363, 'last_price_update_time': 1774706969.287559}
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZY52551') HTTP/1.1" 204 0
2026-03-28 14:09:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: YF84144
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: EN42971
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN42971%27 HTTP/1.1" 200 None
2026-03-28 14:09:29 [auto1.es] INFO: Scrape type for EN42971: 0
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: PD68374
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: UD71414
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD71414%27 HTTP/1.1" 200 None
2026-03-28 14:09:29 [auto1.es] INFO: Scrape type for UD71414: 0
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: XR91515
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: KJ07748
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: AJ61664
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: RV91175
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: NL36775
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL36775%27 HTTP/1.1" 200 None
2026-03-28 14:09:29 [auto1.es] INFO: Scrape type for NL36775: 0
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: MA45744
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA45744%27 HTTP/1.1" 200 None
2026-03-28 14:09:29 [auto1.es] INFO: Scrape type for MA45744: 0
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: FZ75347
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: NT89177
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT89177%27 HTTP/1.1" 200 None
2026-03-28 14:09:29 [auto1.es] INFO: Scrape type for NT89177: 0
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: ZC64345
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC64345%27 HTTP/1.1" 200 None
2026-03-28 14:09:29 [auto1.es] INFO: Scrape type for ZC64345: 0
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: FG54373
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: XD17912
2026-03-28 14:09:29 [auto1.es] INFO: Found listing with ID: RY22174
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY22174%27 HTTP/1.1" 200 None
2026-03-28 14:09:29 [auto1.es] INFO: Scrape type for RY22174: 2
2026-03-28 14:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c6d4aca-2848-59c9-b64f-31a03c8a9e7d with identifier: RY22174
2026-03-28 14:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c6d4aca-2848-59c9-b64f-31a03c8a9e7d with scrape type 2
2026-03-28 14:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c6d4aca-2848-59c9-b64f-31a03c8a9e7d with scrape type 2
2026-03-28 14:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8c6d4aca-2848-59c9-b64f-31a03c8a9e7d, identifier: RY22174
2026-03-28 14:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8c6d4aca-2848-59c9-b64f-31a03c8a9e7d with identifier: RY22174
2026-03-28 14:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8c6d4aca-2848-59c9-b64f-31a03c8a9e7d with identifier: RY22174
2026-03-28 14:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8c6d4aca-2848-59c9-b64f-31a03c8a9e7d with identifier: RY22174 to the API
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:01:51Z',
 'fuel_type': 'diesel',
 'id': '8c6d4aca-2848-59c9-b64f-31a03c8a9e7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY22174',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 111158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-25',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2014}
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY22174%27 HTTP/1.1" 200 None
2026-03-28 14:09:29 [auto1.es] INFO: Saving data for RY22174: {'auction_closing_time': 1774713711.0, 'created_time': 1774523147.215714, 'last_price_update_time': 1774706969.902921}
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RY22174') HTTP/1.1" 204 0
2026-03-28 14:09:30 [auto1.es] INFO: Found listing with ID: UT20809
2026-03-28 14:09:30 [auto1.es] INFO: Found listing with ID: FG10684
2026-03-28 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG10684%27 HTTP/1.1" 200 None
2026-03-28 14:09:30 [auto1.es] INFO: Scrape type for FG10684: 0
2026-03-28 14:09:30 [auto1.es] INFO: Found listing with ID: FU47680
2026-03-28 14:09:30 [auto1.es] INFO: Found listing with ID: CH09218
2026-03-28 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH09218%27 HTTP/1.1" 200 None
2026-03-28 14:09:30 [auto1.es] INFO: Scrape type for CH09218: 2
2026-03-28 14:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70cb57f2-222b-5530-a1e4-2e80435e3b9a with identifier: CH09218
2026-03-28 14:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70cb57f2-222b-5530-a1e4-2e80435e3b9a with scrape type 2
2026-03-28 14:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70cb57f2-222b-5530-a1e4-2e80435e3b9a with scrape type 2
2026-03-28 14:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 70cb57f2-222b-5530-a1e4-2e80435e3b9a, identifier: CH09218
2026-03-28 14:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 70cb57f2-222b-5530-a1e4-2e80435e3b9a with identifier: CH09218
2026-03-28 14:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 70cb57f2-222b-5530-a1e4-2e80435e3b9a with identifier: CH09218
2026-03-28 14:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 70cb57f2-222b-5530-a1e4-2e80435e3b9a with identifier: CH09218 to the API
2026-03-28 14:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:31:03Z',
 'fuel_type': 'hybrid',
 'id': '70cb57f2-222b-5530-a1e4-2e80435e3b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH09218',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 90746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seller_name': None,
 'title': 'Renault Clio 1.6 E-Tech Hybrid Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2021}
2026-03-28 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH09218%27 HTTP/1.1" 200 None
2026-03-28 14:09:30 [auto1.es] INFO: Saving data for CH09218: {'auction_closing_time': 1774715463.0, 'created_time': 1774523121.42898, 'last_price_update_time': 1774706970.419707}
2026-03-28 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CH09218') HTTP/1.1" 204 0
2026-03-28 14:09:30 [auto1.es] INFO: Found listing with ID: UF43058
2026-03-28 14:09:30 [auto1.es] INFO: Found listing with ID: TF80262
2026-03-28 14:09:30 [auto1.es] INFO: Found listing with ID: YT73159
2026-03-28 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT73159%27 HTTP/1.1" 200 None
2026-03-28 14:09:30 [auto1.es] INFO: Scrape type for YT73159: 0
2026-03-28 14:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:31 [auto1.es] INFO: Channel: 24h | Page: 38 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: TG66753
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: AU62151
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: CL10688
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL10688%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for CL10688: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: UT51740
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: XH62171
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: DH48682
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: TU72670
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: CC38102
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC38102%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for CC38102: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: DT94982
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT94982%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for DT94982: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: GC28603
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC28603%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for GC28603: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: MC11095
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC11095%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for MC11095: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: NV62926
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: MA34031
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: KM76960
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM76960%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for KM76960: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: NK65007
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: TW71891
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW71891%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for TW71891: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: UD05464
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD05464%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for UD05464: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: DD26500
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: XP71478
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: ZZ54358
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: BB78010
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB78010%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for BB78010: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: SP16189
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP16189%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for SP16189: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: LN74062
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN74062%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for LN74062: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: GT09019
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT09019%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for GT09019: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: FX97244
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: SK09082
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK09082%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for SK09082: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: NY35082
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY35082%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for NY35082: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: CD12764
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: JL56851
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL56851%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for JL56851: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: JF75670
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF75670%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for JF75670: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: ZY41152
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: WT09242
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT09242%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for WT09242: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: FS30541
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: KS85396
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS85396%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for KS85396: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: GS63441
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: FB21971
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB21971%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for FB21971: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: AG10118
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: YM84351
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: EU03494
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU03494%27 HTTP/1.1" 200 None
2026-03-28 14:09:31 [auto1.es] INFO: Scrape type for EU03494: 0
2026-03-28 14:09:31 [auto1.es] INFO: Found listing with ID: RF56388
2026-03-28 14:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:32 [auto1.es] INFO: Channel: 24h | Page: 39 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:32 [auto1.es] INFO: Found listing with ID: XA81448
2026-03-28 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA81448%27 HTTP/1.1" 200 None
2026-03-28 14:09:32 [auto1.es] INFO: Scrape type for XA81448: 0
2026-03-28 14:09:32 [auto1.es] INFO: Found listing with ID: RL15311
2026-03-28 14:09:32 [auto1.es] INFO: Found listing with ID: AD59112
2026-03-28 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD59112%27 HTTP/1.1" 200 None
2026-03-28 14:09:32 [auto1.es] INFO: Scrape type for AD59112: 0
2026-03-28 14:09:32 [auto1.es] INFO: Found listing with ID: FL29872
2026-03-28 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL29872%27 HTTP/1.1" 200 None
2026-03-28 14:09:32 [auto1.es] INFO: Scrape type for FL29872: 0
2026-03-28 14:09:32 [auto1.es] INFO: Found listing with ID: NK77548
2026-03-28 14:09:32 [auto1.es] INFO: Found listing with ID: JH13002
2026-03-28 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH13002%27 HTTP/1.1" 200 None
2026-03-28 14:09:32 [auto1.es] INFO: Scrape type for JH13002: 0
2026-03-28 14:09:32 [auto1.es] INFO: Found listing with ID: VG51698
2026-03-28 14:09:32 [auto1.es] INFO: Found listing with ID: XZ20616
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ20616%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for XZ20616: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: WF62317
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF62317%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for WF62317: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: CL39322
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: CU36803
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU36803%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for CU36803: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: KT28524
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: EX93255
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX93255%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for EX93255: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: SH77373
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: GM36563
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: XT63016
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT63016%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for XT63016: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: KD18831
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD18831%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for KD18831: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: UC02522
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: EV19134
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV19134%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for EV19134: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: UZ90788
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ90788%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for UZ90788: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: FU34465
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU34465%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for FU34465: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: YA75501
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: XA87642
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: XZ11402
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: JV95856
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: XS50380
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS50380%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for XS50380: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: LC68552
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: CD34626
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD34626%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for CD34626: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: TV57362
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: BS42122
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BS42122%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for BS42122: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: SM85087
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: LS40670
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS40670%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for LS40670: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: RC86632
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: RR39906
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR39906%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for RR39906: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: RU34223
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU34223%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for RU34223: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: GA97156
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA97156%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for GA97156: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: VW25923
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW25923%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for VW25923: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: YY21107
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY21107%27 HTTP/1.1" 200 None
2026-03-28 14:09:33 [auto1.es] INFO: Scrape type for YY21107: 0
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: YM80761
2026-03-28 14:09:33 [auto1.es] INFO: Found listing with ID: HV14061
2026-03-28 14:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:34 [auto1.es] INFO: Channel: 24h | Page: 40 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:34 [auto1.es] INFO: Found listing with ID: HR86968
2026-03-28 14:09:34 [auto1.es] INFO: Found listing with ID: KP17570
2026-03-28 14:09:34 [auto1.es] INFO: Found listing with ID: ZW86524
2026-03-28 14:09:34 [auto1.es] INFO: Found listing with ID: ZT59108
2026-03-28 14:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT59108%27 HTTP/1.1" 200 None
2026-03-28 14:09:34 [auto1.es] INFO: Scrape type for ZT59108: 2
2026-03-28 14:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5e95912-deea-5a26-a8d5-0603cab9e89b with identifier: ZT59108
2026-03-28 14:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5e95912-deea-5a26-a8d5-0603cab9e89b with scrape type 2
2026-03-28 14:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5e95912-deea-5a26-a8d5-0603cab9e89b with scrape type 2
2026-03-28 14:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e5e95912-deea-5a26-a8d5-0603cab9e89b, identifier: ZT59108
2026-03-28 14:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e5e95912-deea-5a26-a8d5-0603cab9e89b with identifier: ZT59108
2026-03-28 14:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e5e95912-deea-5a26-a8d5-0603cab9e89b with identifier: ZT59108
2026-03-28 14:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e5e95912-deea-5a26-a8d5-0603cab9e89b with identifier: ZT59108 to the API
2026-03-28 14:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-28T16:55:10Z',
 'fuel_type': 'petrol',
 'id': 'e5e95912-deea-5a26-a8d5-0603cab9e89b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT59108',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 248364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-07-16',
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 230 Kompressor Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 1997}
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT59108%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Saving data for ZT59108: {'auction_closing_time': 1774716910.0, 'created_time': 1774425957.048225, 'last_price_update_time': 1774706975.031465}
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZT59108') HTTP/1.1" 204 0
2026-03-28 14:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: XX07827
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX07827%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for XX07827: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: CU53246
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU53246%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for CU53246: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: LR10742
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR10742%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for LR10742: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: VC56562
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC56562%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for VC56562: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: HB97411
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB97411%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for HB97411: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: ZS36669
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS36669%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for ZS36669: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: NJ98715
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: VY69585
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY69585%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for VY69585: 2
2026-03-28 14:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 276c6626-b5de-55a3-868c-7173b36eced0 with identifier: VY69585
2026-03-28 14:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 276c6626-b5de-55a3-868c-7173b36eced0 with scrape type 2
2026-03-28 14:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 276c6626-b5de-55a3-868c-7173b36eced0 with scrape type 2
2026-03-28 14:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 276c6626-b5de-55a3-868c-7173b36eced0, identifier: VY69585
2026-03-28 14:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 276c6626-b5de-55a3-868c-7173b36eced0 with identifier: VY69585
2026-03-28 14:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 276c6626-b5de-55a3-868c-7173b36eced0 with identifier: VY69585
2026-03-28 14:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 276c6626-b5de-55a3-868c-7173b36eced0 with identifier: VY69585 to the API
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:32:12Z',
 'fuel_type': 'diesel',
 'id': '276c6626-b5de-55a3-868c-7173b36eced0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY69585',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 233997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-06',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY69585%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Saving data for VY69585: {'auction_closing_time': 1774715532.0, 'created_time': 1774523174.590899, 'last_price_update_time': 1774706975.667487}
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VY69585') HTTP/1.1" 204 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: FT04300
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: PS20422
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: KB11280
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB11280%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for KB11280: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: AC97398
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: FK13380
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK13380%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for FK13380: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: DD02893
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: FJ48317
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ48317%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for FJ48317: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: TB67105
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: YH79403
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: RJ57584
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ57584%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for RJ57584: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: ZM86466
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: SK07271
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK07271%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for SK07271: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: WZ18115
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: CL69232
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: XZ49849
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ49849%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for XZ49849: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: VK08624
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: ZF20558
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF20558%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for ZF20558: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: LA59477
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: WT51875
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: YJ22618
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ22618%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for YJ22618: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: CY21718
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: EN57511
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN57511%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for EN57511: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: MJ86771
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: FG81749
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: XW98344
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: FA05952
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: HY26286
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY26286%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for HY26286: 0
2026-03-28 14:09:35 [auto1.es] INFO: Found listing with ID: SL84888
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL84888%27 HTTP/1.1" 200 None
2026-03-28 14:09:35 [auto1.es] INFO: Scrape type for SL84888: 0
2026-03-28 14:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:36 [auto1.es] INFO: Channel: 24h | Page: 41 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: DR35066
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR35066%27 HTTP/1.1" 200 None
2026-03-28 14:09:36 [auto1.es] INFO: Scrape type for DR35066: 0
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: CM92438
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM92438%27 HTTP/1.1" 200 None
2026-03-28 14:09:36 [auto1.es] INFO: Scrape type for CM92438: 0
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: EG03635
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: EM05584
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: ZT41669
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: LB47883
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB47883%27 HTTP/1.1" 200 None
2026-03-28 14:09:36 [auto1.es] INFO: Scrape type for LB47883: 0
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: ZH70186
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH70186%27 HTTP/1.1" 200 None
2026-03-28 14:09:36 [auto1.es] INFO: Scrape type for ZH70186: 0
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: BE54244
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE54244%27 HTTP/1.1" 200 None
2026-03-28 14:09:36 [auto1.es] INFO: Scrape type for BE54244: 0
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: RC07486
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: FM46706
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: PU52271
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: JW04171
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW04171%27 HTTP/1.1" 200 None
2026-03-28 14:09:36 [auto1.es] INFO: Scrape type for JW04171: 0
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: HF45963
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: UD26451
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: YL57759
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: BY74928
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY74928%27 HTTP/1.1" 200 None
2026-03-28 14:09:36 [auto1.es] INFO: Scrape type for BY74928: 0
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: AP77113
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP77113%27 HTTP/1.1" 200 None
2026-03-28 14:09:36 [auto1.es] INFO: Scrape type for AP77113: 0
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: VW52839
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: UH68821
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH68821%27 HTTP/1.1" 200 None
2026-03-28 14:09:36 [auto1.es] INFO: Scrape type for UH68821: 0
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: FJ96130
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: MC49666
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: RR74853
2026-03-28 14:09:36 [auto1.es] INFO: Found listing with ID: JJ77360
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ77360%27 HTTP/1.1" 200 None
2026-03-28 14:09:37 [auto1.es] INFO: Scrape type for JJ77360: 0
2026-03-28 14:09:37 [auto1.es] INFO: Found listing with ID: CY26712
2026-03-28 14:09:37 [auto1.es] INFO: Found listing with ID: SR69249
2026-03-28 14:09:37 [auto1.es] INFO: Found listing with ID: RG81713
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG81713%27 HTTP/1.1" 200 None
2026-03-28 14:09:37 [auto1.es] INFO: Scrape type for RG81713: 0
2026-03-28 14:09:37 [auto1.es] INFO: Found listing with ID: NC65740
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC65740%27 HTTP/1.1" 200 None
2026-03-28 14:09:37 [auto1.es] INFO: Scrape type for NC65740: 0
2026-03-28 14:09:37 [auto1.es] INFO: Found listing with ID: MP83522
2026-03-28 14:09:37 [auto1.es] INFO: Found listing with ID: ZV33545
2026-03-28 14:09:37 [auto1.es] INFO: Found listing with ID: GL92788
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL92788%27 HTTP/1.1" 200 None
2026-03-28 14:09:37 [auto1.es] INFO: Scrape type for GL92788: 2
2026-03-28 14:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffa16adf-ae4f-5863-b69d-fc713bb4540e with identifier: GL92788
2026-03-28 14:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffa16adf-ae4f-5863-b69d-fc713bb4540e with scrape type 2
2026-03-28 14:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffa16adf-ae4f-5863-b69d-fc713bb4540e with scrape type 2
2026-03-28 14:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ffa16adf-ae4f-5863-b69d-fc713bb4540e, identifier: GL92788
2026-03-28 14:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ffa16adf-ae4f-5863-b69d-fc713bb4540e with identifier: GL92788
2026-03-28 14:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ffa16adf-ae4f-5863-b69d-fc713bb4540e with identifier: GL92788
2026-03-28 14:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ffa16adf-ae4f-5863-b69d-fc713bb4540e with identifier: GL92788 to the API
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:10:07Z',
 'fuel_type': 'diesel',
 'id': 'ffa16adf-ae4f-5863-b69d-fc713bb4540e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL92788',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 232222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-02',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2012}
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL92788%27 HTTP/1.1" 200 None
2026-03-28 14:09:37 [auto1.es] INFO: Saving data for GL92788: {'auction_closing_time': 1774714207.0, 'created_time': 1774296594.184093, 'last_price_update_time': 1774706977.481453}
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GL92788') HTTP/1.1" 204 0
2026-03-28 14:09:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:37 [auto1.es] INFO: Found listing with ID: XH10437
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH10437%27 HTTP/1.1" 200 None
2026-03-28 14:09:37 [auto1.es] INFO: Scrape type for XH10437: 0
2026-03-28 14:09:37 [auto1.es] INFO: Found listing with ID: JN05964
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN05964%27 HTTP/1.1" 200 None
2026-03-28 14:09:37 [auto1.es] INFO: Scrape type for JN05964: 0
2026-03-28 14:09:37 [auto1.es] INFO: Found listing with ID: KW20253
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW20253%27 HTTP/1.1" 200 None
2026-03-28 14:09:37 [auto1.es] INFO: Scrape type for KW20253: 0
2026-03-28 14:09:37 [auto1.es] INFO: Found listing with ID: CG09187
2026-03-28 14:09:37 [auto1.es] INFO: Found listing with ID: ZL32724
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL32724%27 HTTP/1.1" 200 None
2026-03-28 14:09:37 [auto1.es] INFO: Scrape type for ZL32724: 2
2026-03-28 14:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72f7060f-59cd-502f-b78e-0b30af6ee255 with identifier: ZL32724
2026-03-28 14:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72f7060f-59cd-502f-b78e-0b30af6ee255 with scrape type 2
2026-03-28 14:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72f7060f-59cd-502f-b78e-0b30af6ee255 with scrape type 2
2026-03-28 14:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 72f7060f-59cd-502f-b78e-0b30af6ee255, identifier: ZL32724
2026-03-28 14:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 72f7060f-59cd-502f-b78e-0b30af6ee255 with identifier: ZL32724
2026-03-28 14:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 72f7060f-59cd-502f-b78e-0b30af6ee255 with identifier: ZL32724
2026-03-28 14:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 72f7060f-59cd-502f-b78e-0b30af6ee255 with identifier: ZL32724 to the API
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:10:10Z',
 'fuel_type': 'diesel',
 'id': '72f7060f-59cd-502f-b78e-0b30af6ee255',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL32724',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 117288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-19',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR Advanced',
 'transmission': 'manual',
 'trim': 'FR Advanced',
 'year': 2017}
2026-03-28 14:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL32724%27 HTTP/1.1" 200 None
2026-03-28 14:09:38 [auto1.es] INFO: Saving data for ZL32724: {'auction_closing_time': 1774714210.0, 'created_time': 1774523155.487401, 'last_price_update_time': 1774706978.019019}
2026-03-28 14:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL32724') HTTP/1.1" 204 0
2026-03-28 14:09:38 [auto1.es] INFO: Found listing with ID: YF74611
2026-03-28 14:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF74611%27 HTTP/1.1" 200 None
2026-03-28 14:09:38 [auto1.es] INFO: Scrape type for YF74611: 0
2026-03-28 14:09:38 [auto1.es] INFO: Found listing with ID: WC57455
2026-03-28 14:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC57455%27 HTTP/1.1" 200 None
2026-03-28 14:09:38 [auto1.es] INFO: Scrape type for WC57455: 0
2026-03-28 14:09:38 [auto1.es] INFO: Found listing with ID: YU51978
2026-03-28 14:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU51978%27 HTTP/1.1" 200 None
2026-03-28 14:09:38 [auto1.es] INFO: Scrape type for YU51978: 0
2026-03-28 14:09:38 [auto1.es] INFO: Found listing with ID: LY65055
2026-03-28 14:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY65055%27 HTTP/1.1" 200 None
2026-03-28 14:09:38 [auto1.es] INFO: Scrape type for LY65055: 0
2026-03-28 14:09:38 [auto1.es] INFO: Found listing with ID: NG74473
2026-03-28 14:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:42 [auto1.es] INFO: Channel: 24h | Page: 42 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: NF74888
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF74888%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for NF74888: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: DH03412
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: XR15363
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: JV83587
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JV83587%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for JV83587: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: SN56696
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: XV15787
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV15787%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for XV15787: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: FR40817
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR40817%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for FR40817: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: BU83574
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU83574%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for BU83574: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: HV80518
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: YP61713
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP61713%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for YP61713: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: SP65649
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: KP20621
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP20621%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for KP20621: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: NA52413
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA52413%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for NA52413: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: ZE77964
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE77964%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for ZE77964: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: WA77291
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA77291%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for WA77291: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: EN05559
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: EU16511
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU16511%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for EU16511: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: PF18321
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF18321%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for PF18321: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: JC37021
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: YW59434
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: XW29028
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: ZF17550
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF17550%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for ZF17550: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: DY05510
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: YC76181
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC76181%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for YC76181: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: XH10383
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH10383%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for XH10383: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: SF23835
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF23835%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for SF23835: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: JZ74348
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: EV57307
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: AP01935
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: HA51253
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: DB91286
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: US16617
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US16617%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for US16617: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: UZ32916
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ32916%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for UZ32916: 0
2026-03-28 14:09:42 [auto1.es] INFO: Found listing with ID: KH58937
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH58937%27 HTTP/1.1" 200 None
2026-03-28 14:09:42 [auto1.es] INFO: Scrape type for KH58937: 2
2026-03-28 14:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3cb3db5-982b-5c0b-a435-b015343943d5 with identifier: KH58937
2026-03-28 14:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3cb3db5-982b-5c0b-a435-b015343943d5 with scrape type 2
2026-03-28 14:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3cb3db5-982b-5c0b-a435-b015343943d5 with scrape type 2
2026-03-28 14:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c3cb3db5-982b-5c0b-a435-b015343943d5, identifier: KH58937
2026-03-28 14:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c3cb3db5-982b-5c0b-a435-b015343943d5 with identifier: KH58937
2026-03-28 14:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c3cb3db5-982b-5c0b-a435-b015343943d5 with identifier: KH58937
2026-03-28 14:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c3cb3db5-982b-5c0b-a435-b015343943d5 with identifier: KH58937 to the API
2026-03-28 14:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:00:23Z',
 'fuel_type': 'petrol',
 'id': 'c3cb3db5-982b-5c0b-a435-b015343943d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH58937',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 204745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-03',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-28 14:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH58937%27 HTTP/1.1" 200 None
2026-03-28 14:09:43 [auto1.es] INFO: Saving data for KH58937: {'auction_closing_time': 1774713623.0, 'created_time': 1774523184.931547, 'last_price_update_time': 1774706983.10953}
2026-03-28 14:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KH58937') HTTP/1.1" 204 0
2026-03-28 14:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:43 [auto1.es] INFO: Found listing with ID: BB21726
2026-03-28 14:09:43 [auto1.es] INFO: Found listing with ID: VE25065
2026-03-28 14:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE25065%27 HTTP/1.1" 200 None
2026-03-28 14:09:43 [auto1.es] INFO: Scrape type for VE25065: 0
2026-03-28 14:09:43 [auto1.es] INFO: Found listing with ID: VC51874
2026-03-28 14:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC51874%27 HTTP/1.1" 200 None
2026-03-28 14:09:43 [auto1.es] INFO: Scrape type for VC51874: 0
2026-03-28 14:09:43 [auto1.es] INFO: Found listing with ID: HB80191
2026-03-28 14:09:43 [auto1.es] INFO: Found listing with ID: EH44076
2026-03-28 14:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH44076%27 HTTP/1.1" 200 None
2026-03-28 14:09:43 [auto1.es] INFO: Scrape type for EH44076: 0
2026-03-28 14:09:43 [auto1.es] INFO: Found listing with ID: BV69737
2026-03-28 14:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:44 [auto1.es] INFO: Channel: 24h | Page: 43 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: CE26517
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: WP31785
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: NA45690
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: XW07664
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW07664%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for XW07664: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: UL26650
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL26650%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for UL26650: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: PN60622
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN60622%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for PN60622: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: BE55826
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: MR13736
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: XY73701
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY73701%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for XY73701: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: NJ64367
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ64367%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for NJ64367: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: MU84560
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: VZ14573
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: NP28736
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP28736%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for NP28736: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: BE57585
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: LZ46895
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: ZK08967
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: MF18812
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF18812%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for MF18812: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: VX73239
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX73239%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for VX73239: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: GS37711
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: MD97530
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: HE26407
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE26407%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for HE26407: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: CH37145
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH37145%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for CH37145: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: YX91165
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX91165%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for YX91165: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: PM01444
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM01444%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for PM01444: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: CG97821
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG97821%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for CG97821: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: HU91100
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: CP16982
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: SW39850
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: ES67704
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES67704%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for ES67704: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: UF98716
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: UV98686
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV98686%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for UV98686: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: ZL46614
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL46614%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for ZL46614: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: CF72772
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF72772%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for CF72772: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: CD32787
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD32787%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for CD32787: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: ME11919
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: YU32195
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU32195%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for YU32195: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: HE05235
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE05235%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for HE05235: 0
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: GE49904
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: UX45403
2026-03-28 14:09:44 [auto1.es] INFO: Found listing with ID: PY10364
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY10364%27 HTTP/1.1" 200 None
2026-03-28 14:09:44 [auto1.es] INFO: Scrape type for PY10364: 0
2026-03-28 14:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:45 [auto1.es] INFO: Channel: 24h | Page: 44 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: FY36073
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: HM53954
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: KE93313
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE93313%27 HTTP/1.1" 200 None
2026-03-28 14:09:45 [auto1.es] INFO: Scrape type for KE93313: 0
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: GX93030
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX93030%27 HTTP/1.1" 200 None
2026-03-28 14:09:45 [auto1.es] INFO: Scrape type for GX93030: 0
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: DS99682
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS99682%27 HTTP/1.1" 200 None
2026-03-28 14:09:45 [auto1.es] INFO: Scrape type for DS99682: 0
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: WV40532
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV40532%27 HTTP/1.1" 200 None
2026-03-28 14:09:45 [auto1.es] INFO: Scrape type for WV40532: 0
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: KC53673
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: SM25064
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: MP42129
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP42129%27 HTTP/1.1" 200 None
2026-03-28 14:09:45 [auto1.es] INFO: Scrape type for MP42129: 0
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: NK34270
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: US76988
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: HL11989
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: UL24539
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: WE46909
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE46909%27 HTTP/1.1" 200 None
2026-03-28 14:09:45 [auto1.es] INFO: Scrape type for WE46909: 0
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: XL66794
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: GJ58304
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ58304%27 HTTP/1.1" 200 None
2026-03-28 14:09:45 [auto1.es] INFO: Scrape type for GJ58304: 0
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: SU07288
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU07288%27 HTTP/1.1" 200 None
2026-03-28 14:09:45 [auto1.es] INFO: Scrape type for SU07288: 0
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: RN04683
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN04683%27 HTTP/1.1" 200 None
2026-03-28 14:09:45 [auto1.es] INFO: Scrape type for RN04683: 0
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: KE66826
2026-03-28 14:09:45 [auto1.es] INFO: Found listing with ID: GT62572
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT62572%27 HTTP/1.1" 200 None
2026-03-28 14:09:45 [auto1.es] INFO: Scrape type for GT62572: 2
2026-03-28 14:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec250ca4-7088-5e48-a311-aa2ca3d55d2d with identifier: GT62572
2026-03-28 14:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec250ca4-7088-5e48-a311-aa2ca3d55d2d with scrape type 2
2026-03-28 14:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec250ca4-7088-5e48-a311-aa2ca3d55d2d with scrape type 2
2026-03-28 14:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ec250ca4-7088-5e48-a311-aa2ca3d55d2d, identifier: GT62572
2026-03-28 14:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ec250ca4-7088-5e48-a311-aa2ca3d55d2d with identifier: GT62572
2026-03-28 14:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ec250ca4-7088-5e48-a311-aa2ca3d55d2d with identifier: GT62572
2026-03-28 14:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ec250ca4-7088-5e48-a311-aa2ca3d55d2d with identifier: GT62572 to the API
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 381,
 'expiration_date': '2026-03-28T16:43:52Z',
 'fuel_type': 'hybrid',
 'id': 'ec250ca4-7088-5e48-a311-aa2ca3d55d2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT62572',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 81560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-25',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid 80th Anniversary',
 'transmission': 'automatic',
 'trim': '80th Anniversary',
 'year': 2021}
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT62572%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Saving data for GT62572: {'auction_closing_time': 1774716232.0, 'created_time': 1774523221.37404, 'last_price_update_time': 1774706986.480408}
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GT62572') HTTP/1.1" 204 0
2026-03-28 14:09:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: SA21904
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: CU63126
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU63126%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for CU63126: 0
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: PS40392
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS40392%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for PS40392: 0
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: ER70032
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER70032%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for ER70032: 0
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: NB66504
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB66504%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for NB66504: 0
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: LY43971
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: AR16993
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR16993%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for AR16993: 0
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: AE99486
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE99486%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for AE99486: 0
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: ST64769
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: BR73846
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR73846%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for BR73846: 0
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: NZ52735
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ52735%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for NZ52735: 0
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: VG19915
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: JX90216
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX90216%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for JX90216: 0
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: WW69130
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW69130%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for WW69130: 0
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: DB60699
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: MD84451
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: FF27063
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: FM76074
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM76074%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for FM76074: 0
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: FN47664
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN47664%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for FN47664: 0
2026-03-28 14:09:46 [auto1.es] INFO: Found listing with ID: PX56700
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX56700%27 HTTP/1.1" 200 None
2026-03-28 14:09:46 [auto1.es] INFO: Scrape type for PX56700: 0
2026-03-28 14:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:47 [auto1.es] INFO: Channel: 24h | Page: 45 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:47 [auto1.es] INFO: Found listing with ID: LE05631
2026-03-28 14:09:47 [auto1.es] INFO: Found listing with ID: YA92841
2026-03-28 14:09:47 [auto1.es] INFO: Found listing with ID: WJ47895
2026-03-28 14:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ47895%27 HTTP/1.1" 200 None
2026-03-28 14:09:47 [auto1.es] INFO: Scrape type for WJ47895: 0
2026-03-28 14:09:47 [auto1.es] INFO: Found listing with ID: EN16009
2026-03-28 14:09:47 [auto1.es] INFO: Found listing with ID: BP83698
2026-03-28 14:09:47 [auto1.es] INFO: Found listing with ID: UY61522
2026-03-28 14:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UY61522%27 HTTP/1.1" 200 None
2026-03-28 14:09:47 [auto1.es] INFO: Scrape type for UY61522: 0
2026-03-28 14:09:47 [auto1.es] INFO: Found listing with ID: FP96823
2026-03-28 14:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP96823%27 HTTP/1.1" 200 None
2026-03-28 14:09:47 [auto1.es] INFO: Scrape type for FP96823: 0
2026-03-28 14:09:47 [auto1.es] INFO: Found listing with ID: MT75330
2026-03-28 14:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT75330%27 HTTP/1.1" 200 None
2026-03-28 14:09:47 [auto1.es] INFO: Scrape type for MT75330: 0
2026-03-28 14:09:47 [auto1.es] INFO: Found listing with ID: CY83374
2026-03-28 14:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY83374%27 HTTP/1.1" 200 None
2026-03-28 14:09:47 [auto1.es] INFO: Scrape type for CY83374: 0
2026-03-28 14:09:47 [auto1.es] INFO: Found listing with ID: CA59744
2026-03-28 14:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA59744%27 HTTP/1.1" 200 None
2026-03-28 14:09:47 [auto1.es] INFO: Scrape type for CA59744: 0
2026-03-28 14:09:47 [auto1.es] INFO: Found listing with ID: GZ65139
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ65139%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for GZ65139: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: SV82730
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV82730%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for SV82730: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: NR18889
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: GT34308
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT34308%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for GT34308: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: VE56967
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: YG49669
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: XX51310
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX51310%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for XX51310: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: NZ53366
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: HA69691
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: BR02548
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: CK45240
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CK45240%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for CK45240: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: NT11654
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT11654%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for NT11654: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: FU44920
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU44920%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for FU44920: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: CH18424
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH18424%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for CH18424: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: KR74310
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: HL87277
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL87277%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for HL87277: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: ZS52106
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: GA48296
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA48296%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for GA48296: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: PV57289
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: DH51017
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH51017%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for DH51017: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: YS24805
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: KK62636
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: GP88698
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: UE51591
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: KK88543
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK88543%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for KK88543: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: SJ54893
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ54893%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for SJ54893: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: UR77549
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR77549%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for UR77549: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: RH13684
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: RR88978
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR88978%27 HTTP/1.1" 200 None
2026-03-28 14:09:48 [auto1.es] INFO: Scrape type for RR88978: 0
2026-03-28 14:09:48 [auto1.es] INFO: Found listing with ID: VM33646
2026-03-28 14:09:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:49 [auto1.es] INFO: Channel: 24h | Page: 46 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: TN33358
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN33358%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for TN33358: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: JR18467
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR18467%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for JR18467: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: WH79046
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: YH97828
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH97828%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for YH97828: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: ZR58264
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: EG55234
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG55234%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for EG55234: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: JY61710
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY61710%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for JY61710: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: MZ20228
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ20228%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for MZ20228: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: NF49332
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: GP02900
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: TJ92656
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ92656%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for TJ92656: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: TJ35606
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ35606%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for TJ35606: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: JL87579
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL87579%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for JL87579: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: CU50273
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU50273%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for CU50273: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: KA14000
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: LU77013
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: UN54067
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: EB66984
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB66984%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for EB66984: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: LE92322
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE92322%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for LE92322: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: FK94642
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK94642%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for FK94642: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: RF34421
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: MF83182
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: UJ15106
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: SX47256
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: TL38815
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL38815%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for TL38815: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: RT35335
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: AY17458
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: AX44077
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: LR05195
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: ED43827
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: WE77493
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: TK05995
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TK05995%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for TK05995: 0
2026-03-28 14:09:49 [auto1.es] INFO: Found listing with ID: RE01082
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE01082%27 HTTP/1.1" 200 None
2026-03-28 14:09:49 [auto1.es] INFO: Scrape type for RE01082: 2
2026-03-28 14:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f00ecdb-99a7-5bfa-a6de-e3d639d1f367 with identifier: RE01082
2026-03-28 14:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f00ecdb-99a7-5bfa-a6de-e3d639d1f367 with scrape type 2
2026-03-28 14:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f00ecdb-99a7-5bfa-a6de-e3d639d1f367 with scrape type 2
2026-03-28 14:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8f00ecdb-99a7-5bfa-a6de-e3d639d1f367, identifier: RE01082
2026-03-28 14:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8f00ecdb-99a7-5bfa-a6de-e3d639d1f367 with identifier: RE01082
2026-03-28 14:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8f00ecdb-99a7-5bfa-a6de-e3d639d1f367 with identifier: RE01082
2026-03-28 14:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8f00ecdb-99a7-5bfa-a6de-e3d639d1f367 with identifier: RE01082 to the API
2026-03-28 14:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:53:58Z',
 'fuel_type': 'diesel',
 'id': '8f00ecdb-99a7-5bfa-a6de-e3d639d1f367',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE01082',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 377758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-29',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR 1',
 'transmission': 'manual',
 'trim': 'FR 1',
 'year': 2007}
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE01082%27 HTTP/1.1" 200 None
2026-03-28 14:09:50 [auto1.es] INFO: Saving data for RE01082: {'auction_closing_time': 1774716838.0, 'created_time': 1774620362.960905, 'last_price_update_time': 1774706990.141366}
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RE01082') HTTP/1.1" 204 0
2026-03-28 14:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:50 [auto1.es] INFO: Found listing with ID: VR51792
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR51792%27 HTTP/1.1" 200 None
2026-03-28 14:09:50 [auto1.es] INFO: Scrape type for VR51792: 0
2026-03-28 14:09:50 [auto1.es] INFO: Found listing with ID: WW04715
2026-03-28 14:09:50 [auto1.es] INFO: Found listing with ID: LP98864
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP98864%27 HTTP/1.1" 200 None
2026-03-28 14:09:50 [auto1.es] INFO: Scrape type for LP98864: 0
2026-03-28 14:09:50 [auto1.es] INFO: Found listing with ID: CL84602
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL84602%27 HTTP/1.1" 200 None
2026-03-28 14:09:50 [auto1.es] INFO: Scrape type for CL84602: 0
2026-03-28 14:09:50 [auto1.es] INFO: Found listing with ID: CB44972
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB44972%27 HTTP/1.1" 200 None
2026-03-28 14:09:50 [auto1.es] INFO: Scrape type for CB44972: 0
2026-03-28 14:09:50 [auto1.es] INFO: Found listing with ID: GB72499
2026-03-28 14:09:50 [auto1.es] INFO: Found listing with ID: YG58121
2026-03-28 14:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:51 [auto1.es] INFO: Channel: 24h | Page: 47 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: CM66780
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: NJ18297
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ18297%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for NJ18297: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: JP19484
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: FL72079
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: CD37802
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD37802%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for CD37802: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: KR53631
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: RH73314
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH73314%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for RH73314: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: FM03469
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: DK97910
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DK97910%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for DK97910: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: TZ12338
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: UE32558
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE32558%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for UE32558: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: BL42593
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL42593%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for BL42593: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: VV22800
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: JT33139
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: LV49477
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: CM70741
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM70741%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for CM70741: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: SM51869
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM51869%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for SM51869: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: DU33012
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU33012%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for DU33012: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: LN79000
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: PG51774
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: LA22899
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: LV62700
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV62700%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for LV62700: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: KT03520
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: PR26492
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: MA61689
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA61689%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for MA61689: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: NG44542
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG44542%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for NG44542: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: FT82115
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT82115%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for FT82115: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: EK45789
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: UA81124
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: KZ85278
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: NN86390
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: MD24315
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD24315%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for MD24315: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: ER91055
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER91055%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for ER91055: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: MT58726
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: MX17134
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX17134%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for MX17134: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: RK31632
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK31632%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for RK31632: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: DH56387
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: JC23738
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC23738%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for JC23738: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: DF11976
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF11976%27 HTTP/1.1" 200 None
2026-03-28 14:09:51 [auto1.es] INFO: Scrape type for DF11976: 0
2026-03-28 14:09:51 [auto1.es] INFO: Found listing with ID: PL96310
2026-03-28 14:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:53 [auto1.es] INFO: Channel: 24h | Page: 48 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:53 [auto1.es] INFO: Found listing with ID: FK36826
2026-03-28 14:09:53 [auto1.es] INFO: Found listing with ID: EV43622
2026-03-28 14:09:53 [auto1.es] INFO: Found listing with ID: DR08098
2026-03-28 14:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR08098%27 HTTP/1.1" 200 None
2026-03-28 14:09:53 [auto1.es] INFO: Scrape type for DR08098: 2
2026-03-28 14:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fe1e605-3799-5703-8158-005192e20d00 with identifier: DR08098
2026-03-28 14:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fe1e605-3799-5703-8158-005192e20d00 with scrape type 2
2026-03-28 14:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fe1e605-3799-5703-8158-005192e20d00 with scrape type 2
2026-03-28 14:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0fe1e605-3799-5703-8158-005192e20d00, identifier: DR08098
2026-03-28 14:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0fe1e605-3799-5703-8158-005192e20d00 with identifier: DR08098
2026-03-28 14:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0fe1e605-3799-5703-8158-005192e20d00 with identifier: DR08098
2026-03-28 14:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0fe1e605-3799-5703-8158-005192e20d00 with identifier: DR08098 to the API
2026-03-28 14:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:15:46Z',
 'fuel_type': 'petrol',
 'id': '0fe1e605-3799-5703-8158-005192e20d00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR08098',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 215449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Kia Carens 1.6 GDI Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2015}
2026-03-28 14:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR08098%27 HTTP/1.1" 200 None
2026-03-28 14:09:53 [auto1.es] INFO: Saving data for DR08098: {'auction_closing_time': 1774714546.0, 'created_time': 1774037220.605839, 'last_price_update_time': 1774706993.711819}
2026-03-28 14:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DR08098') HTTP/1.1" 204 0
2026-03-28 14:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:53 [auto1.es] INFO: Found listing with ID: VR55239
2026-03-28 14:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR55239%27 HTTP/1.1" 200 None
2026-03-28 14:09:53 [auto1.es] INFO: Scrape type for VR55239: 2
2026-03-28 14:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0facb5e4-323d-5851-af3d-218f459a21d4 with identifier: VR55239
2026-03-28 14:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0facb5e4-323d-5851-af3d-218f459a21d4 with scrape type 2
2026-03-28 14:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0facb5e4-323d-5851-af3d-218f459a21d4 with scrape type 2
2026-03-28 14:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0facb5e4-323d-5851-af3d-218f459a21d4, identifier: VR55239
2026-03-28 14:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0facb5e4-323d-5851-af3d-218f459a21d4 with identifier: VR55239
2026-03-28 14:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0facb5e4-323d-5851-af3d-218f459a21d4 with identifier: VR55239
2026-03-28 14:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0facb5e4-323d-5851-af3d-218f459a21d4 with identifier: VR55239 to the API
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:01:06Z',
 'fuel_type': 'diesel',
 'id': '0facb5e4-323d-5851-af3d-218f459a21d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR55239',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 173073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2014}
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR55239%27 HTTP/1.1" 200 None
2026-03-28 14:09:54 [auto1.es] INFO: Saving data for VR55239: {'auction_closing_time': 1774713666.0, 'created_time': 1773692061.827187, 'last_price_update_time': 1774706994.176326}
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VR55239') HTTP/1.1" 204 0
2026-03-28 14:09:54 [auto1.es] INFO: Found listing with ID: MA33029
2026-03-28 14:09:54 [auto1.es] INFO: Found listing with ID: CF71670
2026-03-28 14:09:54 [auto1.es] INFO: Found listing with ID: JM46031
2026-03-28 14:09:54 [auto1.es] INFO: Found listing with ID: WL49874
2026-03-28 14:09:54 [auto1.es] INFO: Found listing with ID: UR06074
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR06074%27 HTTP/1.1" 200 None
2026-03-28 14:09:54 [auto1.es] INFO: Scrape type for UR06074: 2
2026-03-28 14:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b994a21-ac6f-57a6-ad35-99138f24825e with identifier: UR06074
2026-03-28 14:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b994a21-ac6f-57a6-ad35-99138f24825e with scrape type 2
2026-03-28 14:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b994a21-ac6f-57a6-ad35-99138f24825e with scrape type 2
2026-03-28 14:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8b994a21-ac6f-57a6-ad35-99138f24825e, identifier: UR06074
2026-03-28 14:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8b994a21-ac6f-57a6-ad35-99138f24825e with identifier: UR06074
2026-03-28 14:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8b994a21-ac6f-57a6-ad35-99138f24825e with identifier: UR06074
2026-03-28 14:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8b994a21-ac6f-57a6-ad35-99138f24825e with identifier: UR06074 to the API
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:25:36Z',
 'fuel_type': 'diesel',
 'id': '8b994a21-ac6f-57a6-ad35-99138f24825e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR06074',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 107898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-28',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2015}
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR06074%27 HTTP/1.1" 200 None
2026-03-28 14:09:54 [auto1.es] INFO: Saving data for UR06074: {'auction_closing_time': 1774715136.0, 'created_time': 1774620336.173345, 'last_price_update_time': 1774706994.562262}
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UR06074') HTTP/1.1" 204 0
2026-03-28 14:09:54 [auto1.es] INFO: Found listing with ID: DU03691
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU03691%27 HTTP/1.1" 200 None
2026-03-28 14:09:54 [auto1.es] INFO: Scrape type for DU03691: 2
2026-03-28 14:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043e7720-5064-57aa-a2f2-2dfc3887ddac with identifier: DU03691
2026-03-28 14:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043e7720-5064-57aa-a2f2-2dfc3887ddac with scrape type 2
2026-03-28 14:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043e7720-5064-57aa-a2f2-2dfc3887ddac with scrape type 2
2026-03-28 14:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 043e7720-5064-57aa-a2f2-2dfc3887ddac, identifier: DU03691
2026-03-28 14:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 043e7720-5064-57aa-a2f2-2dfc3887ddac with identifier: DU03691
2026-03-28 14:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 043e7720-5064-57aa-a2f2-2dfc3887ddac with identifier: DU03691
2026-03-28 14:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 043e7720-5064-57aa-a2f2-2dfc3887ddac with identifier: DU03691 to the API
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:51:53Z',
 'fuel_type': 'diesel',
 'id': '043e7720-5064-57aa-a2f2-2dfc3887ddac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU03691',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 221951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-24',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Furgón Professional',
 'transmission': 'manual',
 'trim': 'Furgón Professional',
 'year': 2021}
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU03691%27 HTTP/1.1" 200 None
2026-03-28 14:09:54 [auto1.es] INFO: Saving data for DU03691: {'auction_closing_time': 1774716713.0, 'created_time': 1774620348.775498, 'last_price_update_time': 1774706994.973368}
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DU03691') HTTP/1.1" 204 0
2026-03-28 14:09:54 [auto1.es] INFO: Found listing with ID: BK29060
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK29060%27 HTTP/1.1" 200 None
2026-03-28 14:09:55 [auto1.es] INFO: Scrape type for BK29060: 2
2026-03-28 14:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1f3c211-e204-5d6b-b8b1-6b49e50230e7 with identifier: BK29060
2026-03-28 14:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1f3c211-e204-5d6b-b8b1-6b49e50230e7 with scrape type 2
2026-03-28 14:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1f3c211-e204-5d6b-b8b1-6b49e50230e7 with scrape type 2
2026-03-28 14:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e1f3c211-e204-5d6b-b8b1-6b49e50230e7, identifier: BK29060
2026-03-28 14:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e1f3c211-e204-5d6b-b8b1-6b49e50230e7 with identifier: BK29060
2026-03-28 14:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e1f3c211-e204-5d6b-b8b1-6b49e50230e7 with identifier: BK29060
2026-03-28 14:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e1f3c211-e204-5d6b-b8b1-6b49e50230e7 with identifier: BK29060 to the API
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:30:41Z',
 'fuel_type': 'diesel',
 'id': 'e1f3c211-e204-5d6b-b8b1-6b49e50230e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK29060',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 213534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-07',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Furgón Professional',
 'transmission': 'manual',
 'trim': 'Furgón Professional',
 'year': 2020}
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK29060%27 HTTP/1.1" 200 None
2026-03-28 14:09:55 [auto1.es] INFO: Saving data for BK29060: {'auction_closing_time': 1774715441.0, 'created_time': 1774620348.227409, 'last_price_update_time': 1774706995.34971}
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BK29060') HTTP/1.1" 204 0
2026-03-28 14:09:55 [auto1.es] INFO: Found listing with ID: NC38723
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC38723%27 HTTP/1.1" 200 None
2026-03-28 14:09:55 [auto1.es] INFO: Scrape type for NC38723: 2
2026-03-28 14:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76e75bda-f5e1-543f-8117-1a2e1949852b with identifier: NC38723
2026-03-28 14:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76e75bda-f5e1-543f-8117-1a2e1949852b with scrape type 2
2026-03-28 14:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76e75bda-f5e1-543f-8117-1a2e1949852b with scrape type 2
2026-03-28 14:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 76e75bda-f5e1-543f-8117-1a2e1949852b, identifier: NC38723
2026-03-28 14:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 76e75bda-f5e1-543f-8117-1a2e1949852b with identifier: NC38723
2026-03-28 14:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 76e75bda-f5e1-543f-8117-1a2e1949852b with identifier: NC38723
2026-03-28 14:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 76e75bda-f5e1-543f-8117-1a2e1949852b with identifier: NC38723 to the API
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:38:55Z',
 'fuel_type': 'diesel',
 'id': '76e75bda-f5e1-543f-8117-1a2e1949852b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC38723',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 102353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-25',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC38723%27 HTTP/1.1" 200 None
2026-03-28 14:09:55 [auto1.es] INFO: Saving data for NC38723: {'auction_closing_time': 1774715935.0, 'created_time': 1774620331.451515, 'last_price_update_time': 1774706995.744171}
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NC38723') HTTP/1.1" 204 0
2026-03-28 14:09:55 [auto1.es] INFO: Found listing with ID: GA23722
2026-03-28 14:09:55 [auto1.es] INFO: Found listing with ID: RE88096
2026-03-28 14:09:55 [auto1.es] INFO: Found listing with ID: UB92538
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB92538%27 HTTP/1.1" 200 None
2026-03-28 14:09:55 [auto1.es] INFO: Scrape type for UB92538: 2
2026-03-28 14:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa40588a-1e87-5daa-a904-8288f5de4f68 with identifier: UB92538
2026-03-28 14:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa40588a-1e87-5daa-a904-8288f5de4f68 with scrape type 2
2026-03-28 14:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa40588a-1e87-5daa-a904-8288f5de4f68 with scrape type 2
2026-03-28 14:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aa40588a-1e87-5daa-a904-8288f5de4f68, identifier: UB92538
2026-03-28 14:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aa40588a-1e87-5daa-a904-8288f5de4f68 with identifier: UB92538
2026-03-28 14:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aa40588a-1e87-5daa-a904-8288f5de4f68 with identifier: UB92538
2026-03-28 14:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aa40588a-1e87-5daa-a904-8288f5de4f68 with identifier: UB92538 to the API
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:16Z',
 'fuel_type': 'petrol',
 'id': 'aa40588a-1e87-5daa-a904-8288f5de4f68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB92538',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 94760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-28',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB92538%27 HTTP/1.1" 200 None
2026-03-28 14:09:56 [auto1.es] INFO: Saving data for UB92538: {'auction_closing_time': 1774713616.0, 'created_time': 1774620350.647585, 'last_price_update_time': 1774706996.10308}
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UB92538') HTTP/1.1" 204 0
2026-03-28 14:09:56 [auto1.es] INFO: Found listing with ID: VW16333
2026-03-28 14:09:56 [auto1.es] INFO: Found listing with ID: LW24131
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW24131%27 HTTP/1.1" 200 None
2026-03-28 14:09:56 [auto1.es] INFO: Scrape type for LW24131: 2
2026-03-28 14:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 826812bc-1c10-5d67-9e8f-6a2ab54d6ddd with identifier: LW24131
2026-03-28 14:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 826812bc-1c10-5d67-9e8f-6a2ab54d6ddd with scrape type 2
2026-03-28 14:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 826812bc-1c10-5d67-9e8f-6a2ab54d6ddd with scrape type 2
2026-03-28 14:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 826812bc-1c10-5d67-9e8f-6a2ab54d6ddd, identifier: LW24131
2026-03-28 14:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 826812bc-1c10-5d67-9e8f-6a2ab54d6ddd with identifier: LW24131
2026-03-28 14:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 826812bc-1c10-5d67-9e8f-6a2ab54d6ddd with identifier: LW24131
2026-03-28 14:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 826812bc-1c10-5d67-9e8f-6a2ab54d6ddd with identifier: LW24131 to the API
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-28T16:12:26Z',
 'fuel_type': 'hybrid',
 'id': '826812bc-1c10-5d67-9e8f-6a2ab54d6ddd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW24131',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 65963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-30',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid Trailhawk',
 'transmission': 'automatic',
 'trim': 'Trailhawk',
 'year': 2022}
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW24131%27 HTTP/1.1" 200 None
2026-03-28 14:09:56 [auto1.es] INFO: Saving data for LW24131: {'auction_closing_time': 1774714346.0, 'created_time': 1774620351.079359, 'last_price_update_time': 1774706996.568811}
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LW24131') HTTP/1.1" 204 0
2026-03-28 14:09:56 [auto1.es] INFO: Found listing with ID: JH23969
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH23969%27 HTTP/1.1" 200 None
2026-03-28 14:09:56 [auto1.es] INFO: Scrape type for JH23969: 2
2026-03-28 14:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bf9bc8d-490a-5267-b43e-7aead072ce8f with identifier: JH23969
2026-03-28 14:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf9bc8d-490a-5267-b43e-7aead072ce8f with scrape type 2
2026-03-28 14:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bf9bc8d-490a-5267-b43e-7aead072ce8f with scrape type 2
2026-03-28 14:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7bf9bc8d-490a-5267-b43e-7aead072ce8f, identifier: JH23969
2026-03-28 14:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7bf9bc8d-490a-5267-b43e-7aead072ce8f with identifier: JH23969
2026-03-28 14:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7bf9bc8d-490a-5267-b43e-7aead072ce8f with identifier: JH23969
2026-03-28 14:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7bf9bc8d-490a-5267-b43e-7aead072ce8f with identifier: JH23969 to the API
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:12:14Z',
 'fuel_type': 'diesel',
 'id': '7bf9bc8d-490a-5267-b43e-7aead072ce8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH23969',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 176568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-08',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2013}
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH23969%27 HTTP/1.1" 200 None
2026-03-28 14:09:56 [auto1.es] INFO: Saving data for JH23969: {'auction_closing_time': 1774714334.0, 'created_time': 1774620351.921663, 'last_price_update_time': 1774706996.95217}
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JH23969') HTTP/1.1" 204 0
2026-03-28 14:09:56 [auto1.es] INFO: Found listing with ID: GU02949
2026-03-28 14:09:56 [auto1.es] INFO: Found listing with ID: AD94776
2026-03-28 14:09:56 [auto1.es] INFO: Found listing with ID: FY67843
2026-03-28 14:09:56 [auto1.es] INFO: Found listing with ID: CJ73946
2026-03-28 14:09:56 [auto1.es] INFO: Found listing with ID: HW14857
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW14857%27 HTTP/1.1" 200 None
2026-03-28 14:09:56 [auto1.es] INFO: Scrape type for HW14857: 2
2026-03-28 14:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0070548-05e2-5c2d-aa14-6cc437da0eea with identifier: HW14857
2026-03-28 14:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0070548-05e2-5c2d-aa14-6cc437da0eea with scrape type 2
2026-03-28 14:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0070548-05e2-5c2d-aa14-6cc437da0eea with scrape type 2
2026-03-28 14:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d0070548-05e2-5c2d-aa14-6cc437da0eea, identifier: HW14857
2026-03-28 14:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d0070548-05e2-5c2d-aa14-6cc437da0eea with identifier: HW14857
2026-03-28 14:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d0070548-05e2-5c2d-aa14-6cc437da0eea with identifier: HW14857
2026-03-28 14:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d0070548-05e2-5c2d-aa14-6cc437da0eea with identifier: HW14857 to the API
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:21:15Z',
 'fuel_type': 'diesel',
 'id': 'd0070548-05e2-5c2d-aa14-6cc437da0eea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW14857',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 125543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-25',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Authentique Pack',
 'transmission': 'manual',
 'trim': 'Authentique Pack',
 'year': 2009}
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW14857%27 HTTP/1.1" 200 None
2026-03-28 14:09:57 [auto1.es] INFO: Saving data for HW14857: {'auction_closing_time': 1774714875.0, 'created_time': 1774620352.546106, 'last_price_update_time': 1774706997.31633}
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HW14857') HTTP/1.1" 204 0
2026-03-28 14:09:57 [auto1.es] INFO: Found listing with ID: YP76490
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP76490%27 HTTP/1.1" 200 None
2026-03-28 14:09:57 [auto1.es] INFO: Scrape type for YP76490: 2
2026-03-28 14:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e24cc297-40c0-5755-8be0-208ad4f4bfb4 with identifier: YP76490
2026-03-28 14:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e24cc297-40c0-5755-8be0-208ad4f4bfb4 with scrape type 2
2026-03-28 14:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e24cc297-40c0-5755-8be0-208ad4f4bfb4 with scrape type 2
2026-03-28 14:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e24cc297-40c0-5755-8be0-208ad4f4bfb4, identifier: YP76490
2026-03-28 14:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e24cc297-40c0-5755-8be0-208ad4f4bfb4 with identifier: YP76490
2026-03-28 14:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e24cc297-40c0-5755-8be0-208ad4f4bfb4 with identifier: YP76490
2026-03-28 14:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e24cc297-40c0-5755-8be0-208ad4f4bfb4 with identifier: YP76490 to the API
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:24:35Z',
 'fuel_type': 'diesel',
 'id': 'e24cc297-40c0-5755-8be0-208ad4f4bfb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP76490',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS5',
 'odometer': 240104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-11',
 'seller_name': None,
 'title': 'Citroen DS5 2.0 Blue-HDi Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2015}
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP76490%27 HTTP/1.1" 200 None
2026-03-28 14:09:57 [auto1.es] INFO: Saving data for YP76490: {'auction_closing_time': 1774715075.0, 'created_time': 1773128774.245828, 'last_price_update_time': 1774706997.700411}
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YP76490') HTTP/1.1" 204 0
2026-03-28 14:09:57 [auto1.es] INFO: Channel: 24h | Page: 49 | totalHits: 2697 | hits on page: 40
2026-03-28 14:09:57 [auto1.es] INFO: Found listing with ID: KD88168
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD88168%27 HTTP/1.1" 200 None
2026-03-28 14:09:57 [auto1.es] INFO: Scrape type for KD88168: 2
2026-03-28 14:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7ab066d-b4bd-5083-8561-d422b44d1c9d with identifier: KD88168
2026-03-28 14:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ab066d-b4bd-5083-8561-d422b44d1c9d with scrape type 2
2026-03-28 14:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7ab066d-b4bd-5083-8561-d422b44d1c9d with scrape type 2
2026-03-28 14:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c7ab066d-b4bd-5083-8561-d422b44d1c9d, identifier: KD88168
2026-03-28 14:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c7ab066d-b4bd-5083-8561-d422b44d1c9d with identifier: KD88168
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 14:09:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c7ab066d-b4bd-5083-8561-d422b44d1c9d with identifier: KD88168
2026-03-28 14:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c7ab066d-b4bd-5083-8561-d422b44d1c9d with identifier: KD88168 to the API
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:06:18Z',
 'fuel_type': 'diesel',
 'id': 'c7ab066d-b4bd-5083-8561-d422b44d1c9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD88168',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 107463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-13',
 'seller_name': None,
 'title': 'Kia Stonic 1.6 CRDi Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2018}
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD88168%27 HTTP/1.1" 200 None
2026-03-28 14:09:58 [auto1.es] INFO: Saving data for KD88168: {'auction_closing_time': 1774713978.0, 'created_time': 1774620339.415168, 'last_price_update_time': 1774706998.263323}
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KD88168') HTTP/1.1" 204 0
2026-03-28 14:09:58 [auto1.es] INFO: Found listing with ID: RD09772
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD09772%27 HTTP/1.1" 200 None
2026-03-28 14:09:58 [auto1.es] INFO: Scrape type for RD09772: 2
2026-03-28 14:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6681cda-877c-5051-b29c-1c6d919a8fa7 with identifier: RD09772
2026-03-28 14:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6681cda-877c-5051-b29c-1c6d919a8fa7 with scrape type 2
2026-03-28 14:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6681cda-877c-5051-b29c-1c6d919a8fa7 with scrape type 2
2026-03-28 14:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b6681cda-877c-5051-b29c-1c6d919a8fa7, identifier: RD09772
2026-03-28 14:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:09:58 [auto1.es] INFO: Found listing with ID: MJ15003
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ15003%27 HTTP/1.1" 200 None
2026-03-28 14:09:58 [auto1.es] INFO: Scrape type for MJ15003: 2
2026-03-28 14:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b42db28-016c-588d-85a4-310ff8cd81b9 with identifier: MJ15003
2026-03-28 14:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b42db28-016c-588d-85a4-310ff8cd81b9 with scrape type 2
2026-03-28 14:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b42db28-016c-588d-85a4-310ff8cd81b9 with scrape type 2
2026-03-28 14:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0b42db28-016c-588d-85a4-310ff8cd81b9, identifier: MJ15003
2026-03-28 14:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b6681cda-877c-5051-b29c-1c6d919a8fa7 with identifier: RD09772
2026-03-28 14:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b6681cda-877c-5051-b29c-1c6d919a8fa7 with identifier: RD09772
2026-03-28 14:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b6681cda-877c-5051-b29c-1c6d919a8fa7 with identifier: RD09772 to the API
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:41:11Z',
 'fuel_type': 'petrol',
 'id': 'b6681cda-877c-5051-b29c-1c6d919a8fa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD09772',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 212776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-22',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 X Line',
 'transmission': 'manual',
 'trim': 'X Line',
 'year': 2006}
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD09772%27 HTTP/1.1" 200 None
2026-03-28 14:09:58 [auto1.es] INFO: Saving data for RD09772: {'auction_closing_time': 1774716071.0, 'created_time': 1774620358.567763, 'last_price_update_time': 1774706998.747432}
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD09772') HTTP/1.1" 204 0
2026-03-28 14:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0b42db28-016c-588d-85a4-310ff8cd81b9 with identifier: MJ15003
2026-03-28 14:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0b42db28-016c-588d-85a4-310ff8cd81b9 with identifier: MJ15003
2026-03-28 14:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0b42db28-016c-588d-85a4-310ff8cd81b9 with identifier: MJ15003 to the API
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-28T16:37:37Z',
 'fuel_type': 'petrol',
 'id': '0b42db28-016c-588d-85a4-310ff8cd81b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ15003',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 75072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-28',
 'seller_name': None,
 'title': 'Opel Grandland X 1.6 Turbo Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2019}
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ15003%27 HTTP/1.1" 200 None
2026-03-28 14:09:59 [auto1.es] INFO: Saving data for MJ15003: {'auction_closing_time': 1774715857.0, 'created_time': 1774015713.683222, 'last_price_update_time': 1774706999.103108}
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MJ15003') HTTP/1.1" 204 0
2026-03-28 14:09:59 [auto1.es] INFO: Found listing with ID: DC98818
2026-03-28 14:09:59 [auto1.es] INFO: Found listing with ID: FG46245
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG46245%27 HTTP/1.1" 200 None
2026-03-28 14:09:59 [auto1.es] INFO: Scrape type for FG46245: 2
2026-03-28 14:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 113a692c-619a-5b3d-b6c0-37f0369b0917 with identifier: FG46245
2026-03-28 14:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113a692c-619a-5b3d-b6c0-37f0369b0917 with scrape type 2
2026-03-28 14:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 113a692c-619a-5b3d-b6c0-37f0369b0917 with scrape type 2
2026-03-28 14:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 113a692c-619a-5b3d-b6c0-37f0369b0917, identifier: FG46245
2026-03-28 14:09:59 [auto1.es] INFO: Found listing with ID: BX46671
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX46671%27 HTTP/1.1" 200 None
2026-03-28 14:09:59 [auto1.es] INFO: Scrape type for BX46671: 2
2026-03-28 14:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdf34356-a556-58f2-b598-18aaf6ea3c32 with identifier: BX46671
2026-03-28 14:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf34356-a556-58f2-b598-18aaf6ea3c32 with scrape type 2
2026-03-28 14:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdf34356-a556-58f2-b598-18aaf6ea3c32 with scrape type 2
2026-03-28 14:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bdf34356-a556-58f2-b598-18aaf6ea3c32, identifier: BX46671
2026-03-28 14:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 113a692c-619a-5b3d-b6c0-37f0369b0917 with identifier: FG46245
2026-03-28 14:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 113a692c-619a-5b3d-b6c0-37f0369b0917 with identifier: FG46245
2026-03-28 14:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 113a692c-619a-5b3d-b6c0-37f0369b0917 with identifier: FG46245 to the API
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:00:46Z',
 'fuel_type': 'diesel',
 'id': '113a692c-619a-5b3d-b6c0-37f0369b0917',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG46245',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 132243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-11',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG46245%27 HTTP/1.1" 200 None
2026-03-28 14:09:59 [auto1.es] INFO: Saving data for FG46245: {'auction_closing_time': 1774713646.0, 'created_time': 1774037392.564589, 'last_price_update_time': 1774706999.576673}
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FG46245') HTTP/1.1" 204 0
2026-03-28 14:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bdf34356-a556-58f2-b598-18aaf6ea3c32 with identifier: BX46671
2026-03-28 14:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bdf34356-a556-58f2-b598-18aaf6ea3c32 with identifier: BX46671
2026-03-28 14:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bdf34356-a556-58f2-b598-18aaf6ea3c32 with identifier: BX46671 to the API
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:36:26Z',
 'fuel_type': 'petrol',
 'id': 'bdf34356-a556-58f2-b598-18aaf6ea3c32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX46671',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 80924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-03',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX46671%27 HTTP/1.1" 200 None
2026-03-28 14:09:59 [auto1.es] INFO: Saving data for BX46671: {'auction_closing_time': 1774715786.0, 'created_time': 1774620338.856778, 'last_price_update_time': 1774706999.839677}
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BX46671') HTTP/1.1" 204 0
2026-03-28 14:09:59 [auto1.es] INFO: Found listing with ID: ZC78414
2026-03-28 14:09:59 [auto1.es] INFO: Found listing with ID: SV12911
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV12911%27 HTTP/1.1" 200 None
2026-03-28 14:09:59 [auto1.es] INFO: Scrape type for SV12911: 2
2026-03-28 14:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ace38ba-6a1b-5dec-ba40-0b6b0b7ef738 with identifier: SV12911
2026-03-28 14:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ace38ba-6a1b-5dec-ba40-0b6b0b7ef738 with scrape type 2
2026-03-28 14:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ace38ba-6a1b-5dec-ba40-0b6b0b7ef738 with scrape type 2
2026-03-28 14:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ace38ba-6a1b-5dec-ba40-0b6b0b7ef738, identifier: SV12911
2026-03-28 14:09:59 [auto1.es] INFO: Found listing with ID: XH33697
2026-03-28 14:09:59 [auto1.es] INFO: Found listing with ID: AK05110
2026-03-28 14:09:59 [auto1.es] INFO: Found listing with ID: KA10637
2026-03-28 14:09:59 [auto1.es] INFO: Found listing with ID: RK54634
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK54634%27 HTTP/1.1" 200 None
2026-03-28 14:09:59 [auto1.es] INFO: Scrape type for RK54634: 0
2026-03-28 14:09:59 [auto1.es] INFO: Found listing with ID: YF73149
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF73149%27 HTTP/1.1" 200 None
2026-03-28 14:09:59 [auto1.es] INFO: Scrape type for YF73149: 2
2026-03-28 14:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48049865-b7ca-57fc-b14c-4750501bb855 with identifier: YF73149
2026-03-28 14:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48049865-b7ca-57fc-b14c-4750501bb855 with scrape type 2
2026-03-28 14:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48049865-b7ca-57fc-b14c-4750501bb855 with scrape type 2
2026-03-28 14:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 48049865-b7ca-57fc-b14c-4750501bb855, identifier: YF73149
2026-03-28 14:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ace38ba-6a1b-5dec-ba40-0b6b0b7ef738 with identifier: SV12911
2026-03-28 14:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ace38ba-6a1b-5dec-ba40-0b6b0b7ef738 with identifier: SV12911
2026-03-28 14:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ace38ba-6a1b-5dec-ba40-0b6b0b7ef738 with identifier: SV12911 to the API
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:01:42Z',
 'fuel_type': 'diesel',
 'id': '1ace38ba-6a1b-5dec-ba40-0b6b0b7ef738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV12911',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 124573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV12911%27 HTTP/1.1" 200 None
2026-03-28 14:10:00 [auto1.es] INFO: Saving data for SV12911: {'auction_closing_time': 1774713702.0, 'created_time': 1772705080.373302, 'last_price_update_time': 1774707000.402147}
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SV12911') HTTP/1.1" 204 0
2026-03-28 14:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 48049865-b7ca-57fc-b14c-4750501bb855 with identifier: YF73149
2026-03-28 14:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 48049865-b7ca-57fc-b14c-4750501bb855 with identifier: YF73149
2026-03-28 14:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 48049865-b7ca-57fc-b14c-4750501bb855 with identifier: YF73149 to the API
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:17:04Z',
 'fuel_type': 'petrol',
 'id': '48049865-b7ca-57fc-b14c-4750501bb855',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF73149',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 92239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-27',
 'seller_name': None,
 'title': 'Citroen C3 1.6 VTi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2010}
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF73149%27 HTTP/1.1" 200 None
2026-03-28 14:10:00 [auto1.es] INFO: Saving data for YF73149: {'auction_closing_time': 1774714624.0, 'created_time': 1773400035.885125, 'last_price_update_time': 1774707000.690162}
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YF73149') HTTP/1.1" 204 0
2026-03-28 14:10:00 [auto1.es] INFO: Found listing with ID: SW56869
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW56869%27 HTTP/1.1" 200 None
2026-03-28 14:10:00 [auto1.es] INFO: Scrape type for SW56869: 2
2026-03-28 14:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f720314f-cac4-5989-a376-90e0a283ccf6 with identifier: SW56869
2026-03-28 14:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f720314f-cac4-5989-a376-90e0a283ccf6 with scrape type 2
2026-03-28 14:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f720314f-cac4-5989-a376-90e0a283ccf6 with scrape type 2
2026-03-28 14:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f720314f-cac4-5989-a376-90e0a283ccf6, identifier: SW56869
2026-03-28 14:10:00 [auto1.es] INFO: Found listing with ID: NM67545
2026-03-28 14:10:00 [auto1.es] INFO: Found listing with ID: FX35940
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX35940%27 HTTP/1.1" 200 None
2026-03-28 14:10:00 [auto1.es] INFO: Scrape type for FX35940: 2
2026-03-28 14:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dbb2f5e-0955-53e0-991b-2e44a508cb57 with identifier: FX35940
2026-03-28 14:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dbb2f5e-0955-53e0-991b-2e44a508cb57 with scrape type 2
2026-03-28 14:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dbb2f5e-0955-53e0-991b-2e44a508cb57 with scrape type 2
2026-03-28 14:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6dbb2f5e-0955-53e0-991b-2e44a508cb57, identifier: FX35940
2026-03-28 14:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f720314f-cac4-5989-a376-90e0a283ccf6 with identifier: SW56869
2026-03-28 14:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f720314f-cac4-5989-a376-90e0a283ccf6 with identifier: SW56869
2026-03-28 14:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f720314f-cac4-5989-a376-90e0a283ccf6 with identifier: SW56869 to the API
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:36:42Z',
 'fuel_type': 'diesel',
 'id': 'f720314f-cac4-5989-a376-90e0a283ccf6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW56869',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 90671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueTEC Avantgarde',
 'year': 2014}
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW56869%27 HTTP/1.1" 200 None
2026-03-28 14:10:01 [auto1.es] INFO: Saving data for SW56869: {'auction_closing_time': 1774715802.0, 'created_time': 1774620376.065731, 'last_price_update_time': 1774707001.188506}
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SW56869') HTTP/1.1" 204 0
2026-03-28 14:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6dbb2f5e-0955-53e0-991b-2e44a508cb57 with identifier: FX35940
2026-03-28 14:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6dbb2f5e-0955-53e0-991b-2e44a508cb57 with identifier: FX35940
2026-03-28 14:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6dbb2f5e-0955-53e0-991b-2e44a508cb57 with identifier: FX35940 to the API
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:23:05Z',
 'fuel_type': 'diesel',
 'id': '6dbb2f5e-0955-53e0-991b-2e44a508cb57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX35940',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 341360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-06',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX35940%27 HTTP/1.1" 200 None
2026-03-28 14:10:01 [auto1.es] INFO: Saving data for FX35940: {'auction_closing_time': 1774714985.0, 'created_time': 1774350375.943417, 'last_price_update_time': 1774707001.540746}
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FX35940') HTTP/1.1" 204 0
2026-03-28 14:10:01 [auto1.es] INFO: Found listing with ID: HB55085
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB55085%27 HTTP/1.1" 200 None
2026-03-28 14:10:01 [auto1.es] INFO: Scrape type for HB55085: 2
2026-03-28 14:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 423e501a-28ee-5602-859b-ce18172ab882 with identifier: HB55085
2026-03-28 14:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 423e501a-28ee-5602-859b-ce18172ab882 with scrape type 2
2026-03-28 14:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 423e501a-28ee-5602-859b-ce18172ab882 with scrape type 2
2026-03-28 14:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 423e501a-28ee-5602-859b-ce18172ab882, identifier: HB55085
2026-03-28 14:10:01 [auto1.es] INFO: Found listing with ID: KA04822
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA04822%27 HTTP/1.1" 200 None
2026-03-28 14:10:01 [auto1.es] INFO: Scrape type for KA04822: 2
2026-03-28 14:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f6f829c-3a16-52d4-853b-3bf3ebf8f83e with identifier: KA04822
2026-03-28 14:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f6f829c-3a16-52d4-853b-3bf3ebf8f83e with scrape type 2
2026-03-28 14:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f6f829c-3a16-52d4-853b-3bf3ebf8f83e with scrape type 2
2026-03-28 14:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f6f829c-3a16-52d4-853b-3bf3ebf8f83e, identifier: KA04822
2026-03-28 14:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 423e501a-28ee-5602-859b-ce18172ab882 with identifier: HB55085
2026-03-28 14:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 423e501a-28ee-5602-859b-ce18172ab882 with identifier: HB55085
2026-03-28 14:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 423e501a-28ee-5602-859b-ce18172ab882 with identifier: HB55085 to the API
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:46:22Z',
 'fuel_type': 'petrol',
 'id': '423e501a-28ee-5602-859b-ce18172ab882',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB55085',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 167331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-16',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB55085%27 HTTP/1.1" 200 None
2026-03-28 14:10:02 [auto1.es] INFO: Saving data for HB55085: {'auction_closing_time': 1774716382.0, 'created_time': 1773324609.447409, 'last_price_update_time': 1774707002.055278}
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HB55085') HTTP/1.1" 204 0
2026-03-28 14:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f6f829c-3a16-52d4-853b-3bf3ebf8f83e with identifier: KA04822
2026-03-28 14:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f6f829c-3a16-52d4-853b-3bf3ebf8f83e with identifier: KA04822
2026-03-28 14:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f6f829c-3a16-52d4-853b-3bf3ebf8f83e with identifier: KA04822 to the API
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:47:28Z',
 'fuel_type': 'diesel',
 'id': '7f6f829c-3a16-52d4-853b-3bf3ebf8f83e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA04822',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 298727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-27',
 'seller_name': None,
 'title': 'Porsche Cayenne Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA04822%27 HTTP/1.1" 200 None
2026-03-28 14:10:02 [auto1.es] INFO: Saving data for KA04822: {'auction_closing_time': 1774716448.0, 'created_time': 1774350381.148507, 'last_price_update_time': 1774707002.327371}
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KA04822') HTTP/1.1" 204 0
2026-03-28 14:10:02 [auto1.es] INFO: Found listing with ID: KB02477
2026-03-28 14:10:02 [auto1.es] INFO: Found listing with ID: XY62505
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY62505%27 HTTP/1.1" 200 None
2026-03-28 14:10:02 [auto1.es] INFO: Scrape type for XY62505: 2
2026-03-28 14:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 219e7b25-1f12-51aa-8225-7f505e3c4ebb with identifier: XY62505
2026-03-28 14:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 219e7b25-1f12-51aa-8225-7f505e3c4ebb with scrape type 2
2026-03-28 14:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 219e7b25-1f12-51aa-8225-7f505e3c4ebb with scrape type 2
2026-03-28 14:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 219e7b25-1f12-51aa-8225-7f505e3c4ebb, identifier: XY62505
2026-03-28 14:10:02 [auto1.es] INFO: Found listing with ID: YU55670
2026-03-28 14:10:02 [auto1.es] INFO: Found listing with ID: AR66930
2026-03-28 14:10:02 [auto1.es] INFO: Found listing with ID: MS70085
2026-03-28 14:10:02 [auto1.es] INFO: Found listing with ID: EY91693
2026-03-28 14:10:02 [auto1.es] INFO: Found listing with ID: SK48295
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK48295%27 HTTP/1.1" 200 None
2026-03-28 14:10:02 [auto1.es] INFO: Scrape type for SK48295: 2
2026-03-28 14:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d50fadae-84c5-5c9c-8f5a-be49363d8e8f with identifier: SK48295
2026-03-28 14:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d50fadae-84c5-5c9c-8f5a-be49363d8e8f with scrape type 2
2026-03-28 14:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d50fadae-84c5-5c9c-8f5a-be49363d8e8f with scrape type 2
2026-03-28 14:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d50fadae-84c5-5c9c-8f5a-be49363d8e8f, identifier: SK48295
2026-03-28 14:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 219e7b25-1f12-51aa-8225-7f505e3c4ebb with identifier: XY62505
2026-03-28 14:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 219e7b25-1f12-51aa-8225-7f505e3c4ebb with identifier: XY62505
2026-03-28 14:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 219e7b25-1f12-51aa-8225-7f505e3c4ebb with identifier: XY62505 to the API
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:37:20Z',
 'fuel_type': 'petrol',
 'id': '219e7b25-1f12-51aa-8225-7f505e3c4ebb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY62505',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 120748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-10',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.4 VTi Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2012}
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY62505%27 HTTP/1.1" 200 None
2026-03-28 14:10:02 [auto1.es] INFO: Saving data for XY62505: {'auction_closing_time': 1774715840.0, 'created_time': 1774620366.365203, 'last_price_update_time': 1774707002.796079}
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XY62505') HTTP/1.1" 204 0
2026-03-28 14:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d50fadae-84c5-5c9c-8f5a-be49363d8e8f with identifier: SK48295
2026-03-28 14:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d50fadae-84c5-5c9c-8f5a-be49363d8e8f with identifier: SK48295
2026-03-28 14:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d50fadae-84c5-5c9c-8f5a-be49363d8e8f with identifier: SK48295 to the API
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:43:01Z',
 'fuel_type': 'petrol',
 'id': 'd50fadae-84c5-5c9c-8f5a-be49363d8e8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK48295',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 107753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK48295%27 HTTP/1.1" 200 None
2026-03-28 14:10:03 [auto1.es] INFO: Saving data for SK48295: {'auction_closing_time': 1774716181.0, 'created_time': 1774620355.250994, 'last_price_update_time': 1774707003.08485}
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SK48295') HTTP/1.1" 204 0
2026-03-28 14:10:03 [auto1.es] INFO: Found listing with ID: VC51295
2026-03-28 14:10:03 [auto1.es] INFO: Found listing with ID: ZU80420
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU80420%27 HTTP/1.1" 200 None
2026-03-28 14:10:03 [auto1.es] INFO: Scrape type for ZU80420: 2
2026-03-28 14:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7e8f7ec-765a-52bc-bd26-2408c37a7c08 with identifier: ZU80420
2026-03-28 14:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7e8f7ec-765a-52bc-bd26-2408c37a7c08 with scrape type 2
2026-03-28 14:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7e8f7ec-765a-52bc-bd26-2408c37a7c08 with scrape type 2
2026-03-28 14:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d7e8f7ec-765a-52bc-bd26-2408c37a7c08, identifier: ZU80420
2026-03-28 14:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d7e8f7ec-765a-52bc-bd26-2408c37a7c08 with identifier: ZU80420
2026-03-28 14:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d7e8f7ec-765a-52bc-bd26-2408c37a7c08 with identifier: ZU80420
2026-03-28 14:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d7e8f7ec-765a-52bc-bd26-2408c37a7c08 with identifier: ZU80420 to the API
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:57:25Z',
 'fuel_type': 'petrol',
 'id': 'd7e8f7ec-765a-52bc-bd26-2408c37a7c08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU80420',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 22566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-28',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2023}
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU80420%27 HTTP/1.1" 200 None
2026-03-28 14:10:03 [auto1.es] INFO: Saving data for ZU80420: {'auction_closing_time': 1774717045.0, 'created_time': 1773691704.98549, 'last_price_update_time': 1774707003.537213}
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZU80420') HTTP/1.1" 204 0
2026-03-28 14:10:03 [auto1.es] INFO: Found listing with ID: CX94622
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX94622%27 HTTP/1.1" 200 None
2026-03-28 14:10:03 [auto1.es] INFO: Scrape type for CX94622: 2
2026-03-28 14:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 244fe6f9-5138-5566-9cd4-e52644b33193 with identifier: CX94622
2026-03-28 14:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 244fe6f9-5138-5566-9cd4-e52644b33193 with scrape type 2
2026-03-28 14:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 244fe6f9-5138-5566-9cd4-e52644b33193 with scrape type 2
2026-03-28 14:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 244fe6f9-5138-5566-9cd4-e52644b33193, identifier: CX94622
2026-03-28 14:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 244fe6f9-5138-5566-9cd4-e52644b33193 with identifier: CX94622
2026-03-28 14:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 244fe6f9-5138-5566-9cd4-e52644b33193 with identifier: CX94622
2026-03-28 14:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 244fe6f9-5138-5566-9cd4-e52644b33193 with identifier: CX94622 to the API
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:32:38Z',
 'fuel_type': 'hybrid',
 'id': '244fe6f9-5138-5566-9cd4-e52644b33193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX94622',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Camry',
 'odometer': 263778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-22',
 'seller_name': None,
 'title': 'Toyota Camry 2.5 Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2020}
2026-03-28 14:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX94622%27 HTTP/1.1" 200 None
2026-03-28 14:10:04 [auto1.es] INFO: Saving data for CX94622: {'auction_closing_time': 1774715558.0, 'created_time': 1773691812.47268, 'last_price_update_time': 1774707004.004052}
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CX94622') HTTP/1.1" 204 0
2026-03-28 14:10:04 [auto1.es] INFO: Found listing with ID: CV01854
2026-03-28 14:10:04 [auto1.es] INFO: Found listing with ID: NH75257
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH75257%27 HTTP/1.1" 200 None
2026-03-28 14:10:04 [auto1.es] INFO: Scrape type for NH75257: 2
2026-03-28 14:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeeb3811-cbc1-504c-b93b-ba16cc5f3075 with identifier: NH75257
2026-03-28 14:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeeb3811-cbc1-504c-b93b-ba16cc5f3075 with scrape type 2
2026-03-28 14:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eeeb3811-cbc1-504c-b93b-ba16cc5f3075 with scrape type 2
2026-03-28 14:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eeeb3811-cbc1-504c-b93b-ba16cc5f3075, identifier: NH75257
2026-03-28 14:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eeeb3811-cbc1-504c-b93b-ba16cc5f3075 with identifier: NH75257
2026-03-28 14:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eeeb3811-cbc1-504c-b93b-ba16cc5f3075 with identifier: NH75257
2026-03-28 14:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eeeb3811-cbc1-504c-b93b-ba16cc5f3075 with identifier: NH75257 to the API
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:20:32Z',
 'fuel_type': 'diesel',
 'id': 'eeeb3811-cbc1-504c-b93b-ba16cc5f3075',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH75257',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 199816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-25',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH75257%27 HTTP/1.1" 200 None
2026-03-28 14:10:04 [auto1.es] INFO: Saving data for NH75257: {'auction_closing_time': 1774714832.0, 'created_time': 1774436750.350051, 'last_price_update_time': 1774707004.385715}
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NH75257') HTTP/1.1" 204 0
2026-03-28 14:10:04 [auto1.es] INFO: Found listing with ID: MC91810
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC91810%27 HTTP/1.1" 200 None
2026-03-28 14:10:04 [auto1.es] INFO: Scrape type for MC91810: 2
2026-03-28 14:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2a0b652-aa6f-5fa6-ae06-f6414519b9a6 with identifier: MC91810
2026-03-28 14:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a0b652-aa6f-5fa6-ae06-f6414519b9a6 with scrape type 2
2026-03-28 14:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2a0b652-aa6f-5fa6-ae06-f6414519b9a6 with scrape type 2
2026-03-28 14:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b2a0b652-aa6f-5fa6-ae06-f6414519b9a6, identifier: MC91810
2026-03-28 14:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b2a0b652-aa6f-5fa6-ae06-f6414519b9a6 with identifier: MC91810
2026-03-28 14:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b2a0b652-aa6f-5fa6-ae06-f6414519b9a6 with identifier: MC91810
2026-03-28 14:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b2a0b652-aa6f-5fa6-ae06-f6414519b9a6 with identifier: MC91810 to the API
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:52Z',
 'fuel_type': 'diesel',
 'id': 'b2a0b652-aa6f-5fa6-ae06-f6414519b9a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC91810',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 205172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-08',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Luxury 2WD',
 'transmission': 'manual',
 'trim': 'Luxury 2WD',
 'year': 2016}
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC91810%27 HTTP/1.1" 200 None
2026-03-28 14:10:04 [auto1.es] INFO: Saving data for MC91810: {'auction_closing_time': 1774715092.0, 'created_time': 1774620371.57963, 'last_price_update_time': 1774707004.773759}
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MC91810') HTTP/1.1" 204 0
2026-03-28 14:10:04 [auto1.es] INFO: Found listing with ID: XX41705
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX41705%27 HTTP/1.1" 200 None
2026-03-28 14:10:04 [auto1.es] INFO: Scrape type for XX41705: 2
2026-03-28 14:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8382a981-aa03-5ae7-8fbb-4a40d8967b49 with identifier: XX41705
2026-03-28 14:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8382a981-aa03-5ae7-8fbb-4a40d8967b49 with scrape type 2
2026-03-28 14:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8382a981-aa03-5ae7-8fbb-4a40d8967b49 with scrape type 2
2026-03-28 14:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8382a981-aa03-5ae7-8fbb-4a40d8967b49, identifier: XX41705
2026-03-28 14:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8382a981-aa03-5ae7-8fbb-4a40d8967b49 with identifier: XX41705
2026-03-28 14:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8382a981-aa03-5ae7-8fbb-4a40d8967b49 with identifier: XX41705
2026-03-28 14:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8382a981-aa03-5ae7-8fbb-4a40d8967b49 with identifier: XX41705 to the API
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 99,
 'expiration_date': '2026-03-28T16:06:02Z',
 'fuel_type': 'diesel',
 'id': '8382a981-aa03-5ae7-8fbb-4a40d8967b49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX41705',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 243883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi 20 Aniversario Edition',
 'transmission': 'manual',
 'trim': '20 Aniversario Edition',
 'year': 2016}
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX41705%27 HTTP/1.1" 200 None
2026-03-28 14:10:05 [auto1.es] INFO: Saving data for XX41705: {'auction_closing_time': 1774713962.0, 'created_time': 1773400188.748931, 'last_price_update_time': 1774707005.193832}
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XX41705') HTTP/1.1" 204 0
2026-03-28 14:10:05 [auto1.es] INFO: Found listing with ID: WC11174
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC11174%27 HTTP/1.1" 200 None
2026-03-28 14:10:05 [auto1.es] INFO: Scrape type for WC11174: 2
2026-03-28 14:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea3aae0-4fff-5e4f-a2b8-d4b66ae7da8f with identifier: WC11174
2026-03-28 14:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea3aae0-4fff-5e4f-a2b8-d4b66ae7da8f with scrape type 2
2026-03-28 14:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ea3aae0-4fff-5e4f-a2b8-d4b66ae7da8f with scrape type 2
2026-03-28 14:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9ea3aae0-4fff-5e4f-a2b8-d4b66ae7da8f, identifier: WC11174
2026-03-28 14:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9ea3aae0-4fff-5e4f-a2b8-d4b66ae7da8f with identifier: WC11174
2026-03-28 14:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9ea3aae0-4fff-5e4f-a2b8-d4b66ae7da8f with identifier: WC11174
2026-03-28 14:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9ea3aae0-4fff-5e4f-a2b8-d4b66ae7da8f with identifier: WC11174 to the API
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 489,
 'expiration_date': '2026-03-28T16:36:37Z',
 'fuel_type': 'hybrid',
 'id': '9ea3aae0-4fff-5e4f-a2b8-d4b66ae7da8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC11174',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 229916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-08',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 560e L AMG Line',
 'transmission': 'automatic',
 'trim': 'L AMG Line',
 'year': 2020}
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC11174%27 HTTP/1.1" 200 None
2026-03-28 14:10:05 [auto1.es] INFO: Saving data for WC11174: {'auction_closing_time': 1774715797.0, 'created_time': 1773691826.220755, 'last_price_update_time': 1774707005.589912}
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WC11174') HTTP/1.1" 204 0
2026-03-28 14:10:05 [auto1.es] INFO: Found listing with ID: TX02907
2026-03-28 14:10:05 [auto1.es] INFO: Found listing with ID: GT49964
2026-03-28 14:10:05 [auto1.es] INFO: Found listing with ID: RU11910
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU11910%27 HTTP/1.1" 200 None
2026-03-28 14:10:05 [auto1.es] INFO: Scrape type for RU11910: 2
2026-03-28 14:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da07433-7c1f-593e-8ba9-d8173551b171 with identifier: RU11910
2026-03-28 14:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da07433-7c1f-593e-8ba9-d8173551b171 with scrape type 2
2026-03-28 14:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5da07433-7c1f-593e-8ba9-d8173551b171 with scrape type 2
2026-03-28 14:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5da07433-7c1f-593e-8ba9-d8173551b171, identifier: RU11910
2026-03-28 14:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5da07433-7c1f-593e-8ba9-d8173551b171 with identifier: RU11910
2026-03-28 14:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5da07433-7c1f-593e-8ba9-d8173551b171 with identifier: RU11910
2026-03-28 14:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5da07433-7c1f-593e-8ba9-d8173551b171 with identifier: RU11910 to the API
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:56:13Z',
 'fuel_type': 'petrol',
 'id': '5da07433-7c1f-593e-8ba9-d8173551b171',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU11910',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 199256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-11',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU11910%27 HTTP/1.1" 200 None
2026-03-28 14:10:06 [auto1.es] INFO: Saving data for RU11910: {'auction_closing_time': 1774716973.0, 'created_time': 1773128849.082588, 'last_price_update_time': 1774707006.032872}
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RU11910') HTTP/1.1" 204 0
2026-03-28 14:10:06 [auto1.es] INFO: Found listing with ID: MR81111
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR81111%27 HTTP/1.1" 200 None
2026-03-28 14:10:06 [auto1.es] INFO: Scrape type for MR81111: 2
2026-03-28 14:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dac0f31e-0b44-5a5a-a24d-c677ee8ed09d with identifier: MR81111
2026-03-28 14:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac0f31e-0b44-5a5a-a24d-c677ee8ed09d with scrape type 2
2026-03-28 14:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dac0f31e-0b44-5a5a-a24d-c677ee8ed09d with scrape type 2
2026-03-28 14:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dac0f31e-0b44-5a5a-a24d-c677ee8ed09d, identifier: MR81111
2026-03-28 14:10:06 [auto1.es] INFO: Channel: 24h | Page: 50 | totalHits: 2697 | hits on page: 40
2026-03-28 14:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dac0f31e-0b44-5a5a-a24d-c677ee8ed09d with identifier: MR81111
2026-03-28 14:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dac0f31e-0b44-5a5a-a24d-c677ee8ed09d with identifier: MR81111
2026-03-28 14:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dac0f31e-0b44-5a5a-a24d-c677ee8ed09d with identifier: MR81111 to the API
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-28T16:51:25Z',
 'fuel_type': 'petrol',
 'id': 'dac0f31e-0b44-5a5a-a24d-c677ee8ed09d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR81111',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 14200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-20',
 'seller_name': None,
 'title': 'Ford Focus 2.3 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2023}
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR81111%27 HTTP/1.1" 200 None
2026-03-28 14:10:06 [auto1.es] INFO: Saving data for MR81111: {'auction_closing_time': 1774716685.0, 'created_time': 1773952462.878598, 'last_price_update_time': 1774707006.417247}
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MR81111') HTTP/1.1" 204 0
2026-03-28 14:10:06 [auto1.es] INFO: Found listing with ID: AG64385
2026-03-28 14:10:06 [auto1.es] INFO: Found listing with ID: DE89755
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE89755%27 HTTP/1.1" 200 None
2026-03-28 14:10:06 [auto1.es] INFO: Scrape type for DE89755: 2
2026-03-28 14:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ca7a6b5-fb8c-52f7-bfe4-a775c0dc1e22 with identifier: DE89755
2026-03-28 14:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ca7a6b5-fb8c-52f7-bfe4-a775c0dc1e22 with scrape type 2
2026-03-28 14:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ca7a6b5-fb8c-52f7-bfe4-a775c0dc1e22 with scrape type 2
2026-03-28 14:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ca7a6b5-fb8c-52f7-bfe4-a775c0dc1e22, identifier: DE89755
2026-03-28 14:10:06 [auto1.es] INFO: Found listing with ID: YV46157
2026-03-28 14:10:06 [auto1.es] INFO: Found listing with ID: MK48449
2026-03-28 14:10:06 [auto1.es] INFO: Found listing with ID: XA71436
2026-03-28 14:10:06 [auto1.es] INFO: Found listing with ID: VV60127
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV60127%27 HTTP/1.1" 200 None
2026-03-28 14:10:06 [auto1.es] INFO: Scrape type for VV60127: 2
2026-03-28 14:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af320b28-95ce-51db-b6ff-190c132fd8e2 with identifier: VV60127
2026-03-28 14:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af320b28-95ce-51db-b6ff-190c132fd8e2 with scrape type 2
2026-03-28 14:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af320b28-95ce-51db-b6ff-190c132fd8e2 with scrape type 2
2026-03-28 14:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af320b28-95ce-51db-b6ff-190c132fd8e2, identifier: VV60127
2026-03-28 14:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ca7a6b5-fb8c-52f7-bfe4-a775c0dc1e22 with identifier: DE89755
2026-03-28 14:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ca7a6b5-fb8c-52f7-bfe4-a775c0dc1e22 with identifier: DE89755
2026-03-28 14:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ca7a6b5-fb8c-52f7-bfe4-a775c0dc1e22 with identifier: DE89755 to the API
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:54:59Z',
 'fuel_type': 'diesel',
 'id': '1ca7a6b5-fb8c-52f7-bfe4-a775c0dc1e22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE89755',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 145963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2022}
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE89755%27 HTTP/1.1" 200 None
2026-03-28 14:10:06 [auto1.es] INFO: Saving data for DE89755: {'auction_closing_time': 1774716899.0, 'created_time': 1774382839.287883, 'last_price_update_time': 1774707006.889787}
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DE89755') HTTP/1.1" 204 0
2026-03-28 14:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af320b28-95ce-51db-b6ff-190c132fd8e2 with identifier: VV60127
2026-03-28 14:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af320b28-95ce-51db-b6ff-190c132fd8e2 with identifier: VV60127
2026-03-28 14:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af320b28-95ce-51db-b6ff-190c132fd8e2 with identifier: VV60127 to the API
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:56:34Z',
 'fuel_type': 'diesel',
 'id': 'af320b28-95ce-51db-b6ff-190c132fd8e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV60127',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 73343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-16',
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV60127%27 HTTP/1.1" 200 None
2026-03-28 14:10:07 [auto1.es] INFO: Saving data for VV60127: {'auction_closing_time': 1774716994.0, 'created_time': 1773691742.421294, 'last_price_update_time': 1774707007.277787}
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VV60127') HTTP/1.1" 204 0
2026-03-28 14:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:10:07 [auto1.es] INFO: Found listing with ID: FD55064
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD55064%27 HTTP/1.1" 200 None
2026-03-28 14:10:07 [auto1.es] INFO: Scrape type for FD55064: 2
2026-03-28 14:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e520b6-42c0-5402-b42c-be6c4d250245 with identifier: FD55064
2026-03-28 14:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e520b6-42c0-5402-b42c-be6c4d250245 with scrape type 2
2026-03-28 14:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e520b6-42c0-5402-b42c-be6c4d250245 with scrape type 2
2026-03-28 14:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 96e520b6-42c0-5402-b42c-be6c4d250245, identifier: FD55064
2026-03-28 14:10:07 [auto1.es] INFO: Found listing with ID: RD28906
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD28906%27 HTTP/1.1" 200 None
2026-03-28 14:10:07 [auto1.es] INFO: Scrape type for RD28906: 2
2026-03-28 14:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90584df2-649d-539f-bf65-c6274c333c32 with identifier: RD28906
2026-03-28 14:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90584df2-649d-539f-bf65-c6274c333c32 with scrape type 2
2026-03-28 14:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90584df2-649d-539f-bf65-c6274c333c32 with scrape type 2
2026-03-28 14:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 90584df2-649d-539f-bf65-c6274c333c32, identifier: RD28906
2026-03-28 14:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 96e520b6-42c0-5402-b42c-be6c4d250245 with identifier: FD55064
2026-03-28 14:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 96e520b6-42c0-5402-b42c-be6c4d250245 with identifier: FD55064
2026-03-28 14:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 96e520b6-42c0-5402-b42c-be6c4d250245 with identifier: FD55064 to the API
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:25:33Z',
 'fuel_type': 'diesel',
 'id': '96e520b6-42c0-5402-b42c-be6c4d250245',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD55064',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 222421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style XL',
 'transmission': 'automatic',
 'trim': 'Style XL',
 'year': 2022}
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD55064%27 HTTP/1.1" 200 None
2026-03-28 14:10:07 [auto1.es] INFO: Saving data for FD55064: {'auction_closing_time': 1774715133.0, 'created_time': 1773691840.504846, 'last_price_update_time': 1774707007.784527}
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FD55064') HTTP/1.1" 204 0
2026-03-28 14:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 90584df2-649d-539f-bf65-c6274c333c32 with identifier: RD28906
2026-03-28 14:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 90584df2-649d-539f-bf65-c6274c333c32 with identifier: RD28906
2026-03-28 14:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 90584df2-649d-539f-bf65-c6274c333c32 with identifier: RD28906 to the API
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:37:49Z',
 'fuel_type': 'diesel',
 'id': '90584df2-649d-539f-bf65-c6274c333c32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD28906',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 243340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Edition BlueMotion',
 'transmission': 'manual',
 'trim': 'Edition BlueMotion',
 'year': 2014}
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD28906%27 HTTP/1.1" 200 None
2026-03-28 14:10:08 [auto1.es] INFO: Saving data for RD28906: {'auction_closing_time': 1774715869.0, 'created_time': 1773929142.601649, 'last_price_update_time': 1774707008.044534}
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD28906') HTTP/1.1" 204 0
2026-03-28 14:10:08 [auto1.es] INFO: Found listing with ID: ZZ21581
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ21581%27 HTTP/1.1" 200 None
2026-03-28 14:10:08 [auto1.es] INFO: Scrape type for ZZ21581: 2
2026-03-28 14:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a948a81b-f9fb-5cc3-8664-135ccc1f0fa6 with identifier: ZZ21581
2026-03-28 14:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a948a81b-f9fb-5cc3-8664-135ccc1f0fa6 with scrape type 2
2026-03-28 14:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a948a81b-f9fb-5cc3-8664-135ccc1f0fa6 with scrape type 2
2026-03-28 14:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a948a81b-f9fb-5cc3-8664-135ccc1f0fa6, identifier: ZZ21581
2026-03-28 14:10:08 [auto1.es] INFO: Found listing with ID: YC39574
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC39574%27 HTTP/1.1" 200 None
2026-03-28 14:10:08 [auto1.es] INFO: Scrape type for YC39574: 2
2026-03-28 14:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d50ab3d5-3d83-528a-a704-1e02d1f3c857 with identifier: YC39574
2026-03-28 14:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d50ab3d5-3d83-528a-a704-1e02d1f3c857 with scrape type 2
2026-03-28 14:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d50ab3d5-3d83-528a-a704-1e02d1f3c857 with scrape type 2
2026-03-28 14:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d50ab3d5-3d83-528a-a704-1e02d1f3c857, identifier: YC39574
2026-03-28 14:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a948a81b-f9fb-5cc3-8664-135ccc1f0fa6 with identifier: ZZ21581
2026-03-28 14:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a948a81b-f9fb-5cc3-8664-135ccc1f0fa6 with identifier: ZZ21581
2026-03-28 14:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a948a81b-f9fb-5cc3-8664-135ccc1f0fa6 with identifier: ZZ21581 to the API
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:25:42Z',
 'fuel_type': 'diesel',
 'id': 'a948a81b-f9fb-5cc3-8664-135ccc1f0fa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ21581',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 18812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-27',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2025}
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ21581%27 HTTP/1.1" 200 None
2026-03-28 14:10:08 [auto1.es] INFO: Saving data for ZZ21581: {'auction_closing_time': 1774715142.0, 'created_time': 1773127633.299494, 'last_price_update_time': 1774707008.508391}
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZZ21581') HTTP/1.1" 204 0
2026-03-28 14:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d50ab3d5-3d83-528a-a704-1e02d1f3c857 with identifier: YC39574
2026-03-28 14:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d50ab3d5-3d83-528a-a704-1e02d1f3c857 with identifier: YC39574
2026-03-28 14:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d50ab3d5-3d83-528a-a704-1e02d1f3c857 with identifier: YC39574 to the API
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:32:13Z',
 'fuel_type': 'petrol',
 'id': 'd50ab3d5-3d83-528a-a704-1e02d1f3c857',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC39574',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 54846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-21',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam ecoFlex',
 'transmission': 'manual',
 'trim': 'Jam ecoFlex',
 'year': 2015}
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC39574%27 HTTP/1.1" 200 None
2026-03-28 14:10:08 [auto1.es] INFO: Saving data for YC39574: {'auction_closing_time': 1774715533.0, 'created_time': 1774620414.78005, 'last_price_update_time': 1774707008.772354}
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YC39574') HTTP/1.1" 204 0
2026-03-28 14:10:08 [auto1.es] INFO: Found listing with ID: UN59874
2026-03-28 14:10:08 [auto1.es] INFO: Found listing with ID: TS70412
2026-03-28 14:10:08 [auto1.es] INFO: Found listing with ID: LB05915
2026-03-28 14:10:08 [auto1.es] INFO: Found listing with ID: GU38907
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU38907%27 HTTP/1.1" 200 None
2026-03-28 14:10:08 [auto1.es] INFO: Scrape type for GU38907: 2
2026-03-28 14:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f5e28ac-4ab8-55bc-89b9-9f5fb8750eed with identifier: GU38907
2026-03-28 14:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f5e28ac-4ab8-55bc-89b9-9f5fb8750eed with scrape type 2
2026-03-28 14:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f5e28ac-4ab8-55bc-89b9-9f5fb8750eed with scrape type 2
2026-03-28 14:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9f5e28ac-4ab8-55bc-89b9-9f5fb8750eed, identifier: GU38907
2026-03-28 14:10:08 [auto1.es] INFO: Found listing with ID: ET46210
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET46210%27 HTTP/1.1" 200 None
2026-03-28 14:10:08 [auto1.es] INFO: Scrape type for ET46210: 2
2026-03-28 14:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec4ad27-6bac-587a-a5d1-19acf62cc69b with identifier: ET46210
2026-03-28 14:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec4ad27-6bac-587a-a5d1-19acf62cc69b with scrape type 2
2026-03-28 14:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec4ad27-6bac-587a-a5d1-19acf62cc69b with scrape type 2
2026-03-28 14:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eec4ad27-6bac-587a-a5d1-19acf62cc69b, identifier: ET46210
2026-03-28 14:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9f5e28ac-4ab8-55bc-89b9-9f5fb8750eed with identifier: GU38907
2026-03-28 14:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9f5e28ac-4ab8-55bc-89b9-9f5fb8750eed with identifier: GU38907
2026-03-28 14:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9f5e28ac-4ab8-55bc-89b9-9f5fb8750eed with identifier: GU38907 to the API
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:23:35Z',
 'fuel_type': 'petrol',
 'id': '9f5e28ac-4ab8-55bc-89b9-9f5fb8750eed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU38907',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 132957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-18',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU38907%27 HTTP/1.1" 200 None
2026-03-28 14:10:09 [auto1.es] INFO: Saving data for GU38907: {'auction_closing_time': 1774715015.0, 'created_time': 1774620389.815544, 'last_price_update_time': 1774707009.308341}
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GU38907') HTTP/1.1" 204 0
2026-03-28 14:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eec4ad27-6bac-587a-a5d1-19acf62cc69b with identifier: ET46210
2026-03-28 14:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eec4ad27-6bac-587a-a5d1-19acf62cc69b with identifier: ET46210
2026-03-28 14:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eec4ad27-6bac-587a-a5d1-19acf62cc69b with identifier: ET46210 to the API
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:00:50Z',
 'fuel_type': 'petrol',
 'id': 'eec4ad27-6bac-587a-a5d1-19acf62cc69b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET46210',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 117317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-21',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET46210%27 HTTP/1.1" 200 None
2026-03-28 14:10:09 [auto1.es] INFO: Saving data for ET46210: {'auction_closing_time': 1774713650.0, 'created_time': 1774620391.882109, 'last_price_update_time': 1774707009.647601}
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ET46210') HTTP/1.1" 204 0
2026-03-28 14:10:09 [auto1.es] INFO: Found listing with ID: ZD47887
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD47887%27 HTTP/1.1" 200 None
2026-03-28 14:10:09 [auto1.es] INFO: Scrape type for ZD47887: 2
2026-03-28 14:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 845ea5b3-49fd-514e-aa42-294ace58bb2b with identifier: ZD47887
2026-03-28 14:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 845ea5b3-49fd-514e-aa42-294ace58bb2b with scrape type 2
2026-03-28 14:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 845ea5b3-49fd-514e-aa42-294ace58bb2b with scrape type 2
2026-03-28 14:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 845ea5b3-49fd-514e-aa42-294ace58bb2b, identifier: ZD47887
2026-03-28 14:10:09 [auto1.es] INFO: Found listing with ID: WG59071
2026-03-28 14:10:09 [auto1.es] INFO: Found listing with ID: TF20925
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF20925%27 HTTP/1.1" 200 None
2026-03-28 14:10:09 [auto1.es] INFO: Scrape type for TF20925: 2
2026-03-28 14:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e91d8897-d6c8-5b32-9eec-0c0bbd879848 with identifier: TF20925
2026-03-28 14:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91d8897-d6c8-5b32-9eec-0c0bbd879848 with scrape type 2
2026-03-28 14:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e91d8897-d6c8-5b32-9eec-0c0bbd879848 with scrape type 2
2026-03-28 14:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e91d8897-d6c8-5b32-9eec-0c0bbd879848, identifier: TF20925
2026-03-28 14:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 845ea5b3-49fd-514e-aa42-294ace58bb2b with identifier: ZD47887
2026-03-28 14:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 845ea5b3-49fd-514e-aa42-294ace58bb2b with identifier: ZD47887
2026-03-28 14:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 845ea5b3-49fd-514e-aa42-294ace58bb2b with identifier: ZD47887 to the API
2026-03-28 14:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:58:13Z',
 'fuel_type': 'diesel',
 'id': '845ea5b3-49fd-514e-aa42-294ace58bb2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD47887',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 155754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-21',
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD47887%27 HTTP/1.1" 200 None
2026-03-28 14:10:10 [auto1.es] INFO: Saving data for ZD47887: {'auction_closing_time': 1774717093.0, 'created_time': 1774383026.552461, 'last_price_update_time': 1774707010.156384}
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZD47887') HTTP/1.1" 204 0
2026-03-28 14:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e91d8897-d6c8-5b32-9eec-0c0bbd879848 with identifier: TF20925
2026-03-28 14:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e91d8897-d6c8-5b32-9eec-0c0bbd879848 with identifier: TF20925
2026-03-28 14:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e91d8897-d6c8-5b32-9eec-0c0bbd879848 with identifier: TF20925 to the API
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-28T16:51:15Z',
 'fuel_type': 'diesel',
 'id': 'e91d8897-d6c8-5b32-9eec-0c0bbd879848',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF20925',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 572698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-27',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2012}
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF20925%27 HTTP/1.1" 200 None
2026-03-28 14:10:10 [auto1.es] INFO: Saving data for TF20925: {'auction_closing_time': 1774716675.0, 'created_time': 1774620418.314723, 'last_price_update_time': 1774707010.507033}
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TF20925') HTTP/1.1" 204 0
2026-03-28 14:10:10 [auto1.es] INFO: Found listing with ID: RX29075
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX29075%27 HTTP/1.1" 200 None
2026-03-28 14:10:10 [auto1.es] INFO: Scrape type for RX29075: 2
2026-03-28 14:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cf1867f-6666-538e-8621-f4efaaa3e24d with identifier: RX29075
2026-03-28 14:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cf1867f-6666-538e-8621-f4efaaa3e24d with scrape type 2
2026-03-28 14:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cf1867f-6666-538e-8621-f4efaaa3e24d with scrape type 2
2026-03-28 14:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9cf1867f-6666-538e-8621-f4efaaa3e24d, identifier: RX29075
2026-03-28 14:10:10 [auto1.es] INFO: Found listing with ID: JG54829
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG54829%27 HTTP/1.1" 200 None
2026-03-28 14:10:10 [auto1.es] INFO: Scrape type for JG54829: 2
2026-03-28 14:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3934e9cc-cbd6-59d0-99a5-6638b827fe40 with identifier: JG54829
2026-03-28 14:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3934e9cc-cbd6-59d0-99a5-6638b827fe40 with scrape type 2
2026-03-28 14:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3934e9cc-cbd6-59d0-99a5-6638b827fe40 with scrape type 2
2026-03-28 14:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3934e9cc-cbd6-59d0-99a5-6638b827fe40, identifier: JG54829
2026-03-28 14:10:10 [scrapy.extensions.logstats] INFO: Crawled 188 pages (at 22 pages/min), scraped 194 items (at 67 items/min)
2026-03-28 14:10:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-28 14:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9cf1867f-6666-538e-8621-f4efaaa3e24d with identifier: RX29075
2026-03-28 14:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9cf1867f-6666-538e-8621-f4efaaa3e24d with identifier: RX29075
2026-03-28 14:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9cf1867f-6666-538e-8621-f4efaaa3e24d with identifier: RX29075 to the API
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:43:13Z',
 'fuel_type': 'diesel',
 'id': '9cf1867f-6666-538e-8621-f4efaaa3e24d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX29075',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 157927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX29075%27 HTTP/1.1" 200 None
2026-03-28 14:10:10 [auto1.es] INFO: Saving data for RX29075: {'auction_closing_time': 1774716193.0, 'created_time': 1774620386.993093, 'last_price_update_time': 1774707010.97899}
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RX29075') HTTP/1.1" 204 0
2026-03-28 14:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3934e9cc-cbd6-59d0-99a5-6638b827fe40 with identifier: JG54829
2026-03-28 14:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3934e9cc-cbd6-59d0-99a5-6638b827fe40 with identifier: JG54829
2026-03-28 14:10:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3934e9cc-cbd6-59d0-99a5-6638b827fe40 with identifier: JG54829 to the API
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:31:51Z',
 'fuel_type': 'petrol',
 'id': '3934e9cc-cbd6-59d0-99a5-6638b827fe40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG54829',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 23584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-26',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2024}
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG54829%27 HTTP/1.1" 200 None
2026-03-28 14:10:11 [auto1.es] INFO: Saving data for JG54829: {'auction_closing_time': 1774715511.0, 'created_time': 1774382954.606383, 'last_price_update_time': 1774707011.233046}
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JG54829') HTTP/1.1" 204 0
2026-03-28 14:10:11 [auto1.es] INFO: Found listing with ID: DD64860
2026-03-28 14:10:11 [auto1.es] INFO: Found listing with ID: YC67276
2026-03-28 14:10:11 [auto1.es] INFO: Found listing with ID: BT53297
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT53297%27 HTTP/1.1" 200 None
2026-03-28 14:10:11 [auto1.es] INFO: Scrape type for BT53297: 2
2026-03-28 14:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with identifier: BT53297
2026-03-28 14:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with scrape type 2
2026-03-28 14:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with scrape type 2
2026-03-28 14:10:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644, identifier: BT53297
2026-03-28 14:10:11 [auto1.es] INFO: Found listing with ID: AS80806
2026-03-28 14:10:11 [auto1.es] INFO: Found listing with ID: ZG70058
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG70058%27 HTTP/1.1" 200 None
2026-03-28 14:10:11 [auto1.es] INFO: Scrape type for ZG70058: 2
2026-03-28 14:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f7dc521-0738-598e-98ea-90b9a70abe03 with identifier: ZG70058
2026-03-28 14:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f7dc521-0738-598e-98ea-90b9a70abe03 with scrape type 2
2026-03-28 14:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f7dc521-0738-598e-98ea-90b9a70abe03 with scrape type 2
2026-03-28 14:10:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4f7dc521-0738-598e-98ea-90b9a70abe03, identifier: ZG70058
2026-03-28 14:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with identifier: BT53297
2026-03-28 14:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with identifier: BT53297
2026-03-28 14:10:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with identifier: BT53297 to the API
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:01:32Z',
 'fuel_type': 'diesel',
 'id': '0dd5597b-f9ff-5c71-a6e1-53aaa0d51644',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT53297',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 126450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-19',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 Landmark Editon',
 'transmission': 'manual',
 'trim': 'Landmark Editon',
 'year': 2020}
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT53297%27 HTTP/1.1" 200 None
2026-03-28 14:10:11 [auto1.es] INFO: Saving data for BT53297: {'auction_closing_time': 1774713692.0, 'created_time': 1773691720.367163, 'last_price_update_time': 1774707011.765483}
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BT53297') HTTP/1.1" 204 0
2026-03-28 14:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4f7dc521-0738-598e-98ea-90b9a70abe03 with identifier: ZG70058
2026-03-28 14:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4f7dc521-0738-598e-98ea-90b9a70abe03 with identifier: ZG70058
2026-03-28 14:10:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4f7dc521-0738-598e-98ea-90b9a70abe03 with identifier: ZG70058 to the API
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 209,
 'expiration_date': '2026-03-28T16:07:21Z',
 'fuel_type': 'diesel',
 'id': '4f7dc521-0738-598e-98ea-90b9a70abe03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG70058',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 126191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-03',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Veloce Q4',
 'transmission': 'automatic',
 'trim': 'Veloce Q4',
 'year': 2022}
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG70058%27 HTTP/1.1" 200 None
2026-03-28 14:10:12 [auto1.es] INFO: Saving data for ZG70058: {'auction_closing_time': 1774714041.0, 'created_time': 1774382927.766386, 'last_price_update_time': 1774707012.025482}
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZG70058') HTTP/1.1" 204 0
2026-03-28 14:10:12 [auto1.es] INFO: Found listing with ID: EY80222
2026-03-28 14:10:12 [auto1.es] INFO: Found listing with ID: GJ06814
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ06814%27 HTTP/1.1" 200 None
2026-03-28 14:10:12 [auto1.es] INFO: Scrape type for GJ06814: 2
2026-03-28 14:10:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a2a6501-f3ca-5962-9471-f494494f6010 with identifier: GJ06814
2026-03-28 14:10:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a2a6501-f3ca-5962-9471-f494494f6010 with scrape type 2
2026-03-28 14:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a2a6501-f3ca-5962-9471-f494494f6010 with scrape type 2
2026-03-28 14:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2a2a6501-f3ca-5962-9471-f494494f6010, identifier: GJ06814
2026-03-28 14:10:12 [auto1.es] INFO: Found listing with ID: YH51023
2026-03-28 14:10:12 [auto1.es] INFO: Found listing with ID: CJ84501
2026-03-28 14:10:12 [auto1.es] INFO: Found listing with ID: ZT56570
2026-03-28 14:10:12 [auto1.es] INFO: Found listing with ID: XN30812
2026-03-28 14:10:12 [auto1.es] INFO: Found listing with ID: HH76274
2026-03-28 14:10:12 [auto1.es] INFO: Found listing with ID: LJ17115
2026-03-28 14:10:12 [auto1.es] INFO: Found listing with ID: FG05757
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG05757%27 HTTP/1.1" 200 None
2026-03-28 14:10:12 [auto1.es] INFO: Scrape type for FG05757: 2
2026-03-28 14:10:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88f51771-64e8-529c-ae30-45517eeeb68d with identifier: FG05757
2026-03-28 14:10:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f51771-64e8-529c-ae30-45517eeeb68d with scrape type 2
2026-03-28 14:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88f51771-64e8-529c-ae30-45517eeeb68d with scrape type 2
2026-03-28 14:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 88f51771-64e8-529c-ae30-45517eeeb68d, identifier: FG05757
2026-03-28 14:10:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2a2a6501-f3ca-5962-9471-f494494f6010 with identifier: GJ06814
2026-03-28 14:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2a2a6501-f3ca-5962-9471-f494494f6010 with identifier: GJ06814
2026-03-28 14:10:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2a2a6501-f3ca-5962-9471-f494494f6010 with identifier: GJ06814 to the API
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:19:03Z',
 'fuel_type': 'petrol',
 'id': '2a2a6501-f3ca-5962-9471-f494494f6010',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ06814',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Pajero',
 'odometer': 149082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-23',
 'seller_name': None,
 'title': 'Mitsubishi Pajero 1.8 1800 MPI Kayak',
 'transmission': 'manual',
 'trim': '1800 MPI Kayak',
 'year': 2002}
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ06814%27 HTTP/1.1" 200 None
2026-03-28 14:10:12 [auto1.es] INFO: Saving data for GJ06814: {'auction_closing_time': 1774714743.0, 'created_time': 1774620420.887165, 'last_price_update_time': 1774707012.506226}
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GJ06814') HTTP/1.1" 204 0
2026-03-28 14:10:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 88f51771-64e8-529c-ae30-45517eeeb68d with identifier: FG05757
2026-03-28 14:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 88f51771-64e8-529c-ae30-45517eeeb68d with identifier: FG05757
2026-03-28 14:10:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 88f51771-64e8-529c-ae30-45517eeeb68d with identifier: FG05757 to the API
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:42:07Z',
 'fuel_type': 'diesel',
 'id': '88f51771-64e8-529c-ae30-45517eeeb68d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG05757',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery',
 'odometer': 326811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-24',
 'seller_name': None,
 'title': 'Land Rover Discovery 2.7 Td V6 TD SE',
 'transmission': 'automatic',
 'trim': 'TD SE',
 'year': 2007}
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG05757%27 HTTP/1.1" 200 None
2026-03-28 14:10:12 [auto1.es] INFO: Saving data for FG05757: {'auction_closing_time': 1774716127.0, 'created_time': 1774620416.116274, 'last_price_update_time': 1774707012.868152}
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FG05757') HTTP/1.1" 204 0
2026-03-28 14:10:12 [auto1.es] INFO: Found listing with ID: YJ20703
2026-03-28 14:10:12 [auto1.es] INFO: Found listing with ID: LF19420
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF19420%27 HTTP/1.1" 200 None
2026-03-28 14:10:12 [auto1.es] INFO: Scrape type for LF19420: 2
2026-03-28 14:10:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b1beed6-73e6-5e95-988e-47ac82892165 with identifier: LF19420
2026-03-28 14:10:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b1beed6-73e6-5e95-988e-47ac82892165 with scrape type 2
2026-03-28 14:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b1beed6-73e6-5e95-988e-47ac82892165 with scrape type 2
2026-03-28 14:10:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b1beed6-73e6-5e95-988e-47ac82892165, identifier: LF19420
2026-03-28 14:10:13 [auto1.es] INFO: Found listing with ID: DB89419
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB89419%27 HTTP/1.1" 200 None
2026-03-28 14:10:14 [auto1.es] INFO: Scrape type for DB89419: 2
2026-03-28 14:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b80da904-4806-58cf-bb22-da085903a734 with identifier: DB89419
2026-03-28 14:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b80da904-4806-58cf-bb22-da085903a734 with scrape type 2
2026-03-28 14:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b80da904-4806-58cf-bb22-da085903a734 with scrape type 2
2026-03-28 14:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b80da904-4806-58cf-bb22-da085903a734, identifier: DB89419
2026-03-28 14:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b1beed6-73e6-5e95-988e-47ac82892165 with identifier: LF19420
2026-03-28 14:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b1beed6-73e6-5e95-988e-47ac82892165 with identifier: LF19420
2026-03-28 14:10:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b1beed6-73e6-5e95-988e-47ac82892165 with identifier: LF19420 to the API
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:40:02Z',
 'fuel_type': 'petrol',
 'id': '4b1beed6-73e6-5e95-988e-47ac82892165',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF19420',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '309',
 'odometer': 95666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1988-06-19',
 'seller_name': None,
 'title': 'Peugeot 309 1.4 GR',
 'transmission': 'manual',
 'trim': 'GR',
 'year': 1988}
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF19420%27 HTTP/1.1" 200 None
2026-03-28 14:10:14 [auto1.es] INFO: Saving data for LF19420: {'auction_closing_time': 1774716002.0, 'created_time': 1774620386.049641, 'last_price_update_time': 1774707014.542961}
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LF19420') HTTP/1.1" 204 0
2026-03-28 14:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b80da904-4806-58cf-bb22-da085903a734 with identifier: DB89419
2026-03-28 14:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b80da904-4806-58cf-bb22-da085903a734 with identifier: DB89419
2026-03-28 14:10:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b80da904-4806-58cf-bb22-da085903a734 with identifier: DB89419 to the API
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-28T16:24:52Z',
 'fuel_type': 'diesel',
 'id': 'b80da904-4806-58cf-bb22-da085903a734',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB89419',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 131872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-15',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2021}
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB89419%27 HTTP/1.1" 200 None
2026-03-28 14:10:14 [auto1.es] INFO: Saving data for DB89419: {'auction_closing_time': 1774715092.0, 'created_time': 1774361390.635686, 'last_price_update_time': 1774707014.820243}
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DB89419') HTTP/1.1" 204 0
2026-03-28 14:10:14 [auto1.es] INFO: Found listing with ID: RK37999
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK37999%27 HTTP/1.1" 200 None
2026-03-28 14:10:14 [auto1.es] INFO: Scrape type for RK37999: 2
2026-03-28 14:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9091c9a-3986-5c70-bf46-d65d14bb4264 with identifier: RK37999
2026-03-28 14:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9091c9a-3986-5c70-bf46-d65d14bb4264 with scrape type 2
2026-03-28 14:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9091c9a-3986-5c70-bf46-d65d14bb4264 with scrape type 2
2026-03-28 14:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b9091c9a-3986-5c70-bf46-d65d14bb4264, identifier: RK37999
2026-03-28 14:10:14 [auto1.es] INFO: Found listing with ID: LA57781
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA57781%27 HTTP/1.1" 200 None
2026-03-28 14:10:14 [auto1.es] INFO: Scrape type for LA57781: 2
2026-03-28 14:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26c31886-c431-561f-995c-ba8423ba6f60 with identifier: LA57781
2026-03-28 14:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c31886-c431-561f-995c-ba8423ba6f60 with scrape type 2
2026-03-28 14:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26c31886-c431-561f-995c-ba8423ba6f60 with scrape type 2
2026-03-28 14:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 26c31886-c431-561f-995c-ba8423ba6f60, identifier: LA57781
2026-03-28 14:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b9091c9a-3986-5c70-bf46-d65d14bb4264 with identifier: RK37999
2026-03-28 14:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b9091c9a-3986-5c70-bf46-d65d14bb4264 with identifier: RK37999
2026-03-28 14:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b9091c9a-3986-5c70-bf46-d65d14bb4264 with identifier: RK37999 to the API
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:51:35Z',
 'fuel_type': 'petrol',
 'id': 'b9091c9a-3986-5c70-bf46-d65d14bb4264',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK37999',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 106494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-22',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2015}
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK37999%27 HTTP/1.1" 200 None
2026-03-28 14:10:15 [auto1.es] INFO: Saving data for RK37999: {'auction_closing_time': 1774716695.0, 'created_time': 1774620399.017037, 'last_price_update_time': 1774707015.299218}
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RK37999') HTTP/1.1" 204 0
2026-03-28 14:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 26c31886-c431-561f-995c-ba8423ba6f60 with identifier: LA57781
2026-03-28 14:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 26c31886-c431-561f-995c-ba8423ba6f60 with identifier: LA57781
2026-03-28 14:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 26c31886-c431-561f-995c-ba8423ba6f60 with identifier: LA57781 to the API
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-28T16:00:18Z',
 'fuel_type': 'petrol',
 'id': '26c31886-c431-561f-995c-ba8423ba6f60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA57781',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Bayon',
 'odometer': 21338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-29',
 'seller_name': None,
 'title': 'Hyundai Bayon 1.2 Essence 2WD',
 'transmission': 'manual',
 'trim': 'Essence 2WD',
 'year': 2023}
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA57781%27 HTTP/1.1" 200 None
2026-03-28 14:10:15 [auto1.es] INFO: Saving data for LA57781: {'auction_closing_time': 1774713618.0, 'created_time': 1773129067.531546, 'last_price_update_time': 1774707015.61231}
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LA57781') HTTP/1.1" 204 0
2026-03-28 14:10:15 [auto1.es] INFO: Found listing with ID: VB75549
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB75549%27 HTTP/1.1" 200 None
2026-03-28 14:10:15 [auto1.es] INFO: Scrape type for VB75549: 2
2026-03-28 14:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 028870f6-21ef-5e28-a0e1-f166e354b94e with identifier: VB75549
2026-03-28 14:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 028870f6-21ef-5e28-a0e1-f166e354b94e with scrape type 2
2026-03-28 14:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 028870f6-21ef-5e28-a0e1-f166e354b94e with scrape type 2
2026-03-28 14:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 028870f6-21ef-5e28-a0e1-f166e354b94e, identifier: VB75549
2026-03-28 14:10:15 [auto1.es] INFO: Found listing with ID: RD28331
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD28331%27 HTTP/1.1" 200 None
2026-03-28 14:10:15 [auto1.es] INFO: Scrape type for RD28331: 2
2026-03-28 14:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79e2b6da-81cc-54ef-8577-c350450df61f with identifier: RD28331
2026-03-28 14:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79e2b6da-81cc-54ef-8577-c350450df61f with scrape type 2
2026-03-28 14:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79e2b6da-81cc-54ef-8577-c350450df61f with scrape type 2
2026-03-28 14:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 79e2b6da-81cc-54ef-8577-c350450df61f, identifier: RD28331
2026-03-28 14:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 028870f6-21ef-5e28-a0e1-f166e354b94e with identifier: VB75549
2026-03-28 14:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 028870f6-21ef-5e28-a0e1-f166e354b94e with identifier: VB75549
2026-03-28 14:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 028870f6-21ef-5e28-a0e1-f166e354b94e with identifier: VB75549 to the API
2026-03-28 14:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:15:59Z',
 'fuel_type': 'diesel',
 'id': '028870f6-21ef-5e28-a0e1-f166e354b94e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB75549',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 118402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-23',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2021}
2026-03-28 14:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB75549%27 HTTP/1.1" 200 None
2026-03-28 14:10:16 [auto1.es] INFO: Saving data for VB75549: {'auction_closing_time': 1774714559.0, 'created_time': 1774383041.450032, 'last_price_update_time': 1774707016.144059}
2026-03-28 14:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VB75549') HTTP/1.1" 204 0
2026-03-28 14:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 79e2b6da-81cc-54ef-8577-c350450df61f with identifier: RD28331
2026-03-28 14:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 79e2b6da-81cc-54ef-8577-c350450df61f with identifier: RD28331
2026-03-28 14:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 79e2b6da-81cc-54ef-8577-c350450df61f with identifier: RD28331 to the API
2026-03-28 14:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:02:46Z',
 'fuel_type': 'hybrid',
 'id': '79e2b6da-81cc-54ef-8577-c350450df61f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD28331',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 145087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD28331%27 HTTP/1.1" 200 None
2026-03-28 14:10:17 [auto1.es] INFO: Saving data for RD28331: {'auction_closing_time': 1774713766.0, 'created_time': 1774361410.288905, 'last_price_update_time': 1774707017.034282}
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD28331') HTTP/1.1" 204 0
2026-03-28 14:10:17 [auto1.es] INFO: Found listing with ID: KK99044
2026-03-28 14:10:17 [auto1.es] INFO: Found listing with ID: TW26676
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW26676%27 HTTP/1.1" 200 None
2026-03-28 14:10:17 [auto1.es] INFO: Scrape type for TW26676: 2
2026-03-28 14:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65a230ff-da2d-5c28-bfbb-7c909a10a361 with identifier: TW26676
2026-03-28 14:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a230ff-da2d-5c28-bfbb-7c909a10a361 with scrape type 2
2026-03-28 14:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65a230ff-da2d-5c28-bfbb-7c909a10a361 with scrape type 2
2026-03-28 14:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 65a230ff-da2d-5c28-bfbb-7c909a10a361, identifier: TW26676
2026-03-28 14:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 65a230ff-da2d-5c28-bfbb-7c909a10a361 with identifier: TW26676
2026-03-28 14:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 65a230ff-da2d-5c28-bfbb-7c909a10a361 with identifier: TW26676
2026-03-28 14:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 65a230ff-da2d-5c28-bfbb-7c909a10a361 with identifier: TW26676 to the API
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:26:14Z',
 'fuel_type': 'diesel',
 'id': '65a230ff-da2d-5c28-bfbb-7c909a10a361',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW26676',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 217375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-27',
 'seller_name': None,
 'title': 'Volkswagen Golf V 2.0 TDI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2005}
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW26676%27 HTTP/1.1" 200 None
2026-03-28 14:10:17 [auto1.es] INFO: Saving data for TW26676: {'auction_closing_time': 1774715174.0, 'created_time': 1774620406.887206, 'last_price_update_time': 1774707017.454001}
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TW26676') HTTP/1.1" 204 0
2026-03-28 14:10:17 [auto1.es] INFO: Found listing with ID: GP55698
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP55698%27 HTTP/1.1" 200 None
2026-03-28 14:10:17 [auto1.es] INFO: Scrape type for GP55698: 2
2026-03-28 14:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 577fc18d-b302-59f0-91dd-77fdf7dc569a with identifier: GP55698
2026-03-28 14:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 577fc18d-b302-59f0-91dd-77fdf7dc569a with scrape type 2
2026-03-28 14:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 577fc18d-b302-59f0-91dd-77fdf7dc569a with scrape type 2
2026-03-28 14:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 577fc18d-b302-59f0-91dd-77fdf7dc569a, identifier: GP55698
2026-03-28 14:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 577fc18d-b302-59f0-91dd-77fdf7dc569a with identifier: GP55698
2026-03-28 14:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 577fc18d-b302-59f0-91dd-77fdf7dc569a with identifier: GP55698
2026-03-28 14:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 577fc18d-b302-59f0-91dd-77fdf7dc569a with identifier: GP55698 to the API
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:25:28Z',
 'fuel_type': 'diesel',
 'id': '577fc18d-b302-59f0-91dd-77fdf7dc569a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP55698',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 106462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2022}
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP55698%27 HTTP/1.1" 200 None
2026-03-28 14:10:17 [auto1.es] INFO: Saving data for GP55698: {'auction_closing_time': 1774715128.0, 'created_time': 1773691813.187349, 'last_price_update_time': 1774707017.85468}
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GP55698') HTTP/1.1" 204 0
2026-03-28 14:10:17 [auto1.es] INFO: Found listing with ID: RG56357
2026-03-28 14:10:17 [auto1.es] INFO: Found listing with ID: SW63270
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW63270%27 HTTP/1.1" 200 None
2026-03-28 14:10:17 [auto1.es] INFO: Scrape type for SW63270: 2
2026-03-28 14:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14abc480-abf3-57b6-97a0-7553b015825d with identifier: SW63270
2026-03-28 14:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14abc480-abf3-57b6-97a0-7553b015825d with scrape type 2
2026-03-28 14:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14abc480-abf3-57b6-97a0-7553b015825d with scrape type 2
2026-03-28 14:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 14abc480-abf3-57b6-97a0-7553b015825d, identifier: SW63270
2026-03-28 14:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 14abc480-abf3-57b6-97a0-7553b015825d with identifier: SW63270
2026-03-28 14:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 14abc480-abf3-57b6-97a0-7553b015825d with identifier: SW63270
2026-03-28 14:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 14abc480-abf3-57b6-97a0-7553b015825d with identifier: SW63270 to the API
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:10:18Z',
 'fuel_type': 'diesel',
 'id': '14abc480-abf3-57b6-97a0-7553b015825d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW63270',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 159785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW63270%27 HTTP/1.1" 200 None
2026-03-28 14:10:18 [auto1.es] INFO: Saving data for SW63270: {'auction_closing_time': 1774714218.0, 'created_time': 1774383050.669413, 'last_price_update_time': 1774707018.229348}
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SW63270') HTTP/1.1" 204 0
2026-03-28 14:10:18 [auto1.es] INFO: Found listing with ID: FH92259
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH92259%27 HTTP/1.1" 200 None
2026-03-28 14:10:18 [auto1.es] INFO: Scrape type for FH92259: 2
2026-03-28 14:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be16b84b-b737-53f4-8bc0-6f80a60fb849 with identifier: FH92259
2026-03-28 14:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be16b84b-b737-53f4-8bc0-6f80a60fb849 with scrape type 2
2026-03-28 14:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be16b84b-b737-53f4-8bc0-6f80a60fb849 with scrape type 2
2026-03-28 14:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be16b84b-b737-53f4-8bc0-6f80a60fb849, identifier: FH92259
2026-03-28 14:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be16b84b-b737-53f4-8bc0-6f80a60fb849 with identifier: FH92259
2026-03-28 14:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be16b84b-b737-53f4-8bc0-6f80a60fb849 with identifier: FH92259
2026-03-28 14:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be16b84b-b737-53f4-8bc0-6f80a60fb849 with identifier: FH92259 to the API
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:05:33Z',
 'fuel_type': 'hybrid',
 'id': 'be16b84b-b737-53f4-8bc0-6f80a60fb849',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH92259',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 28152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-12',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T4 Recharge Plug-in Hybrid Plus Bright 2WD',
 'transmission': 'automatic',
 'trim': 'Plus Bright 2WD',
 'year': 2023}
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH92259%27 HTTP/1.1" 200 None
2026-03-28 14:10:18 [auto1.es] INFO: Saving data for FH92259: {'auction_closing_time': 1774713933.0, 'created_time': 1773691775.956429, 'last_price_update_time': 1774707018.714793}
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FH92259') HTTP/1.1" 204 0
2026-03-28 14:10:18 [auto1.es] INFO: Found listing with ID: WN06367
2026-03-28 14:10:18 [auto1.es] INFO: Found listing with ID: HM29961
2026-03-28 14:10:18 [auto1.es] INFO: Found listing with ID: XC57294
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC57294%27 HTTP/1.1" 200 None
2026-03-28 14:10:18 [auto1.es] INFO: Scrape type for XC57294: 2
2026-03-28 14:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcc41424-567b-5257-9008-eabf2171eec6 with identifier: XC57294
2026-03-28 14:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcc41424-567b-5257-9008-eabf2171eec6 with scrape type 2
2026-03-28 14:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcc41424-567b-5257-9008-eabf2171eec6 with scrape type 2
2026-03-28 14:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fcc41424-567b-5257-9008-eabf2171eec6, identifier: XC57294
2026-03-28 14:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fcc41424-567b-5257-9008-eabf2171eec6 with identifier: XC57294
2026-03-28 14:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fcc41424-567b-5257-9008-eabf2171eec6 with identifier: XC57294
2026-03-28 14:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fcc41424-567b-5257-9008-eabf2171eec6 with identifier: XC57294 to the API
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:45:16Z',
 'fuel_type': 'petrol',
 'id': 'fcc41424-567b-5257-9008-eabf2171eec6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC57294',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 175272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-25',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2023}
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC57294%27 HTTP/1.1" 200 None
2026-03-28 14:10:19 [auto1.es] INFO: Saving data for XC57294: {'auction_closing_time': 1774716316.0, 'created_time': 1773691845.846177, 'last_price_update_time': 1774707019.118503}
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XC57294') HTTP/1.1" 204 0
2026-03-28 14:10:19 [auto1.es] INFO: Found listing with ID: EU98432
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU98432%27 HTTP/1.1" 200 None
2026-03-28 14:10:19 [auto1.es] INFO: Scrape type for EU98432: 2
2026-03-28 14:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecab1467-c357-50b8-bfb8-e2cb39e8028e with identifier: EU98432
2026-03-28 14:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecab1467-c357-50b8-bfb8-e2cb39e8028e with scrape type 2
2026-03-28 14:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecab1467-c357-50b8-bfb8-e2cb39e8028e with scrape type 2
2026-03-28 14:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ecab1467-c357-50b8-bfb8-e2cb39e8028e, identifier: EU98432
2026-03-28 14:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ecab1467-c357-50b8-bfb8-e2cb39e8028e with identifier: EU98432
2026-03-28 14:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ecab1467-c357-50b8-bfb8-e2cb39e8028e with identifier: EU98432
2026-03-28 14:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ecab1467-c357-50b8-bfb8-e2cb39e8028e with identifier: EU98432 to the API
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:14:36Z',
 'fuel_type': 'diesel',
 'id': 'ecab1467-c357-50b8-bfb8-e2cb39e8028e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU98432',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 169300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'BMW X5 sDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU98432%27 HTTP/1.1" 200 None
2026-03-28 14:10:19 [auto1.es] INFO: Saving data for EU98432: {'auction_closing_time': 1774714476.0, 'created_time': 1774015736.321225, 'last_price_update_time': 1774707019.531543}
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EU98432') HTTP/1.1" 204 0
2026-03-28 14:10:19 [auto1.es] INFO: Found listing with ID: RY15229
2026-03-28 14:10:19 [auto1.es] INFO: Found listing with ID: DW75083
2026-03-28 14:10:19 [auto1.es] INFO: Found listing with ID: RL87551
2026-03-28 14:10:19 [auto1.es] INFO: Found listing with ID: KN45266
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN45266%27 HTTP/1.1" 200 None
2026-03-28 14:10:19 [auto1.es] INFO: Scrape type for KN45266: 2
2026-03-28 14:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 382b03e7-46a9-562f-bca7-f6469bf85e06 with identifier: KN45266
2026-03-28 14:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 382b03e7-46a9-562f-bca7-f6469bf85e06 with scrape type 2
2026-03-28 14:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 382b03e7-46a9-562f-bca7-f6469bf85e06 with scrape type 2
2026-03-28 14:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 382b03e7-46a9-562f-bca7-f6469bf85e06, identifier: KN45266
2026-03-28 14:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 382b03e7-46a9-562f-bca7-f6469bf85e06 with identifier: KN45266
2026-03-28 14:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 382b03e7-46a9-562f-bca7-f6469bf85e06 with identifier: KN45266
2026-03-28 14:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 382b03e7-46a9-562f-bca7-f6469bf85e06 with identifier: KN45266 to the API
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:02:59Z',
 'fuel_type': 'diesel',
 'id': '382b03e7-46a9-562f-bca7-f6469bf85e06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN45266',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 191912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-29',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Equilibre',
 'transmission': 'manual',
 'trim': 'Equilibre',
 'year': 2023}
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN45266%27 HTTP/1.1" 200 None
2026-03-28 14:10:19 [auto1.es] INFO: Saving data for KN45266: {'auction_closing_time': 1774713779.0, 'created_time': 1773691787.228413, 'last_price_update_time': 1774707019.913332}
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KN45266') HTTP/1.1" 204 0
2026-03-28 14:10:19 [auto1.es] INFO: Found listing with ID: EL62965
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL62965%27 HTTP/1.1" 200 None
2026-03-28 14:10:19 [auto1.es] INFO: Scrape type for EL62965: 2
2026-03-28 14:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d1eb29f-1da8-5d4b-8896-a1e204c9d823 with identifier: EL62965
2026-03-28 14:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d1eb29f-1da8-5d4b-8896-a1e204c9d823 with scrape type 2
2026-03-28 14:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d1eb29f-1da8-5d4b-8896-a1e204c9d823 with scrape type 2
2026-03-28 14:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3d1eb29f-1da8-5d4b-8896-a1e204c9d823, identifier: EL62965
2026-03-28 14:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3d1eb29f-1da8-5d4b-8896-a1e204c9d823 with identifier: EL62965
2026-03-28 14:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3d1eb29f-1da8-5d4b-8896-a1e204c9d823 with identifier: EL62965
2026-03-28 14:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3d1eb29f-1da8-5d4b-8896-a1e204c9d823 with identifier: EL62965 to the API
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:09:48Z',
 'fuel_type': 'diesel',
 'id': '3d1eb29f-1da8-5d4b-8896-a1e204c9d823',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL62965',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 176990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-09',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2021}
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL62965%27 HTTP/1.1" 200 None
2026-03-28 14:10:20 [auto1.es] INFO: Saving data for EL62965: {'auction_closing_time': 1774714188.0, 'created_time': 1774382872.77267, 'last_price_update_time': 1774707020.292979}
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EL62965') HTTP/1.1" 204 0
2026-03-28 14:10:20 [auto1.es] INFO: Found listing with ID: XG96540
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG96540%27 HTTP/1.1" 200 None
2026-03-28 14:10:20 [auto1.es] INFO: Scrape type for XG96540: 2
2026-03-28 14:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c4ec0f0-79f2-5790-b1a1-b2404642130c with identifier: XG96540
2026-03-28 14:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c4ec0f0-79f2-5790-b1a1-b2404642130c with scrape type 2
2026-03-28 14:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c4ec0f0-79f2-5790-b1a1-b2404642130c with scrape type 2
2026-03-28 14:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c4ec0f0-79f2-5790-b1a1-b2404642130c, identifier: XG96540
2026-03-28 14:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c4ec0f0-79f2-5790-b1a1-b2404642130c with identifier: XG96540
2026-03-28 14:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c4ec0f0-79f2-5790-b1a1-b2404642130c with identifier: XG96540
2026-03-28 14:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4c4ec0f0-79f2-5790-b1a1-b2404642130c with identifier: XG96540 to the API
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:48:17Z',
 'fuel_type': 'diesel',
 'id': '4c4ec0f0-79f2-5790-b1a1-b2404642130c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG96540',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 138264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2020}
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG96540%27 HTTP/1.1" 200 None
2026-03-28 14:10:20 [auto1.es] INFO: Saving data for XG96540: {'auction_closing_time': 1774716497.0, 'created_time': 1773691823.738235, 'last_price_update_time': 1774707020.665203}
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XG96540') HTTP/1.1" 204 0
2026-03-28 14:10:20 [auto1.es] INFO: Found listing with ID: AB25333
2026-03-28 14:10:20 [auto1.es] INFO: Found listing with ID: WG96659
2026-03-28 14:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:10:47 [auto1.es] INFO: Channel: 24h | Page: 51 | totalHits: 2697 | hits on page: 40
2026-03-28 14:10:47 [auto1.es] INFO: Found listing with ID: JM59673
2026-03-28 14:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM59673%27 HTTP/1.1" 200 None
2026-03-28 14:10:47 [auto1.es] INFO: Scrape type for JM59673: 2
2026-03-28 14:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 942b41c7-bf38-59b4-8e68-148081097202 with identifier: JM59673
2026-03-28 14:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 942b41c7-bf38-59b4-8e68-148081097202 with scrape type 2
2026-03-28 14:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 942b41c7-bf38-59b4-8e68-148081097202 with scrape type 2
2026-03-28 14:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 942b41c7-bf38-59b4-8e68-148081097202, identifier: JM59673
2026-03-28 14:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 942b41c7-bf38-59b4-8e68-148081097202 with identifier: JM59673
2026-03-28 14:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 942b41c7-bf38-59b4-8e68-148081097202 with identifier: JM59673
2026-03-28 14:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 942b41c7-bf38-59b4-8e68-148081097202 with identifier: JM59673 to the API
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:48:15Z',
 'fuel_type': 'diesel',
 'id': '942b41c7-bf38-59b4-8e68-148081097202',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM59673',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 123007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2022}
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM59673%27 HTTP/1.1" 200 None
2026-03-28 14:10:48 [auto1.es] INFO: Saving data for JM59673: {'auction_closing_time': 1774716495.0, 'created_time': 1774620417.764249, 'last_price_update_time': 1774707048.223043}
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JM59673') HTTP/1.1" 204 0
2026-03-28 14:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:10:48 [auto1.es] INFO: Found listing with ID: GL31739
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL31739%27 HTTP/1.1" 200 None
2026-03-28 14:10:48 [auto1.es] INFO: Scrape type for GL31739: 2
2026-03-28 14:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e122dd8-9993-58cc-922e-fabfdd7f32d2 with identifier: GL31739
2026-03-28 14:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e122dd8-9993-58cc-922e-fabfdd7f32d2 with scrape type 2
2026-03-28 14:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e122dd8-9993-58cc-922e-fabfdd7f32d2 with scrape type 2
2026-03-28 14:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7e122dd8-9993-58cc-922e-fabfdd7f32d2, identifier: GL31739
2026-03-28 14:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7e122dd8-9993-58cc-922e-fabfdd7f32d2 with identifier: GL31739
2026-03-28 14:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7e122dd8-9993-58cc-922e-fabfdd7f32d2 with identifier: GL31739
2026-03-28 14:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7e122dd8-9993-58cc-922e-fabfdd7f32d2 with identifier: GL31739 to the API
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:57:02Z',
 'fuel_type': 'hybrid',
 'id': '7e122dd8-9993-58cc-922e-fabfdd7f32d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL31739',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Camry',
 'odometer': 342243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-22',
 'seller_name': None,
 'title': 'Toyota Camry 2.5 Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2020}
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL31739%27 HTTP/1.1" 200 None
2026-03-28 14:10:48 [auto1.es] INFO: Saving data for GL31739: {'auction_closing_time': 1774717022.0, 'created_time': 1774361364.469162, 'last_price_update_time': 1774707048.593093}
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GL31739') HTTP/1.1" 204 0
2026-03-28 14:10:48 [auto1.es] INFO: Found listing with ID: ZB83445
2026-03-28 14:10:48 [auto1.es] INFO: Found listing with ID: EE09579
2026-03-28 14:10:48 [auto1.es] INFO: Found listing with ID: ZL80540
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL80540%27 HTTP/1.1" 200 None
2026-03-28 14:10:48 [auto1.es] INFO: Scrape type for ZL80540: 2
2026-03-28 14:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 186f73d9-8486-5d5f-92e8-8a38cdf151bd with identifier: ZL80540
2026-03-28 14:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 186f73d9-8486-5d5f-92e8-8a38cdf151bd with scrape type 2
2026-03-28 14:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 186f73d9-8486-5d5f-92e8-8a38cdf151bd with scrape type 2
2026-03-28 14:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 186f73d9-8486-5d5f-92e8-8a38cdf151bd, identifier: ZL80540
2026-03-28 14:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 186f73d9-8486-5d5f-92e8-8a38cdf151bd with identifier: ZL80540
2026-03-28 14:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 186f73d9-8486-5d5f-92e8-8a38cdf151bd with identifier: ZL80540
2026-03-28 14:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 186f73d9-8486-5d5f-92e8-8a38cdf151bd with identifier: ZL80540 to the API
2026-03-28 14:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:15:42Z',
 'fuel_type': 'petrol',
 'id': '186f73d9-8486-5d5f-92e8-8a38cdf151bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL80540',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 87993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-04',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Turbo SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2020}
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL80540%27 HTTP/1.1" 200 None
2026-03-28 14:10:49 [auto1.es] INFO: Saving data for ZL80540: {'auction_closing_time': 1774714542.0, 'created_time': 1773691828.541592, 'last_price_update_time': 1774707049.141189}
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL80540') HTTP/1.1" 204 0
2026-03-28 14:10:49 [auto1.es] INFO: Found listing with ID: PY12516
2026-03-28 14:10:49 [auto1.es] INFO: Found listing with ID: ZY07880
2026-03-28 14:10:49 [auto1.es] INFO: Found listing with ID: UG14230
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG14230%27 HTTP/1.1" 200 None
2026-03-28 14:10:49 [auto1.es] INFO: Scrape type for UG14230: 2
2026-03-28 14:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 623cfb79-11bc-5853-9b83-96c04d204c00 with identifier: UG14230
2026-03-28 14:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 623cfb79-11bc-5853-9b83-96c04d204c00 with scrape type 2
2026-03-28 14:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 623cfb79-11bc-5853-9b83-96c04d204c00 with scrape type 2
2026-03-28 14:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 623cfb79-11bc-5853-9b83-96c04d204c00, identifier: UG14230
2026-03-28 14:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 623cfb79-11bc-5853-9b83-96c04d204c00 with identifier: UG14230
2026-03-28 14:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 623cfb79-11bc-5853-9b83-96c04d204c00 with identifier: UG14230
2026-03-28 14:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 623cfb79-11bc-5853-9b83-96c04d204c00 with identifier: UG14230 to the API
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:55:18Z',
 'fuel_type': 'petrol',
 'id': '623cfb79-11bc-5853-9b83-96c04d204c00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG14230',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 67256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-17',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG14230%27 HTTP/1.1" 200 None
2026-03-28 14:10:49 [auto1.es] INFO: Saving data for UG14230: {'auction_closing_time': 1774716918.0, 'created_time': 1773918447.332907, 'last_price_update_time': 1774707049.530493}
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UG14230') HTTP/1.1" 204 0
2026-03-28 14:10:49 [auto1.es] INFO: Found listing with ID: WD56273
2026-03-28 14:10:49 [auto1.es] INFO: Found listing with ID: WJ13059
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ13059%27 HTTP/1.1" 200 None
2026-03-28 14:10:49 [auto1.es] INFO: Scrape type for WJ13059: 2
2026-03-28 14:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a1efd9f-e4bc-5227-840c-9759c457bc9a with identifier: WJ13059
2026-03-28 14:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a1efd9f-e4bc-5227-840c-9759c457bc9a with scrape type 2
2026-03-28 14:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a1efd9f-e4bc-5227-840c-9759c457bc9a with scrape type 2
2026-03-28 14:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8a1efd9f-e4bc-5227-840c-9759c457bc9a, identifier: WJ13059
2026-03-28 14:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8a1efd9f-e4bc-5227-840c-9759c457bc9a with identifier: WJ13059
2026-03-28 14:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8a1efd9f-e4bc-5227-840c-9759c457bc9a with identifier: WJ13059
2026-03-28 14:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8a1efd9f-e4bc-5227-840c-9759c457bc9a with identifier: WJ13059 to the API
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:55:17Z',
 'fuel_type': 'diesel',
 'id': '8a1efd9f-e4bc-5227-840c-9759c457bc9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ13059',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 188546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-14',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ13059%27 HTTP/1.1" 200 None
2026-03-28 14:10:49 [auto1.es] INFO: Saving data for WJ13059: {'auction_closing_time': 1774716917.0, 'created_time': 1774620442.729393, 'last_price_update_time': 1774707049.92001}
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WJ13059') HTTP/1.1" 204 0
2026-03-28 14:10:50 [auto1.es] INFO: Found listing with ID: PB42278
2026-03-28 14:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB42278%27 HTTP/1.1" 200 None
2026-03-28 14:10:50 [auto1.es] INFO: Scrape type for PB42278: 2
2026-03-28 14:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7807f7f-72ea-5f4e-8afb-386f63a0e8c2 with identifier: PB42278
2026-03-28 14:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7807f7f-72ea-5f4e-8afb-386f63a0e8c2 with scrape type 2
2026-03-28 14:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7807f7f-72ea-5f4e-8afb-386f63a0e8c2 with scrape type 2
2026-03-28 14:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d7807f7f-72ea-5f4e-8afb-386f63a0e8c2, identifier: PB42278
2026-03-28 14:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d7807f7f-72ea-5f4e-8afb-386f63a0e8c2 with identifier: PB42278
2026-03-28 14:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d7807f7f-72ea-5f4e-8afb-386f63a0e8c2 with identifier: PB42278
2026-03-28 14:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d7807f7f-72ea-5f4e-8afb-386f63a0e8c2 with identifier: PB42278 to the API
2026-03-28 14:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:15Z',
 'fuel_type': 'diesel',
 'id': 'd7807f7f-72ea-5f4e-8afb-386f63a0e8c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB42278',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 68590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-11',
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2026-03-28 14:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB42278%27 HTTP/1.1" 200 None
2026-03-28 14:10:51 [auto1.es] INFO: Saving data for PB42278: {'auction_closing_time': 1774715355.0, 'created_time': 1773691828.064005, 'last_price_update_time': 1774707051.091358}
2026-03-28 14:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PB42278') HTTP/1.1" 204 0
2026-03-28 14:10:51 [auto1.es] INFO: Found listing with ID: GH53615
2026-03-28 14:10:51 [auto1.es] INFO: Found listing with ID: TD30027
2026-03-28 14:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD30027%27 HTTP/1.1" 200 None
2026-03-28 14:10:51 [auto1.es] INFO: Scrape type for TD30027: 2
2026-03-28 14:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 148e8eb8-f05d-59c1-91ce-e84952759f09 with identifier: TD30027
2026-03-28 14:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 148e8eb8-f05d-59c1-91ce-e84952759f09 with scrape type 2
2026-03-28 14:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 148e8eb8-f05d-59c1-91ce-e84952759f09 with scrape type 2
2026-03-28 14:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 148e8eb8-f05d-59c1-91ce-e84952759f09, identifier: TD30027
2026-03-28 14:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 148e8eb8-f05d-59c1-91ce-e84952759f09 with identifier: TD30027
2026-03-28 14:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 148e8eb8-f05d-59c1-91ce-e84952759f09 with identifier: TD30027
2026-03-28 14:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 148e8eb8-f05d-59c1-91ce-e84952759f09 with identifier: TD30027 to the API
2026-03-28 14:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:06:17Z',
 'fuel_type': 'petrol',
 'id': '148e8eb8-f05d-59c1-91ce-e84952759f09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD30027',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 70517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-26',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2023}
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD30027%27 HTTP/1.1" 200 None
2026-03-28 14:10:52 [auto1.es] INFO: Saving data for TD30027: {'auction_closing_time': 1774713977.0, 'created_time': 1774037425.653103, 'last_price_update_time': 1774707052.078365}
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TD30027') HTTP/1.1" 204 0
2026-03-28 14:10:52 [auto1.es] INFO: Found listing with ID: FA27463
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA27463%27 HTTP/1.1" 200 None
2026-03-28 14:10:52 [auto1.es] INFO: Scrape type for FA27463: 2
2026-03-28 14:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2dc1a57-4c40-591e-a071-8cede416cd01 with identifier: FA27463
2026-03-28 14:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2dc1a57-4c40-591e-a071-8cede416cd01 with scrape type 2
2026-03-28 14:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2dc1a57-4c40-591e-a071-8cede416cd01 with scrape type 2
2026-03-28 14:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f2dc1a57-4c40-591e-a071-8cede416cd01, identifier: FA27463
2026-03-28 14:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f2dc1a57-4c40-591e-a071-8cede416cd01 with identifier: FA27463
2026-03-28 14:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f2dc1a57-4c40-591e-a071-8cede416cd01 with identifier: FA27463
2026-03-28 14:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f2dc1a57-4c40-591e-a071-8cede416cd01 with identifier: FA27463 to the API
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:19:29Z',
 'fuel_type': 'petrol',
 'id': 'f2dc1a57-4c40-591e-a071-8cede416cd01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA27463',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 132174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-13',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Selective Start/Stop',
 'transmission': 'manual',
 'trim': 'Selective Start/Stop',
 'year': 2017}
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA27463%27 HTTP/1.1" 200 None
2026-03-28 14:10:52 [auto1.es] INFO: Saving data for FA27463: {'auction_closing_time': 1774714769.0, 'created_time': 1773131950.044609, 'last_price_update_time': 1774707052.452148}
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FA27463') HTTP/1.1" 204 0
2026-03-28 14:10:52 [auto1.es] INFO: Found listing with ID: MR66674
2026-03-28 14:10:52 [auto1.es] INFO: Found listing with ID: FA20187
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA20187%27 HTTP/1.1" 200 None
2026-03-28 14:10:52 [auto1.es] INFO: Scrape type for FA20187: 2
2026-03-28 14:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4fbb307-a7c0-56f5-85c7-628dc4304fbf with identifier: FA20187
2026-03-28 14:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4fbb307-a7c0-56f5-85c7-628dc4304fbf with scrape type 2
2026-03-28 14:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4fbb307-a7c0-56f5-85c7-628dc4304fbf with scrape type 2
2026-03-28 14:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4fbb307-a7c0-56f5-85c7-628dc4304fbf, identifier: FA20187
2026-03-28 14:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4fbb307-a7c0-56f5-85c7-628dc4304fbf with identifier: FA20187
2026-03-28 14:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4fbb307-a7c0-56f5-85c7-628dc4304fbf with identifier: FA20187
2026-03-28 14:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e4fbb307-a7c0-56f5-85c7-628dc4304fbf with identifier: FA20187 to the API
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:01:40Z',
 'fuel_type': 'hybrid',
 'id': 'e4fbb307-a7c0-56f5-85c7-628dc4304fbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA20187',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 33730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-22',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2024}
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA20187%27 HTTP/1.1" 200 None
2026-03-28 14:10:52 [auto1.es] INFO: Saving data for FA20187: {'auction_closing_time': 1774713700.0, 'created_time': 1773691788.851917, 'last_price_update_time': 1774707052.852283}
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FA20187') HTTP/1.1" 204 0
2026-03-28 14:10:52 [auto1.es] INFO: Found listing with ID: XB66018
2026-03-28 14:10:52 [auto1.es] INFO: Found listing with ID: ES48862
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES48862%27 HTTP/1.1" 200 None
2026-03-28 14:10:52 [auto1.es] INFO: Scrape type for ES48862: 0
2026-03-28 14:10:52 [auto1.es] INFO: Found listing with ID: AN82065
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN82065%27 HTTP/1.1" 200 None
2026-03-28 14:10:52 [auto1.es] INFO: Scrape type for AN82065: 2
2026-03-28 14:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64265824-8360-5105-84ce-4084155e60eb with identifier: AN82065
2026-03-28 14:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64265824-8360-5105-84ce-4084155e60eb with scrape type 2
2026-03-28 14:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64265824-8360-5105-84ce-4084155e60eb with scrape type 2
2026-03-28 14:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 64265824-8360-5105-84ce-4084155e60eb, identifier: AN82065
2026-03-28 14:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 64265824-8360-5105-84ce-4084155e60eb with identifier: AN82065
2026-03-28 14:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 64265824-8360-5105-84ce-4084155e60eb with identifier: AN82065
2026-03-28 14:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 64265824-8360-5105-84ce-4084155e60eb with identifier: AN82065 to the API
2026-03-28 14:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:41:32Z',
 'fuel_type': 'diesel',
 'id': '64265824-8360-5105-84ce-4084155e60eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN82065',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 137964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 14:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN82065%27 HTTP/1.1" 200 None
2026-03-28 14:10:53 [auto1.es] INFO: Saving data for AN82065: {'auction_closing_time': 1774716092.0, 'created_time': 1773691796.531523, 'last_price_update_time': 1774707053.257301}
2026-03-28 14:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AN82065') HTTP/1.1" 204 0
2026-03-28 14:10:53 [auto1.es] INFO: Found listing with ID: AP65187
2026-03-28 14:10:53 [auto1.es] INFO: Found listing with ID: EZ05662
2026-03-28 14:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ05662%27 HTTP/1.1" 200 None
2026-03-28 14:10:53 [auto1.es] INFO: Scrape type for EZ05662: 2
2026-03-28 14:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3385980a-0819-506e-ae0f-89dbd42702a9 with identifier: EZ05662
2026-03-28 14:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3385980a-0819-506e-ae0f-89dbd42702a9 with scrape type 2
2026-03-28 14:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3385980a-0819-506e-ae0f-89dbd42702a9 with scrape type 2
2026-03-28 14:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3385980a-0819-506e-ae0f-89dbd42702a9, identifier: EZ05662
2026-03-28 14:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3385980a-0819-506e-ae0f-89dbd42702a9 with identifier: EZ05662
2026-03-28 14:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3385980a-0819-506e-ae0f-89dbd42702a9 with identifier: EZ05662
2026-03-28 14:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3385980a-0819-506e-ae0f-89dbd42702a9 with identifier: EZ05662 to the API
2026-03-28 14:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:39Z',
 'fuel_type': 'diesel',
 'id': '3385980a-0819-506e-ae0f-89dbd42702a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ05662',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 16802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-25',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2024}
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ05662%27 HTTP/1.1" 200 None
2026-03-28 14:10:54 [auto1.es] INFO: Saving data for EZ05662: {'auction_closing_time': 1774717059.0, 'created_time': 1774620411.388966, 'last_price_update_time': 1774707054.067077}
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EZ05662') HTTP/1.1" 204 0
2026-03-28 14:10:54 [auto1.es] INFO: Found listing with ID: GR17806
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR17806%27 HTTP/1.1" 200 None
2026-03-28 14:10:54 [auto1.es] INFO: Scrape type for GR17806: 2
2026-03-28 14:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c73d85c-936c-52f1-89c9-bc502bc79539 with identifier: GR17806
2026-03-28 14:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c73d85c-936c-52f1-89c9-bc502bc79539 with scrape type 2
2026-03-28 14:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c73d85c-936c-52f1-89c9-bc502bc79539 with scrape type 2
2026-03-28 14:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0c73d85c-936c-52f1-89c9-bc502bc79539, identifier: GR17806
2026-03-28 14:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0c73d85c-936c-52f1-89c9-bc502bc79539 with identifier: GR17806
2026-03-28 14:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0c73d85c-936c-52f1-89c9-bc502bc79539 with identifier: GR17806
2026-03-28 14:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0c73d85c-936c-52f1-89c9-bc502bc79539 with identifier: GR17806 to the API
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:48:41Z',
 'fuel_type': 'diesel',
 'id': '0c73d85c-936c-52f1-89c9-bc502bc79539',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR17806',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4',
 'odometer': 129244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seller_name': None,
 'title': 'DS Automobiles DS4 1.5 Blue-HDi Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2023}
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR17806%27 HTTP/1.1" 200 None
2026-03-28 14:10:54 [auto1.es] INFO: Saving data for GR17806: {'auction_closing_time': 1774716521.0, 'created_time': 1773691793.09134, 'last_price_update_time': 1774707054.576738}
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GR17806') HTTP/1.1" 204 0
2026-03-28 14:10:54 [auto1.es] INFO: Found listing with ID: PW69748
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW69748%27 HTTP/1.1" 200 None
2026-03-28 14:10:54 [auto1.es] INFO: Scrape type for PW69748: 2
2026-03-28 14:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd118af7-0eb1-56ca-92fe-6cbaa91622b4 with identifier: PW69748
2026-03-28 14:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd118af7-0eb1-56ca-92fe-6cbaa91622b4 with scrape type 2
2026-03-28 14:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd118af7-0eb1-56ca-92fe-6cbaa91622b4 with scrape type 2
2026-03-28 14:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cd118af7-0eb1-56ca-92fe-6cbaa91622b4, identifier: PW69748
2026-03-28 14:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cd118af7-0eb1-56ca-92fe-6cbaa91622b4 with identifier: PW69748
2026-03-28 14:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cd118af7-0eb1-56ca-92fe-6cbaa91622b4 with identifier: PW69748
2026-03-28 14:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cd118af7-0eb1-56ca-92fe-6cbaa91622b4 with identifier: PW69748 to the API
2026-03-28 14:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:21:36Z',
 'fuel_type': 'diesel',
 'id': 'cd118af7-0eb1-56ca-92fe-6cbaa91622b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW69748',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4',
 'odometer': 33967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seller_name': None,
 'title': 'DS Automobiles DS4 1.5 Blue-HDi Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2023}
2026-03-28 14:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW69748%27 HTTP/1.1" 200 None
2026-03-28 14:10:56 [auto1.es] INFO: Saving data for PW69748: {'auction_closing_time': 1774714896.0, 'created_time': 1773691794.724781, 'last_price_update_time': 1774707056.145455}
2026-03-28 14:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PW69748') HTTP/1.1" 204 0
2026-03-28 14:10:56 [auto1.es] INFO: Channel: 24h | Page: 52 | totalHits: 2697 | hits on page: 40
2026-03-28 14:10:56 [auto1.es] INFO: Found listing with ID: LM78815
2026-03-28 14:10:56 [auto1.es] INFO: Found listing with ID: XP48517
2026-03-28 14:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP48517%27 HTTP/1.1" 200 None
2026-03-28 14:10:56 [auto1.es] INFO: Scrape type for XP48517: 2
2026-03-28 14:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1337db95-c2c8-5d78-9085-572044ce934d with identifier: XP48517
2026-03-28 14:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1337db95-c2c8-5d78-9085-572044ce934d with scrape type 2
2026-03-28 14:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1337db95-c2c8-5d78-9085-572044ce934d with scrape type 2
2026-03-28 14:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1337db95-c2c8-5d78-9085-572044ce934d, identifier: XP48517
2026-03-28 14:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1337db95-c2c8-5d78-9085-572044ce934d with identifier: XP48517
2026-03-28 14:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1337db95-c2c8-5d78-9085-572044ce934d with identifier: XP48517
2026-03-28 14:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1337db95-c2c8-5d78-9085-572044ce934d with identifier: XP48517 to the API
2026-03-28 14:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:28:27Z',
 'fuel_type': 'diesel',
 'id': '1337db95-c2c8-5d78-9085-572044ce934d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP48517',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 194735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-05',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 HDi X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2006}
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP48517%27 HTTP/1.1" 200 None
2026-03-28 14:10:57 [auto1.es] INFO: Saving data for XP48517: {'auction_closing_time': 1774715307.0, 'created_time': 1773324441.343214, 'last_price_update_time': 1774707057.064401}
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XP48517') HTTP/1.1" 204 0
2026-03-28 14:10:57 [auto1.es] INFO: Found listing with ID: JX94297
2026-03-28 14:10:57 [auto1.es] INFO: Found listing with ID: RC43522
2026-03-28 14:10:57 [auto1.es] INFO: Found listing with ID: EH10088
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH10088%27 HTTP/1.1" 200 None
2026-03-28 14:10:57 [auto1.es] INFO: Scrape type for EH10088: 2
2026-03-28 14:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 822ecc11-5924-54bf-a494-e009e0915be1 with identifier: EH10088
2026-03-28 14:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 822ecc11-5924-54bf-a494-e009e0915be1 with scrape type 2
2026-03-28 14:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 822ecc11-5924-54bf-a494-e009e0915be1 with scrape type 2
2026-03-28 14:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 822ecc11-5924-54bf-a494-e009e0915be1, identifier: EH10088
2026-03-28 14:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:10:57 [auto1.es] INFO: Found listing with ID: DD74793
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD74793%27 HTTP/1.1" 200 None
2026-03-28 14:10:57 [auto1.es] INFO: Scrape type for DD74793: 2
2026-03-28 14:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d3407af-7fa5-5857-b442-d36a46bcfcab with identifier: DD74793
2026-03-28 14:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d3407af-7fa5-5857-b442-d36a46bcfcab with scrape type 2
2026-03-28 14:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d3407af-7fa5-5857-b442-d36a46bcfcab with scrape type 2
2026-03-28 14:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7d3407af-7fa5-5857-b442-d36a46bcfcab, identifier: DD74793
2026-03-28 14:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 822ecc11-5924-54bf-a494-e009e0915be1 with identifier: EH10088
2026-03-28 14:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 822ecc11-5924-54bf-a494-e009e0915be1 with identifier: EH10088
2026-03-28 14:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 822ecc11-5924-54bf-a494-e009e0915be1 with identifier: EH10088 to the API
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:03Z',
 'fuel_type': 'diesel',
 'id': '822ecc11-5924-54bf-a494-e009e0915be1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH10088',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 37480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-14',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2022}
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH10088%27 HTTP/1.1" 200 None
2026-03-28 14:10:57 [auto1.es] INFO: Saving data for EH10088: {'auction_closing_time': 1774714563.0, 'created_time': 1774361447.283501, 'last_price_update_time': 1774707057.583539}
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EH10088') HTTP/1.1" 204 0
2026-03-28 14:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7d3407af-7fa5-5857-b442-d36a46bcfcab with identifier: DD74793
2026-03-28 14:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7d3407af-7fa5-5857-b442-d36a46bcfcab with identifier: DD74793
2026-03-28 14:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7d3407af-7fa5-5857-b442-d36a46bcfcab with identifier: DD74793 to the API
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:08:24Z',
 'fuel_type': 'petrol',
 'id': '7d3407af-7fa5-5857-b442-d36a46bcfcab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD74793',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 139745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-15',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2015}
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD74793%27 HTTP/1.1" 200 None
2026-03-28 14:10:57 [auto1.es] INFO: Saving data for DD74793: {'auction_closing_time': 1774714104.0, 'created_time': 1774620408.096548, 'last_price_update_time': 1774707057.854962}
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DD74793') HTTP/1.1" 204 0
2026-03-28 14:10:57 [auto1.es] INFO: Found listing with ID: FB98424
2026-03-28 14:10:57 [auto1.es] INFO: Found listing with ID: GA24285
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA24285%27 HTTP/1.1" 200 None
2026-03-28 14:10:57 [auto1.es] INFO: Scrape type for GA24285: 2
2026-03-28 14:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efc73e95-dda1-53ed-9f33-45232a13cbd3 with identifier: GA24285
2026-03-28 14:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efc73e95-dda1-53ed-9f33-45232a13cbd3 with scrape type 2
2026-03-28 14:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efc73e95-dda1-53ed-9f33-45232a13cbd3 with scrape type 2
2026-03-28 14:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: efc73e95-dda1-53ed-9f33-45232a13cbd3, identifier: GA24285
2026-03-28 14:10:57 [auto1.es] INFO: Found listing with ID: VF19120
2026-03-28 14:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF19120%27 HTTP/1.1" 200 None
2026-03-28 14:10:58 [auto1.es] INFO: Scrape type for VF19120: 2
2026-03-28 14:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3dd1325-ad33-5423-b03d-a3c7cb5dfe31 with identifier: VF19120
2026-03-28 14:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3dd1325-ad33-5423-b03d-a3c7cb5dfe31 with scrape type 2
2026-03-28 14:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3dd1325-ad33-5423-b03d-a3c7cb5dfe31 with scrape type 2
2026-03-28 14:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b3dd1325-ad33-5423-b03d-a3c7cb5dfe31, identifier: VF19120
2026-03-28 14:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: efc73e95-dda1-53ed-9f33-45232a13cbd3 with identifier: GA24285
2026-03-28 14:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: efc73e95-dda1-53ed-9f33-45232a13cbd3 with identifier: GA24285
2026-03-28 14:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: efc73e95-dda1-53ed-9f33-45232a13cbd3 with identifier: GA24285 to the API
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:30Z',
 'fuel_type': 'diesel',
 'id': 'efc73e95-dda1-53ed-9f33-45232a13cbd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA24285',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 172590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-28',
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA24285%27 HTTP/1.1" 200 None
2026-03-28 14:10:58 [auto1.es] INFO: Saving data for GA24285: {'auction_closing_time': 1774715070.0, 'created_time': 1773691810.265776, 'last_price_update_time': 1774707058.444928}
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GA24285') HTTP/1.1" 204 0
2026-03-28 14:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b3dd1325-ad33-5423-b03d-a3c7cb5dfe31 with identifier: VF19120
2026-03-28 14:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b3dd1325-ad33-5423-b03d-a3c7cb5dfe31 with identifier: VF19120
2026-03-28 14:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b3dd1325-ad33-5423-b03d-a3c7cb5dfe31 with identifier: VF19120 to the API
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:57:39Z',
 'fuel_type': 'diesel',
 'id': 'b3dd1325-ad33-5423-b03d-a3c7cb5dfe31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF19120',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 64596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2021}
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF19120%27 HTTP/1.1" 200 None
2026-03-28 14:10:58 [auto1.es] INFO: Saving data for VF19120: {'auction_closing_time': 1774717059.0, 'created_time': 1773691792.348839, 'last_price_update_time': 1774707058.828915}
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VF19120') HTTP/1.1" 204 0
2026-03-28 14:10:58 [auto1.es] INFO: Found listing with ID: EL53937
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL53937%27 HTTP/1.1" 200 None
2026-03-28 14:10:58 [auto1.es] INFO: Scrape type for EL53937: 2
2026-03-28 14:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a68baa2f-cee8-5866-9fcb-05766164775b with identifier: EL53937
2026-03-28 14:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a68baa2f-cee8-5866-9fcb-05766164775b with scrape type 2
2026-03-28 14:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a68baa2f-cee8-5866-9fcb-05766164775b with scrape type 2
2026-03-28 14:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a68baa2f-cee8-5866-9fcb-05766164775b, identifier: EL53937
2026-03-28 14:10:58 [auto1.es] INFO: Found listing with ID: NM32585
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM32585%27 HTTP/1.1" 200 None
2026-03-28 14:10:58 [auto1.es] INFO: Scrape type for NM32585: 2
2026-03-28 14:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69a8c0b4-f255-55a3-b42c-2091b278657d with identifier: NM32585
2026-03-28 14:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69a8c0b4-f255-55a3-b42c-2091b278657d with scrape type 2
2026-03-28 14:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69a8c0b4-f255-55a3-b42c-2091b278657d with scrape type 2
2026-03-28 14:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 69a8c0b4-f255-55a3-b42c-2091b278657d, identifier: NM32585
2026-03-28 14:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a68baa2f-cee8-5866-9fcb-05766164775b with identifier: EL53937
2026-03-28 14:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a68baa2f-cee8-5866-9fcb-05766164775b with identifier: EL53937
2026-03-28 14:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a68baa2f-cee8-5866-9fcb-05766164775b with identifier: EL53937 to the API
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:52:20Z',
 'fuel_type': 'diesel',
 'id': 'a68baa2f-cee8-5866-9fcb-05766164775b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL53937',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 136265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-28',
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL53937%27 HTTP/1.1" 200 None
2026-03-28 14:10:59 [auto1.es] INFO: Saving data for EL53937: {'auction_closing_time': 1774716740.0, 'created_time': 1773691808.163079, 'last_price_update_time': 1774707059.369826}
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EL53937') HTTP/1.1" 204 0
2026-03-28 14:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 69a8c0b4-f255-55a3-b42c-2091b278657d with identifier: NM32585
2026-03-28 14:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 69a8c0b4-f255-55a3-b42c-2091b278657d with identifier: NM32585
2026-03-28 14:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 69a8c0b4-f255-55a3-b42c-2091b278657d with identifier: NM32585 to the API
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:05Z',
 'fuel_type': 'diesel',
 'id': '69a8c0b4-f255-55a3-b42c-2091b278657d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM32585',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 151801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-17',
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM32585%27 HTTP/1.1" 200 None
2026-03-28 14:10:59 [auto1.es] INFO: Saving data for NM32585: {'auction_closing_time': 1774717085.0, 'created_time': 1774361418.429045, 'last_price_update_time': 1774707059.667217}
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NM32585') HTTP/1.1" 204 0
2026-03-28 14:10:59 [auto1.es] INFO: Found listing with ID: SL87514
2026-03-28 14:10:59 [auto1.es] INFO: Found listing with ID: MN81981
2026-03-28 14:10:59 [auto1.es] INFO: Found listing with ID: RG01927
2026-03-28 14:10:59 [auto1.es] INFO: Found listing with ID: WE77223
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE77223%27 HTTP/1.1" 200 None
2026-03-28 14:10:59 [auto1.es] INFO: Scrape type for WE77223: 2
2026-03-28 14:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dded4bbf-51da-530e-8db5-6bdc77ebd2b6 with identifier: WE77223
2026-03-28 14:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dded4bbf-51da-530e-8db5-6bdc77ebd2b6 with scrape type 2
2026-03-28 14:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dded4bbf-51da-530e-8db5-6bdc77ebd2b6 with scrape type 2
2026-03-28 14:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dded4bbf-51da-530e-8db5-6bdc77ebd2b6, identifier: WE77223
2026-03-28 14:10:59 [auto1.es] INFO: Found listing with ID: PY80888
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY80888%27 HTTP/1.1" 200 None
2026-03-28 14:10:59 [auto1.es] INFO: Scrape type for PY80888: 2
2026-03-28 14:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4406a88-6586-5d57-96aa-7f633dd0e6ea with identifier: PY80888
2026-03-28 14:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4406a88-6586-5d57-96aa-7f633dd0e6ea with scrape type 2
2026-03-28 14:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4406a88-6586-5d57-96aa-7f633dd0e6ea with scrape type 2
2026-03-28 14:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4406a88-6586-5d57-96aa-7f633dd0e6ea, identifier: PY80888
2026-03-28 14:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dded4bbf-51da-530e-8db5-6bdc77ebd2b6 with identifier: WE77223
2026-03-28 14:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dded4bbf-51da-530e-8db5-6bdc77ebd2b6 with identifier: WE77223
2026-03-28 14:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dded4bbf-51da-530e-8db5-6bdc77ebd2b6 with identifier: WE77223 to the API
2026-03-28 14:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:57:45Z',
 'fuel_type': 'petrol',
 'id': 'dded4bbf-51da-530e-8db5-6bdc77ebd2b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE77223',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 47406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seller_name': None,
 'title': 'Kia Rio 1.0 TGDI Mild-Hybrid Concept',
 'transmission': 'automatic',
 'trim': 'Concept',
 'year': 2022}
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE77223%27 HTTP/1.1" 200 None
2026-03-28 14:11:00 [auto1.es] INFO: Saving data for WE77223: {'auction_closing_time': 1774717065.0, 'created_time': 1774382913.829777, 'last_price_update_time': 1774707060.185124}
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WE77223') HTTP/1.1" 204 0
2026-03-28 14:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4406a88-6586-5d57-96aa-7f633dd0e6ea with identifier: PY80888
2026-03-28 14:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4406a88-6586-5d57-96aa-7f633dd0e6ea with identifier: PY80888
2026-03-28 14:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e4406a88-6586-5d57-96aa-7f633dd0e6ea with identifier: PY80888 to the API
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:01Z',
 'fuel_type': 'diesel',
 'id': 'e4406a88-6586-5d57-96aa-7f633dd0e6ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY80888',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 329444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-09',
 'seller_name': None,
 'title': 'Seat Leon 1.9 TDI Sport F.R.',
 'transmission': 'manual',
 'trim': 'Sport F.R.',
 'year': 2002}
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY80888%27 HTTP/1.1" 200 None
2026-03-28 14:11:00 [auto1.es] INFO: Saving data for PY80888: {'auction_closing_time': 1774714741.0, 'created_time': 1774620430.181354, 'last_price_update_time': 1774707060.457774}
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PY80888') HTTP/1.1" 204 0
2026-03-28 14:11:00 [auto1.es] INFO: Found listing with ID: SL38190
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL38190%27 HTTP/1.1" 200 None
2026-03-28 14:11:00 [auto1.es] INFO: Scrape type for SL38190: 2
2026-03-28 14:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89b88a36-62f2-5ff3-bc84-b3cfd850d08a with identifier: SL38190
2026-03-28 14:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89b88a36-62f2-5ff3-bc84-b3cfd850d08a with scrape type 2
2026-03-28 14:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89b88a36-62f2-5ff3-bc84-b3cfd850d08a with scrape type 2
2026-03-28 14:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 89b88a36-62f2-5ff3-bc84-b3cfd850d08a, identifier: SL38190
2026-03-28 14:11:00 [auto1.es] INFO: Found listing with ID: RA61754
2026-03-28 14:11:00 [auto1.es] INFO: Found listing with ID: TS18952
2026-03-28 14:11:00 [auto1.es] INFO: Found listing with ID: GG84553
2026-03-28 14:11:00 [auto1.es] INFO: Found listing with ID: VY77417
2026-03-28 14:11:00 [auto1.es] INFO: Found listing with ID: LS36094
2026-03-28 14:11:00 [auto1.es] INFO: Found listing with ID: YW75502
2026-03-28 14:11:00 [auto1.es] INFO: Found listing with ID: CR47918
2026-03-28 14:11:00 [auto1.es] INFO: Found listing with ID: HF65167
2026-03-28 14:11:00 [auto1.es] INFO: Found listing with ID: GG33729
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG33729%27 HTTP/1.1" 200 None
2026-03-28 14:11:00 [auto1.es] INFO: Scrape type for GG33729: 2
2026-03-28 14:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83f22cec-5da9-5e9d-87c7-9849278a9838 with identifier: GG33729
2026-03-28 14:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83f22cec-5da9-5e9d-87c7-9849278a9838 with scrape type 2
2026-03-28 14:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83f22cec-5da9-5e9d-87c7-9849278a9838 with scrape type 2
2026-03-28 14:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 83f22cec-5da9-5e9d-87c7-9849278a9838, identifier: GG33729
2026-03-28 14:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 89b88a36-62f2-5ff3-bc84-b3cfd850d08a with identifier: SL38190
2026-03-28 14:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 89b88a36-62f2-5ff3-bc84-b3cfd850d08a with identifier: SL38190
2026-03-28 14:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 89b88a36-62f2-5ff3-bc84-b3cfd850d08a with identifier: SL38190 to the API
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:32:29Z',
 'fuel_type': 'petrol',
 'id': '89b88a36-62f2-5ff3-bc84-b3cfd850d08a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL38190',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 52625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seller_name': None,
 'title': 'Kia Rio 1.0 TGDI Mild-Hybrid Concept',
 'transmission': 'automatic',
 'trim': 'Concept',
 'year': 2022}
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL38190%27 HTTP/1.1" 200 None
2026-03-28 14:11:00 [auto1.es] INFO: Saving data for SL38190: {'auction_closing_time': 1774715549.0, 'created_time': 1774382935.100962, 'last_price_update_time': 1774707060.988131}
2026-03-28 14:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SL38190') HTTP/1.1" 204 0
2026-03-28 14:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 83f22cec-5da9-5e9d-87c7-9849278a9838 with identifier: GG33729
2026-03-28 14:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 83f22cec-5da9-5e9d-87c7-9849278a9838 with identifier: GG33729
2026-03-28 14:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 83f22cec-5da9-5e9d-87c7-9849278a9838 with identifier: GG33729 to the API
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:45:20Z',
 'fuel_type': 'diesel',
 'id': '83f22cec-5da9-5e9d-87c7-9849278a9838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG33729',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 180892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-08',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Mild-Hybrid Drive",
 'transmission': 'automatic',
 'trim': 'Drive',
 'year': 2023}
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG33729%27 HTTP/1.1" 200 None
2026-03-28 14:11:01 [auto1.es] INFO: Saving data for GG33729: {'auction_closing_time': 1774716320.0, 'created_time': 1773691819.586601, 'last_price_update_time': 1774707061.380874}
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GG33729') HTTP/1.1" 204 0
2026-03-28 14:11:01 [auto1.es] INFO: Found listing with ID: KT38971
2026-03-28 14:11:01 [auto1.es] INFO: Found listing with ID: PW28611
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW28611%27 HTTP/1.1" 200 None
2026-03-28 14:11:01 [auto1.es] INFO: Scrape type for PW28611: 2
2026-03-28 14:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2f2f154-c5f2-545e-9de0-d6ba7099b1b9 with identifier: PW28611
2026-03-28 14:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2f2f154-c5f2-545e-9de0-d6ba7099b1b9 with scrape type 2
2026-03-28 14:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2f2f154-c5f2-545e-9de0-d6ba7099b1b9 with scrape type 2
2026-03-28 14:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b2f2f154-c5f2-545e-9de0-d6ba7099b1b9, identifier: PW28611
2026-03-28 14:11:01 [auto1.es] INFO: Found listing with ID: RD19726
2026-03-28 14:11:01 [auto1.es] INFO: Found listing with ID: FJ71193
2026-03-28 14:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b2f2f154-c5f2-545e-9de0-d6ba7099b1b9 with identifier: PW28611
2026-03-28 14:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b2f2f154-c5f2-545e-9de0-d6ba7099b1b9 with identifier: PW28611
2026-03-28 14:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b2f2f154-c5f2-545e-9de0-d6ba7099b1b9 with identifier: PW28611 to the API
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:08:02Z',
 'fuel_type': 'diesel',
 'id': 'b2f2f154-c5f2-545e-9de0-d6ba7099b1b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW28611',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 134910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-09',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 HDi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2009}
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW28611%27 HTTP/1.1" 200 None
2026-03-28 14:11:01 [auto1.es] INFO: Saving data for PW28611: {'auction_closing_time': 1774714082.0, 'created_time': 1773130320.482437, 'last_price_update_time': 1774707061.805114}
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PW28611') HTTP/1.1" 204 0
2026-03-28 14:11:01 [auto1.es] INFO: Found listing with ID: LZ88229
2026-03-28 14:11:01 [auto1.es] INFO: Found listing with ID: YM10014
2026-03-28 14:11:01 [auto1.es] INFO: Found listing with ID: BM84951
2026-03-28 14:11:01 [auto1.es] INFO: Found listing with ID: FX21213
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX21213%27 HTTP/1.1" 200 None
2026-03-28 14:11:01 [auto1.es] INFO: Scrape type for FX21213: 2
2026-03-28 14:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8490c66-2739-5c58-8179-236f93d444e2 with identifier: FX21213
2026-03-28 14:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8490c66-2739-5c58-8179-236f93d444e2 with scrape type 2
2026-03-28 14:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8490c66-2739-5c58-8179-236f93d444e2 with scrape type 2
2026-03-28 14:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d8490c66-2739-5c58-8179-236f93d444e2, identifier: FX21213
2026-03-28 14:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d8490c66-2739-5c58-8179-236f93d444e2 with identifier: FX21213
2026-03-28 14:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d8490c66-2739-5c58-8179-236f93d444e2 with identifier: FX21213
2026-03-28 14:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d8490c66-2739-5c58-8179-236f93d444e2 with identifier: FX21213 to the API
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:01:32Z',
 'fuel_type': 'diesel',
 'id': 'd8490c66-2739-5c58-8179-236f93d444e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX21213',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 409822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-07',
 'seller_name': None,
 'title': 'BMW 3er 320d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX21213%27 HTTP/1.1" 200 None
2026-03-28 14:11:02 [auto1.es] INFO: Saving data for FX21213: {'auction_closing_time': 1774713692.0, 'created_time': 1774620443.578184, 'last_price_update_time': 1774707062.188181}
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FX21213') HTTP/1.1" 204 0
2026-03-28 14:11:02 [auto1.es] INFO: Found listing with ID: JG12549
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG12549%27 HTTP/1.1" 200 None
2026-03-28 14:11:02 [auto1.es] INFO: Scrape type for JG12549: 2
2026-03-28 14:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6194f59-c396-5b39-b69d-f23cd7b23a9a with identifier: JG12549
2026-03-28 14:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6194f59-c396-5b39-b69d-f23cd7b23a9a with scrape type 2
2026-03-28 14:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6194f59-c396-5b39-b69d-f23cd7b23a9a with scrape type 2
2026-03-28 14:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a6194f59-c396-5b39-b69d-f23cd7b23a9a, identifier: JG12549
2026-03-28 14:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a6194f59-c396-5b39-b69d-f23cd7b23a9a with identifier: JG12549
2026-03-28 14:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a6194f59-c396-5b39-b69d-f23cd7b23a9a with identifier: JG12549
2026-03-28 14:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a6194f59-c396-5b39-b69d-f23cd7b23a9a with identifier: JG12549 to the API
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:00:46Z',
 'fuel_type': 'diesel',
 'id': 'a6194f59-c396-5b39-b69d-f23cd7b23a9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG12549',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 234181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-24',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2015}
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG12549%27 HTTP/1.1" 200 None
2026-03-28 14:11:02 [auto1.es] INFO: Saving data for JG12549: {'auction_closing_time': 1774713646.0, 'created_time': 1774620445.265417, 'last_price_update_time': 1774707062.596707}
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JG12549') HTTP/1.1" 204 0
2026-03-28 14:11:02 [auto1.es] INFO: Found listing with ID: HK65705
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK65705%27 HTTP/1.1" 200 None
2026-03-28 14:11:02 [auto1.es] INFO: Scrape type for HK65705: 2
2026-03-28 14:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c89d5b0-b366-53a0-929c-486f3a51c5d7 with identifier: HK65705
2026-03-28 14:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c89d5b0-b366-53a0-929c-486f3a51c5d7 with scrape type 2
2026-03-28 14:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c89d5b0-b366-53a0-929c-486f3a51c5d7 with scrape type 2
2026-03-28 14:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5c89d5b0-b366-53a0-929c-486f3a51c5d7, identifier: HK65705
2026-03-28 14:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5c89d5b0-b366-53a0-929c-486f3a51c5d7 with identifier: HK65705
2026-03-28 14:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5c89d5b0-b366-53a0-929c-486f3a51c5d7 with identifier: HK65705
2026-03-28 14:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5c89d5b0-b366-53a0-929c-486f3a51c5d7 with identifier: HK65705 to the API
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:11:37Z',
 'fuel_type': 'diesel',
 'id': '5c89d5b0-b366-53a0-929c-486f3a51c5d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK65705',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 138942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2022}
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK65705%27 HTTP/1.1" 200 None
2026-03-28 14:11:03 [auto1.es] INFO: Saving data for HK65705: {'auction_closing_time': 1774714297.0, 'created_time': 1773126981.660164, 'last_price_update_time': 1774707063.01639}
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HK65705') HTTP/1.1" 204 0
2026-03-28 14:11:03 [auto1.es] INFO: Found listing with ID: WN81450
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN81450%27 HTTP/1.1" 200 None
2026-03-28 14:11:03 [auto1.es] INFO: Scrape type for WN81450: 2
2026-03-28 14:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 090dd9e5-7220-5dbb-9d86-e9c68a82896c with identifier: WN81450
2026-03-28 14:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 090dd9e5-7220-5dbb-9d86-e9c68a82896c with scrape type 2
2026-03-28 14:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 090dd9e5-7220-5dbb-9d86-e9c68a82896c with scrape type 2
2026-03-28 14:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 090dd9e5-7220-5dbb-9d86-e9c68a82896c, identifier: WN81450
2026-03-28 14:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 090dd9e5-7220-5dbb-9d86-e9c68a82896c with identifier: WN81450
2026-03-28 14:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 090dd9e5-7220-5dbb-9d86-e9c68a82896c with identifier: WN81450
2026-03-28 14:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 090dd9e5-7220-5dbb-9d86-e9c68a82896c with identifier: WN81450 to the API
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:27:07Z',
 'fuel_type': 'petrol',
 'id': '090dd9e5-7220-5dbb-9d86-e9c68a82896c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN81450',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90 Cross Country',
 'odometer': 148227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-27',
 'seller_name': None,
 'title': 'Volvo V90 Cross Country 2.0 T5 Pro AWD',
 'transmission': 'automatic',
 'trim': 'Pro AWD',
 'year': 2020}
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN81450%27 HTTP/1.1" 200 None
2026-03-28 14:11:03 [auto1.es] INFO: Saving data for WN81450: {'auction_closing_time': 1774715227.0, 'created_time': 1773126784.237656, 'last_price_update_time': 1774707063.458145}
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WN81450') HTTP/1.1" 204 0
2026-03-28 14:11:03 [auto1.es] INFO: Found listing with ID: TG06683
2026-03-28 14:11:03 [auto1.es] INFO: Found listing with ID: RK21190
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK21190%27 HTTP/1.1" 200 None
2026-03-28 14:11:03 [auto1.es] INFO: Scrape type for RK21190: 2
2026-03-28 14:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db859014-01ba-506b-bf96-376eb802ea25 with identifier: RK21190
2026-03-28 14:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db859014-01ba-506b-bf96-376eb802ea25 with scrape type 2
2026-03-28 14:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db859014-01ba-506b-bf96-376eb802ea25 with scrape type 2
2026-03-28 14:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: db859014-01ba-506b-bf96-376eb802ea25, identifier: RK21190
2026-03-28 14:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: db859014-01ba-506b-bf96-376eb802ea25 with identifier: RK21190
2026-03-28 14:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: db859014-01ba-506b-bf96-376eb802ea25 with identifier: RK21190
2026-03-28 14:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: db859014-01ba-506b-bf96-376eb802ea25 with identifier: RK21190 to the API
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:20:18Z',
 'fuel_type': 'diesel',
 'id': 'db859014-01ba-506b-bf96-376eb802ea25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK21190',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 134851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK21190%27 HTTP/1.1" 200 None
2026-03-28 14:11:03 [auto1.es] INFO: Saving data for RK21190: {'auction_closing_time': 1774714818.0, 'created_time': 1773126793.444645, 'last_price_update_time': 1774707063.925347}
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RK21190') HTTP/1.1" 204 0
2026-03-28 14:11:03 [auto1.es] INFO: Found listing with ID: AL55124
2026-03-28 14:11:03 [auto1.es] INFO: Found listing with ID: BX87783
2026-03-28 14:11:03 [auto1.es] INFO: Found listing with ID: UN21453
2026-03-28 14:11:03 [auto1.es] INFO: Found listing with ID: KF67108
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF67108%27 HTTP/1.1" 200 None
2026-03-28 14:11:03 [auto1.es] INFO: Scrape type for KF67108: 2
2026-03-28 14:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7 with identifier: KF67108
2026-03-28 14:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7 with scrape type 2
2026-03-28 14:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7 with scrape type 2
2026-03-28 14:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7, identifier: KF67108
2026-03-28 14:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7 with identifier: KF67108
2026-03-28 14:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7 with identifier: KF67108
2026-03-28 14:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7 with identifier: KF67108 to the API
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:25:25Z',
 'fuel_type': 'diesel',
 'id': '982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF67108',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 104328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid R-dynamic S',
 'transmission': 'automatic',
 'trim': 'R-dynamic S',
 'year': 2020}
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF67108%27 HTTP/1.1" 200 None
2026-03-28 14:11:04 [auto1.es] INFO: Saving data for KF67108: {'auction_closing_time': 1774715125.0, 'created_time': 1773126775.956732, 'last_price_update_time': 1774707064.331973}
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KF67108') HTTP/1.1" 204 0
2026-03-28 14:11:04 [auto1.es] INFO: Found listing with ID: HN15529
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN15529%27 HTTP/1.1" 200 None
2026-03-28 14:11:04 [auto1.es] INFO: Scrape type for HN15529: 2
2026-03-28 14:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 876d1576-4e3b-58d6-94f5-a541bb77f9fa with identifier: HN15529
2026-03-28 14:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 876d1576-4e3b-58d6-94f5-a541bb77f9fa with scrape type 2
2026-03-28 14:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 876d1576-4e3b-58d6-94f5-a541bb77f9fa with scrape type 2
2026-03-28 14:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 876d1576-4e3b-58d6-94f5-a541bb77f9fa, identifier: HN15529
2026-03-28 14:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 876d1576-4e3b-58d6-94f5-a541bb77f9fa with identifier: HN15529
2026-03-28 14:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 876d1576-4e3b-58d6-94f5-a541bb77f9fa with identifier: HN15529
2026-03-28 14:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 876d1576-4e3b-58d6-94f5-a541bb77f9fa with identifier: HN15529 to the API
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:09:12Z',
 'fuel_type': 'diesel',
 'id': '876d1576-4e3b-58d6-94f5-a541bb77f9fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN15529',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 76830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seller_name': None,
 'title': 'Renault Talisman 1.7 BLUE dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2020}
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN15529%27 HTTP/1.1" 200 None
2026-03-28 14:11:04 [auto1.es] INFO: Saving data for HN15529: {'auction_closing_time': 1774714152.0, 'created_time': 1773126752.638861, 'last_price_update_time': 1774707064.711581}
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HN15529') HTTP/1.1" 204 0
2026-03-28 14:11:04 [auto1.es] INFO: Found listing with ID: WZ09714
2026-03-28 14:11:04 [auto1.es] INFO: Found listing with ID: GT72542
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT72542%27 HTTP/1.1" 200 None
2026-03-28 14:11:04 [auto1.es] INFO: Scrape type for GT72542: 2
2026-03-28 14:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee2b2891-af48-5662-be02-29860f06daf2 with identifier: GT72542
2026-03-28 14:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee2b2891-af48-5662-be02-29860f06daf2 with scrape type 2
2026-03-28 14:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee2b2891-af48-5662-be02-29860f06daf2 with scrape type 2
2026-03-28 14:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee2b2891-af48-5662-be02-29860f06daf2, identifier: GT72542
2026-03-28 14:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee2b2891-af48-5662-be02-29860f06daf2 with identifier: GT72542
2026-03-28 14:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee2b2891-af48-5662-be02-29860f06daf2 with identifier: GT72542
2026-03-28 14:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ee2b2891-af48-5662-be02-29860f06daf2 with identifier: GT72542 to the API
2026-03-28 14:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:55:47Z',
 'fuel_type': 'diesel',
 'id': 'ee2b2891-af48-5662-be02-29860f06daf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT72542',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 265622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-28',
 'seller_name': None,
 'title': 'Hyundai i40 1.7 CRDi Klass Blue',
 'transmission': 'manual',
 'trim': 'Klass Blue',
 'year': 2015}
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT72542%27 HTTP/1.1" 200 None
2026-03-28 14:11:05 [auto1.es] INFO: Saving data for GT72542: {'auction_closing_time': 1774716947.0, 'created_time': 1774620438.908238, 'last_price_update_time': 1774707065.109414}
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GT72542') HTTP/1.1" 204 0
2026-03-28 14:11:05 [auto1.es] INFO: Found listing with ID: NC85422
2026-03-28 14:11:05 [auto1.es] INFO: Found listing with ID: NG03443
2026-03-28 14:11:05 [auto1.es] INFO: Found listing with ID: ZM94527
2026-03-28 14:11:05 [auto1.es] INFO: Found listing with ID: ZY05184
2026-03-28 14:11:05 [auto1.es] INFO: Found listing with ID: XB60101
2026-03-28 14:11:05 [auto1.es] INFO: Found listing with ID: MD81888
2026-03-28 14:11:05 [auto1.es] INFO: Found listing with ID: DS53595
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS53595%27 HTTP/1.1" 200 None
2026-03-28 14:11:05 [auto1.es] INFO: Scrape type for DS53595: 2
2026-03-28 14:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6564af73-29c4-58ba-a8bd-c1c4644ae6c9 with identifier: DS53595
2026-03-28 14:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6564af73-29c4-58ba-a8bd-c1c4644ae6c9 with scrape type 2
2026-03-28 14:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6564af73-29c4-58ba-a8bd-c1c4644ae6c9 with scrape type 2
2026-03-28 14:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6564af73-29c4-58ba-a8bd-c1c4644ae6c9, identifier: DS53595
2026-03-28 14:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6564af73-29c4-58ba-a8bd-c1c4644ae6c9 with identifier: DS53595
2026-03-28 14:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6564af73-29c4-58ba-a8bd-c1c4644ae6c9 with identifier: DS53595
2026-03-28 14:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6564af73-29c4-58ba-a8bd-c1c4644ae6c9 with identifier: DS53595 to the API
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:22:09Z',
 'fuel_type': 'hybrid',
 'id': '6564af73-29c4-58ba-a8bd-c1c4644ae6c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS53595',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 158544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-31',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS53595%27 HTTP/1.1" 200 None
2026-03-28 14:11:05 [auto1.es] INFO: Saving data for DS53595: {'auction_closing_time': 1774714929.0, 'created_time': 1774361486.70454, 'last_price_update_time': 1774707065.491599}
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DS53595') HTTP/1.1" 204 0
2026-03-28 14:11:05 [auto1.es] INFO: Found listing with ID: JK89410
2026-03-28 14:11:05 [auto1.es] INFO: Found listing with ID: KT73774
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT73774%27 HTTP/1.1" 200 None
2026-03-28 14:11:05 [auto1.es] INFO: Scrape type for KT73774: 2
2026-03-28 14:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb3fc9c3-0c29-5f1b-8004-48aba5b9cae5 with identifier: KT73774
2026-03-28 14:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb3fc9c3-0c29-5f1b-8004-48aba5b9cae5 with scrape type 2
2026-03-28 14:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb3fc9c3-0c29-5f1b-8004-48aba5b9cae5 with scrape type 2
2026-03-28 14:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eb3fc9c3-0c29-5f1b-8004-48aba5b9cae5, identifier: KT73774
2026-03-28 14:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eb3fc9c3-0c29-5f1b-8004-48aba5b9cae5 with identifier: KT73774
2026-03-28 14:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eb3fc9c3-0c29-5f1b-8004-48aba5b9cae5 with identifier: KT73774
2026-03-28 14:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eb3fc9c3-0c29-5f1b-8004-48aba5b9cae5 with identifier: KT73774 to the API
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:55:56Z',
 'fuel_type': 'petrol',
 'id': 'eb3fc9c3-0c29-5f1b-8004-48aba5b9cae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT73774',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 59772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-29',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2010}
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT73774%27 HTTP/1.1" 200 None
2026-03-28 14:11:05 [auto1.es] INFO: Saving data for KT73774: {'auction_closing_time': 1774716956.0, 'created_time': 1774620442.354243, 'last_price_update_time': 1774707065.964307}
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KT73774') HTTP/1.1" 204 0
2026-03-28 14:11:05 [auto1.es] INFO: Found listing with ID: DN57812
2026-03-28 14:11:05 [auto1.es] INFO: Found listing with ID: GF25247
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF25247%27 HTTP/1.1" 200 None
2026-03-28 14:11:05 [auto1.es] INFO: Scrape type for GF25247: 2
2026-03-28 14:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddc5cc28-198f-5d14-a46a-791bfe170544 with identifier: GF25247
2026-03-28 14:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddc5cc28-198f-5d14-a46a-791bfe170544 with scrape type 2
2026-03-28 14:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddc5cc28-198f-5d14-a46a-791bfe170544 with scrape type 2
2026-03-28 14:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ddc5cc28-198f-5d14-a46a-791bfe170544, identifier: GF25247
2026-03-28 14:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ddc5cc28-198f-5d14-a46a-791bfe170544 with identifier: GF25247
2026-03-28 14:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ddc5cc28-198f-5d14-a46a-791bfe170544 with identifier: GF25247
2026-03-28 14:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ddc5cc28-198f-5d14-a46a-791bfe170544 with identifier: GF25247 to the API
2026-03-28 14:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:13:39Z',
 'fuel_type': 'diesel',
 'id': 'ddc5cc28-198f-5d14-a46a-791bfe170544',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF25247',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 284088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-23',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 14:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF25247%27 HTTP/1.1" 200 None
2026-03-28 14:11:06 [auto1.es] INFO: Saving data for GF25247: {'auction_closing_time': 1774714419.0, 'created_time': 1774620445.660506, 'last_price_update_time': 1774707066.346639}
2026-03-28 14:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GF25247') HTTP/1.1" 204 0
2026-03-28 14:11:10 [scrapy.extensions.logstats] INFO: Crawled 190 pages (at 2 pages/min), scraped 251 items (at 57 items/min)
2026-03-28 14:11:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-28 14:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:11:31 [auto1.es] INFO: Channel: 24h | Page: 53 | totalHits: 2698 | hits on page: 40
2026-03-28 14:11:31 [auto1.es] INFO: Found listing with ID: GF25247
2026-03-28 14:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF25247%27 HTTP/1.1" 200 None
2026-03-28 14:11:31 [auto1.es] INFO: Scrape type for GF25247: 0
2026-03-28 14:11:31 [auto1.es] INFO: Found listing with ID: GY71785
2026-03-28 14:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY71785%27 HTTP/1.1" 200 None
2026-03-28 14:11:31 [auto1.es] INFO: Scrape type for GY71785: 2
2026-03-28 14:11:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caae1ae9-b0bc-5ffd-94fa-7d918995dc91 with identifier: GY71785
2026-03-28 14:11:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caae1ae9-b0bc-5ffd-94fa-7d918995dc91 with scrape type 2
2026-03-28 14:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caae1ae9-b0bc-5ffd-94fa-7d918995dc91 with scrape type 2
2026-03-28 14:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: caae1ae9-b0bc-5ffd-94fa-7d918995dc91, identifier: GY71785
2026-03-28 14:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: caae1ae9-b0bc-5ffd-94fa-7d918995dc91 with identifier: GY71785
2026-03-28 14:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: caae1ae9-b0bc-5ffd-94fa-7d918995dc91 with identifier: GY71785
2026-03-28 14:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: caae1ae9-b0bc-5ffd-94fa-7d918995dc91 with identifier: GY71785 to the API
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:27:17Z',
 'fuel_type': 'diesel',
 'id': 'caae1ae9-b0bc-5ffd-94fa-7d918995dc91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY71785',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 182165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-28',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 HDi LX Plus',
 'transmission': 'manual',
 'trim': 'LX Plus',
 'year': 2009}
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY71785%27 HTTP/1.1" 200 None
2026-03-28 14:11:32 [auto1.es] INFO: Saving data for GY71785: {'auction_closing_time': 1774715237.0, 'created_time': 1774620437.324105, 'last_price_update_time': 1774707092.306792}
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GY71785') HTTP/1.1" 204 0
2026-03-28 14:11:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:11:32 [auto1.es] INFO: Found listing with ID: RF22633
2026-03-28 14:11:32 [auto1.es] INFO: Found listing with ID: TB59452
2026-03-28 14:11:32 [auto1.es] INFO: Found listing with ID: JG20309
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG20309%27 HTTP/1.1" 200 None
2026-03-28 14:11:32 [auto1.es] INFO: Scrape type for JG20309: 2
2026-03-28 14:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8cbe21a-cc5a-5aef-b58f-9692ee9f9a63 with identifier: JG20309
2026-03-28 14:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8cbe21a-cc5a-5aef-b58f-9692ee9f9a63 with scrape type 2
2026-03-28 14:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8cbe21a-cc5a-5aef-b58f-9692ee9f9a63 with scrape type 2
2026-03-28 14:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d8cbe21a-cc5a-5aef-b58f-9692ee9f9a63, identifier: JG20309
2026-03-28 14:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d8cbe21a-cc5a-5aef-b58f-9692ee9f9a63 with identifier: JG20309
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 14:11:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 14:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d8cbe21a-cc5a-5aef-b58f-9692ee9f9a63 with identifier: JG20309
2026-03-28 14:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d8cbe21a-cc5a-5aef-b58f-9692ee9f9a63 with identifier: JG20309 to the API
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:22:07Z',
 'fuel_type': 'diesel',
 'id': 'd8cbe21a-cc5a-5aef-b58f-9692ee9f9a63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG20309',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 127224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-08',
 'seller_name': None,
 'title': 'MINI One D',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG20309%27 HTTP/1.1" 200 None
2026-03-28 14:11:32 [auto1.es] INFO: Saving data for JG20309: {'auction_closing_time': 1774714927.0, 'created_time': 1774620441.482174, 'last_price_update_time': 1774707092.785249}
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JG20309') HTTP/1.1" 204 0
2026-03-28 14:11:32 [auto1.es] INFO: Found listing with ID: LF34637
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF34637%27 HTTP/1.1" 200 None
2026-03-28 14:11:32 [auto1.es] INFO: Scrape type for LF34637: 2
2026-03-28 14:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f35cfade-9367-5e16-9046-3ba5f422a23a with identifier: LF34637
2026-03-28 14:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f35cfade-9367-5e16-9046-3ba5f422a23a with scrape type 2
2026-03-28 14:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f35cfade-9367-5e16-9046-3ba5f422a23a with scrape type 2
2026-03-28 14:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f35cfade-9367-5e16-9046-3ba5f422a23a, identifier: LF34637
2026-03-28 14:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f35cfade-9367-5e16-9046-3ba5f422a23a with identifier: LF34637
2026-03-28 14:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f35cfade-9367-5e16-9046-3ba5f422a23a with identifier: LF34637
2026-03-28 14:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f35cfade-9367-5e16-9046-3ba5f422a23a with identifier: LF34637 to the API
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:20:26Z',
 'fuel_type': 'diesel',
 'id': 'f35cfade-9367-5e16-9046-3ba5f422a23a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF34637',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 145360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-20',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF34637%27 HTTP/1.1" 200 None
2026-03-28 14:11:33 [auto1.es] INFO: Saving data for LF34637: {'auction_closing_time': 1774714826.0, 'created_time': 1774620573.338218, 'last_price_update_time': 1774707093.246757}
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LF34637') HTTP/1.1" 204 0
2026-03-28 14:11:33 [auto1.es] INFO: Found listing with ID: TA37328
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA37328%27 HTTP/1.1" 200 None
2026-03-28 14:11:33 [auto1.es] INFO: Scrape type for TA37328: 2
2026-03-28 14:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f49af45e-7079-54ed-a565-ad0b279fee30 with identifier: TA37328
2026-03-28 14:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f49af45e-7079-54ed-a565-ad0b279fee30 with scrape type 2
2026-03-28 14:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f49af45e-7079-54ed-a565-ad0b279fee30 with scrape type 2
2026-03-28 14:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f49af45e-7079-54ed-a565-ad0b279fee30, identifier: TA37328
2026-03-28 14:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f49af45e-7079-54ed-a565-ad0b279fee30 with identifier: TA37328
2026-03-28 14:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f49af45e-7079-54ed-a565-ad0b279fee30 with identifier: TA37328
2026-03-28 14:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f49af45e-7079-54ed-a565-ad0b279fee30 with identifier: TA37328 to the API
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-28T16:15:33Z',
 'fuel_type': 'hybrid',
 'id': 'f49af45e-7079-54ed-a565-ad0b279fee30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA37328',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'IONIQ',
 'odometer': 85544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-27',
 'seller_name': None,
 'title': 'Hyundai IONIQ 1.6 Hybrid Tecno',
 'transmission': 'automatic',
 'trim': 'Tecno',
 'year': 2022}
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA37328%27 HTTP/1.1" 200 None
2026-03-28 14:11:33 [auto1.es] INFO: Saving data for TA37328: {'auction_closing_time': 1774714533.0, 'created_time': 1773126990.839271, 'last_price_update_time': 1774707093.629638}
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TA37328') HTTP/1.1" 204 0
2026-03-28 14:11:33 [auto1.es] INFO: Found listing with ID: KS63423
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS63423%27 HTTP/1.1" 200 None
2026-03-28 14:11:33 [auto1.es] INFO: Scrape type for KS63423: 2
2026-03-28 14:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 460edcdc-d0cb-5131-94f7-d277c6b9d2f0 with identifier: KS63423
2026-03-28 14:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 460edcdc-d0cb-5131-94f7-d277c6b9d2f0 with scrape type 2
2026-03-28 14:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 460edcdc-d0cb-5131-94f7-d277c6b9d2f0 with scrape type 2
2026-03-28 14:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 460edcdc-d0cb-5131-94f7-d277c6b9d2f0, identifier: KS63423
2026-03-28 14:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 460edcdc-d0cb-5131-94f7-d277c6b9d2f0 with identifier: KS63423
2026-03-28 14:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 460edcdc-d0cb-5131-94f7-d277c6b9d2f0 with identifier: KS63423
2026-03-28 14:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 460edcdc-d0cb-5131-94f7-d277c6b9d2f0 with identifier: KS63423 to the API
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:43:31Z',
 'fuel_type': 'diesel',
 'id': '460edcdc-d0cb-5131-94f7-d277c6b9d2f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS63423',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 97996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
 'transmission': 'automatic',
 'trim': 'Super',
 'year': 2019}
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS63423%27 HTTP/1.1" 200 None
2026-03-28 14:11:34 [auto1.es] INFO: Saving data for KS63423: {'auction_closing_time': 1774716211.0, 'created_time': 1773669953.640452, 'last_price_update_time': 1774707094.090668}
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KS63423') HTTP/1.1" 204 0
2026-03-28 14:11:34 [auto1.es] INFO: Found listing with ID: MW76524
2026-03-28 14:11:34 [auto1.es] INFO: Found listing with ID: SU90916
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU90916%27 HTTP/1.1" 200 None
2026-03-28 14:11:34 [auto1.es] INFO: Scrape type for SU90916: 2
2026-03-28 14:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd8c555a-8c52-5cd3-bce5-79bc46310ffc with identifier: SU90916
2026-03-28 14:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd8c555a-8c52-5cd3-bce5-79bc46310ffc with scrape type 2
2026-03-28 14:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd8c555a-8c52-5cd3-bce5-79bc46310ffc with scrape type 2
2026-03-28 14:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dd8c555a-8c52-5cd3-bce5-79bc46310ffc, identifier: SU90916
2026-03-28 14:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dd8c555a-8c52-5cd3-bce5-79bc46310ffc with identifier: SU90916
2026-03-28 14:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dd8c555a-8c52-5cd3-bce5-79bc46310ffc with identifier: SU90916
2026-03-28 14:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dd8c555a-8c52-5cd3-bce5-79bc46310ffc with identifier: SU90916 to the API
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:10:00Z',
 'fuel_type': 'diesel',
 'id': 'dd8c555a-8c52-5cd3-bce5-79bc46310ffc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU90916',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 147375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI Premium Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Premium Elegance 4Motion',
 'year': 2022}
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU90916%27 HTTP/1.1" 200 None
2026-03-28 14:11:34 [auto1.es] INFO: Saving data for SU90916: {'auction_closing_time': 1774714200.0, 'created_time': 1774361449.724658, 'last_price_update_time': 1774707094.447048}
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SU90916') HTTP/1.1" 204 0
2026-03-28 14:11:34 [auto1.es] INFO: Found listing with ID: YJ60609
2026-03-28 14:11:34 [auto1.es] INFO: Found listing with ID: TB20827
2026-03-28 14:11:34 [auto1.es] INFO: Found listing with ID: JR41621
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR41621%27 HTTP/1.1" 200 None
2026-03-28 14:11:34 [auto1.es] INFO: Scrape type for JR41621: 2
2026-03-28 14:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46d43870-c297-5968-ae10-3d82640ccb01 with identifier: JR41621
2026-03-28 14:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46d43870-c297-5968-ae10-3d82640ccb01 with scrape type 2
2026-03-28 14:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46d43870-c297-5968-ae10-3d82640ccb01 with scrape type 2
2026-03-28 14:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 46d43870-c297-5968-ae10-3d82640ccb01, identifier: JR41621
2026-03-28 14:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 46d43870-c297-5968-ae10-3d82640ccb01 with identifier: JR41621
2026-03-28 14:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 46d43870-c297-5968-ae10-3d82640ccb01 with identifier: JR41621
2026-03-28 14:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 46d43870-c297-5968-ae10-3d82640ccb01 with identifier: JR41621 to the API
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:00:07Z',
 'fuel_type': 'petrol',
 'id': '46d43870-c297-5968-ae10-3d82640ccb01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR41621',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Avenger',
 'odometer': 27251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-02',
 'seller_name': None,
 'title': 'Jeep Avenger 1.2 T-GDI Altitude',
 'transmission': 'manual',
 'trim': 'Altitude',
 'year': 2024}
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR41621%27 HTTP/1.1" 200 None
2026-03-28 14:11:34 [auto1.es] INFO: Saving data for JR41621: {'auction_closing_time': 1774713607.0, 'created_time': 1773432546.32981, 'last_price_update_time': 1774707094.825281}
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JR41621') HTTP/1.1" 204 0
2026-03-28 14:11:34 [auto1.es] INFO: Found listing with ID: RR11017
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR11017%27 HTTP/1.1" 200 None
2026-03-28 14:11:34 [auto1.es] INFO: Scrape type for RR11017: 2
2026-03-28 14:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6a22393-2712-5f9d-abca-ca3b7a51adcf with identifier: RR11017
2026-03-28 14:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6a22393-2712-5f9d-abca-ca3b7a51adcf with scrape type 2
2026-03-28 14:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6a22393-2712-5f9d-abca-ca3b7a51adcf with scrape type 2
2026-03-28 14:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e6a22393-2712-5f9d-abca-ca3b7a51adcf, identifier: RR11017
2026-03-28 14:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e6a22393-2712-5f9d-abca-ca3b7a51adcf with identifier: RR11017
2026-03-28 14:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e6a22393-2712-5f9d-abca-ca3b7a51adcf with identifier: RR11017
2026-03-28 14:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e6a22393-2712-5f9d-abca-ca3b7a51adcf with identifier: RR11017 to the API
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:05:43Z',
 'fuel_type': 'diesel',
 'id': 'e6a22393-2712-5f9d-abca-ca3b7a51adcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR11017',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 200181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-24',
 'seller_name': None,
 'title': 'Opel Zafira 1.9 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2009}
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR11017%27 HTTP/1.1" 200 None
2026-03-28 14:11:35 [auto1.es] INFO: Saving data for RR11017: {'auction_closing_time': 1774713943.0, 'created_time': 1774620444.477478, 'last_price_update_time': 1774707095.189214}
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RR11017') HTTP/1.1" 204 0
2026-03-28 14:11:35 [auto1.es] INFO: Found listing with ID: HC78450
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC78450%27 HTTP/1.1" 200 None
2026-03-28 14:11:35 [auto1.es] INFO: Scrape type for HC78450: 2
2026-03-28 14:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2735546-4c24-5c32-ae24-5744e0e24686 with identifier: HC78450
2026-03-28 14:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2735546-4c24-5c32-ae24-5744e0e24686 with scrape type 2
2026-03-28 14:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2735546-4c24-5c32-ae24-5744e0e24686 with scrape type 2
2026-03-28 14:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a2735546-4c24-5c32-ae24-5744e0e24686, identifier: HC78450
2026-03-28 14:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a2735546-4c24-5c32-ae24-5744e0e24686 with identifier: HC78450
2026-03-28 14:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a2735546-4c24-5c32-ae24-5744e0e24686 with identifier: HC78450
2026-03-28 14:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a2735546-4c24-5c32-ae24-5744e0e24686 with identifier: HC78450 to the API
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 228,
 'expiration_date': '2026-03-28T16:55:23Z',
 'fuel_type': 'electro',
 'id': 'a2735546-4c24-5c32-ae24-5744e0e24686',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC78450',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 67972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-30',
 'seller_name': None,
 'title': 'Kia EV6 electric drive 168 kW GT Line 2WD',
 'transmission': 'automatic',
 'trim': 'GT Line 2WD',
 'year': 2023}
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC78450%27 HTTP/1.1" 200 None
2026-03-28 14:11:35 [auto1.es] INFO: Saving data for HC78450: {'auction_closing_time': 1774716923.0, 'created_time': 1773432613.753767, 'last_price_update_time': 1774707095.545438}
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HC78450') HTTP/1.1" 204 0
2026-03-28 14:11:35 [auto1.es] INFO: Found listing with ID: VE86539
2026-03-28 14:11:35 [auto1.es] INFO: Found listing with ID: SB05981
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB05981%27 HTTP/1.1" 200 None
2026-03-28 14:11:35 [auto1.es] INFO: Scrape type for SB05981: 2
2026-03-28 14:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c297e49-0432-5c5a-9c24-61f340f73021 with identifier: SB05981
2026-03-28 14:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c297e49-0432-5c5a-9c24-61f340f73021 with scrape type 2
2026-03-28 14:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c297e49-0432-5c5a-9c24-61f340f73021 with scrape type 2
2026-03-28 14:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8c297e49-0432-5c5a-9c24-61f340f73021, identifier: SB05981
2026-03-28 14:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8c297e49-0432-5c5a-9c24-61f340f73021 with identifier: SB05981
2026-03-28 14:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8c297e49-0432-5c5a-9c24-61f340f73021 with identifier: SB05981
2026-03-28 14:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8c297e49-0432-5c5a-9c24-61f340f73021 with identifier: SB05981 to the API
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:15:33Z',
 'fuel_type': 'diesel',
 'id': '8c297e49-0432-5c5a-9c24-61f340f73021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB05981',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 222095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-23',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB05981%27 HTTP/1.1" 200 None
2026-03-28 14:11:35 [auto1.es] INFO: Saving data for SB05981: {'auction_closing_time': 1774714533.0, 'created_time': 1774382918.346028, 'last_price_update_time': 1774707095.929472}
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SB05981') HTTP/1.1" 204 0
2026-03-28 14:11:35 [auto1.es] INFO: Found listing with ID: GH64040
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH64040%27 HTTP/1.1" 200 None
2026-03-28 14:11:35 [auto1.es] INFO: Scrape type for GH64040: 2
2026-03-28 14:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34b80c60-e920-5060-a239-50686d931131 with identifier: GH64040
2026-03-28 14:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34b80c60-e920-5060-a239-50686d931131 with scrape type 2
2026-03-28 14:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34b80c60-e920-5060-a239-50686d931131 with scrape type 2
2026-03-28 14:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 34b80c60-e920-5060-a239-50686d931131, identifier: GH64040
2026-03-28 14:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 34b80c60-e920-5060-a239-50686d931131 with identifier: GH64040
2026-03-28 14:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 34b80c60-e920-5060-a239-50686d931131 with identifier: GH64040
2026-03-28 14:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 34b80c60-e920-5060-a239-50686d931131 with identifier: GH64040 to the API
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:55Z',
 'fuel_type': 'diesel',
 'id': '34b80c60-e920-5060-a239-50686d931131',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH64040',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 81689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-11',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH64040%27 HTTP/1.1" 200 None
2026-03-28 14:11:36 [auto1.es] INFO: Saving data for GH64040: {'auction_closing_time': 1774716355.0, 'created_time': 1773432611.193054, 'last_price_update_time': 1774707096.321367}
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GH64040') HTTP/1.1" 204 0
2026-03-28 14:11:36 [auto1.es] INFO: Found listing with ID: US21221
2026-03-28 14:11:36 [auto1.es] INFO: Found listing with ID: SB85910
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB85910%27 HTTP/1.1" 200 None
2026-03-28 14:11:36 [auto1.es] INFO: Scrape type for SB85910: 2
2026-03-28 14:11:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff with identifier: SB85910
2026-03-28 14:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff with scrape type 2
2026-03-28 14:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff with scrape type 2
2026-03-28 14:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff, identifier: SB85910
2026-03-28 14:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff with identifier: SB85910
2026-03-28 14:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff with identifier: SB85910
2026-03-28 14:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff with identifier: SB85910 to the API
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:38:36Z',
 'fuel_type': 'diesel',
 'id': 'ca33a5c8-6ab9-51e0-8d1c-50ca0f6964ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB85910',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 49335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-26',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Sportline',
 'transmission': 'automatic',
 'trim': 'Sportline',
 'year': 2022}
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB85910%27 HTTP/1.1" 200 None
2026-03-28 14:11:36 [auto1.es] INFO: Saving data for SB85910: {'auction_closing_time': 1774715916.0, 'created_time': 1773346061.295607, 'last_price_update_time': 1774707096.775624}
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SB85910') HTTP/1.1" 204 0
2026-03-28 14:11:36 [auto1.es] INFO: Found listing with ID: WZ08736
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ08736%27 HTTP/1.1" 200 None
2026-03-28 14:11:36 [auto1.es] INFO: Scrape type for WZ08736: 2
2026-03-28 14:11:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c5f82f8-7640-535c-854d-4b6e33ec173a with identifier: WZ08736
2026-03-28 14:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c5f82f8-7640-535c-854d-4b6e33ec173a with scrape type 2
2026-03-28 14:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c5f82f8-7640-535c-854d-4b6e33ec173a with scrape type 2
2026-03-28 14:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c5f82f8-7640-535c-854d-4b6e33ec173a, identifier: WZ08736
2026-03-28 14:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c5f82f8-7640-535c-854d-4b6e33ec173a with identifier: WZ08736
2026-03-28 14:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c5f82f8-7640-535c-854d-4b6e33ec173a with identifier: WZ08736
2026-03-28 14:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3c5f82f8-7640-535c-854d-4b6e33ec173a with identifier: WZ08736 to the API
2026-03-28 14:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:45:56Z',
 'fuel_type': 'diesel',
 'id': '3c5f82f8-7640-535c-854d-4b6e33ec173a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ08736',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 79885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2020}
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ08736%27 HTTP/1.1" 200 None
2026-03-28 14:11:37 [auto1.es] INFO: Saving data for WZ08736: {'auction_closing_time': 1774716356.0, 'created_time': 1773126751.405858, 'last_price_update_time': 1774707097.167824}
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WZ08736') HTTP/1.1" 204 0
2026-03-28 14:11:37 [auto1.es] INFO: Channel: 24h | Page: 54 | totalHits: 2698 | hits on page: 40
2026-03-28 14:11:37 [auto1.es] INFO: Found listing with ID: YH80645
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH80645%27 HTTP/1.1" 200 None
2026-03-28 14:11:37 [auto1.es] INFO: Scrape type for YH80645: 2
2026-03-28 14:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4844526a-a416-5a04-ac08-92ac147f2920 with identifier: YH80645
2026-03-28 14:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4844526a-a416-5a04-ac08-92ac147f2920 with scrape type 2
2026-03-28 14:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4844526a-a416-5a04-ac08-92ac147f2920 with scrape type 2
2026-03-28 14:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4844526a-a416-5a04-ac08-92ac147f2920, identifier: YH80645
2026-03-28 14:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4844526a-a416-5a04-ac08-92ac147f2920 with identifier: YH80645
2026-03-28 14:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4844526a-a416-5a04-ac08-92ac147f2920 with identifier: YH80645
2026-03-28 14:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4844526a-a416-5a04-ac08-92ac147f2920 with identifier: YH80645 to the API
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:34:07Z',
 'fuel_type': 'diesel',
 'id': '4844526a-a416-5a04-ac08-92ac147f2920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH80645',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 182144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Advance BlueMotion',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion',
 'year': 2015}
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH80645%27 HTTP/1.1" 200 None
2026-03-28 14:11:37 [auto1.es] INFO: Saving data for YH80645: {'auction_closing_time': 1774715647.0, 'created_time': 1774620446.535315, 'last_price_update_time': 1774707097.548311}
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YH80645') HTTP/1.1" 204 0
2026-03-28 14:11:37 [auto1.es] INFO: Found listing with ID: HS01643
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS01643%27 HTTP/1.1" 200 None
2026-03-28 14:11:37 [auto1.es] INFO: Scrape type for HS01643: 2
2026-03-28 14:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f820d92-26ac-567e-8177-2a26b589b898 with identifier: HS01643
2026-03-28 14:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f820d92-26ac-567e-8177-2a26b589b898 with scrape type 2
2026-03-28 14:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f820d92-26ac-567e-8177-2a26b589b898 with scrape type 2
2026-03-28 14:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0f820d92-26ac-567e-8177-2a26b589b898, identifier: HS01643
2026-03-28 14:11:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:11:37 [auto1.es] INFO: Found listing with ID: FW08254
2026-03-28 14:11:37 [auto1.es] INFO: Found listing with ID: PK70837
2026-03-28 14:11:37 [auto1.es] INFO: Found listing with ID: EG02791
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG02791%27 HTTP/1.1" 200 None
2026-03-28 14:11:37 [auto1.es] INFO: Scrape type for EG02791: 2
2026-03-28 14:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4c88bbe-b2a2-579b-ae10-f19ad25dcccc with identifier: EG02791
2026-03-28 14:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4c88bbe-b2a2-579b-ae10-f19ad25dcccc with scrape type 2
2026-03-28 14:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4c88bbe-b2a2-579b-ae10-f19ad25dcccc with scrape type 2
2026-03-28 14:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a4c88bbe-b2a2-579b-ae10-f19ad25dcccc, identifier: EG02791
2026-03-28 14:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0f820d92-26ac-567e-8177-2a26b589b898 with identifier: HS01643
2026-03-28 14:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0f820d92-26ac-567e-8177-2a26b589b898 with identifier: HS01643
2026-03-28 14:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0f820d92-26ac-567e-8177-2a26b589b898 with identifier: HS01643 to the API
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:57:11Z',
 'fuel_type': 'diesel',
 'id': '0f820d92-26ac-567e-8177-2a26b589b898',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS01643',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 88877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-01',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS01643%27 HTTP/1.1" 200 None
2026-03-28 14:11:38 [auto1.es] INFO: Saving data for HS01643: {'auction_closing_time': 1774717031.0, 'created_time': 1774382851.902122, 'last_price_update_time': 1774707098.017815}
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HS01643') HTTP/1.1" 204 0
2026-03-28 14:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a4c88bbe-b2a2-579b-ae10-f19ad25dcccc with identifier: EG02791
2026-03-28 14:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a4c88bbe-b2a2-579b-ae10-f19ad25dcccc with identifier: EG02791
2026-03-28 14:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a4c88bbe-b2a2-579b-ae10-f19ad25dcccc with identifier: EG02791 to the API
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:03:14Z',
 'fuel_type': 'petrol',
 'id': 'a4c88bbe-b2a2-579b-ae10-f19ad25dcccc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG02791',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30 Fastback',
 'odometer': 9854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-07',
 'seller_name': None,
 'title': 'Hyundai i30 Fastback 1.0 T-GDI N Line',
 'transmission': 'manual',
 'trim': 'N Line',
 'year': 2024}
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG02791%27 HTTP/1.1" 200 None
2026-03-28 14:11:38 [auto1.es] INFO: Saving data for EG02791: {'auction_closing_time': 1774713794.0, 'created_time': 1773346128.22533, 'last_price_update_time': 1774707098.285307}
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EG02791') HTTP/1.1" 204 0
2026-03-28 14:11:38 [auto1.es] INFO: Found listing with ID: CF60022
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF60022%27 HTTP/1.1" 200 None
2026-03-28 14:11:38 [auto1.es] INFO: Scrape type for CF60022: 2
2026-03-28 14:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f413e7ad-beb9-5193-9ba5-f6f8a2306bb0 with identifier: CF60022
2026-03-28 14:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f413e7ad-beb9-5193-9ba5-f6f8a2306bb0 with scrape type 2
2026-03-28 14:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f413e7ad-beb9-5193-9ba5-f6f8a2306bb0 with scrape type 2
2026-03-28 14:11:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f413e7ad-beb9-5193-9ba5-f6f8a2306bb0, identifier: CF60022
2026-03-28 14:11:38 [auto1.es] INFO: Found listing with ID: DF32061
2026-03-28 14:11:38 [auto1.es] INFO: Found listing with ID: JA56838
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA56838%27 HTTP/1.1" 200 None
2026-03-28 14:11:38 [auto1.es] INFO: Scrape type for JA56838: 2
2026-03-28 14:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f29398a-a858-592b-8ec6-21ea942478f6 with identifier: JA56838
2026-03-28 14:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f29398a-a858-592b-8ec6-21ea942478f6 with scrape type 2
2026-03-28 14:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f29398a-a858-592b-8ec6-21ea942478f6 with scrape type 2
2026-03-28 14:11:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f29398a-a858-592b-8ec6-21ea942478f6, identifier: JA56838
2026-03-28 14:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f413e7ad-beb9-5193-9ba5-f6f8a2306bb0 with identifier: CF60022
2026-03-28 14:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f413e7ad-beb9-5193-9ba5-f6f8a2306bb0 with identifier: CF60022
2026-03-28 14:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f413e7ad-beb9-5193-9ba5-f6f8a2306bb0 with identifier: CF60022 to the API
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:00:01Z',
 'fuel_type': 'hybrid',
 'id': 'f413e7ad-beb9-5193-9ba5-f6f8a2306bb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF60022',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4',
 'odometer': 19494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-25',
 'seller_name': None,
 'title': 'DS Automobiles DS4 1.6 E-Tense Hybrid Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2024}
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF60022%27 HTTP/1.1" 200 None
2026-03-28 14:11:38 [auto1.es] INFO: Saving data for CF60022: {'auction_closing_time': 1774713601.0, 'created_time': 1773130804.189858, 'last_price_update_time': 1774707098.778934}
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CF60022') HTTP/1.1" 204 0
2026-03-28 14:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f29398a-a858-592b-8ec6-21ea942478f6 with identifier: JA56838
2026-03-28 14:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f29398a-a858-592b-8ec6-21ea942478f6 with identifier: JA56838
2026-03-28 14:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f29398a-a858-592b-8ec6-21ea942478f6 with identifier: JA56838 to the API
2026-03-28 14:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:20:13Z',
 'fuel_type': 'petrol',
 'id': '6f29398a-a858-592b-8ec6-21ea942478f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA56838',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 63705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-10',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 TDGI go!+',
 'transmission': 'manual',
 'trim': 'go!+',
 'year': 2019}
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA56838%27 HTTP/1.1" 200 None
2026-03-28 14:11:39 [auto1.es] INFO: Saving data for JA56838: {'auction_closing_time': 1774714813.0, 'created_time': 1773659767.757197, 'last_price_update_time': 1774707099.150624}
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JA56838') HTTP/1.1" 204 0
2026-03-28 14:11:39 [auto1.es] INFO: Found listing with ID: TP19820
2026-03-28 14:11:39 [auto1.es] INFO: Found listing with ID: UP13396
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP13396%27 HTTP/1.1" 200 None
2026-03-28 14:11:39 [auto1.es] INFO: Scrape type for UP13396: 2
2026-03-28 14:11:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0a33f7f-b744-5fe2-8167-ff0f7c2d2bce with identifier: UP13396
2026-03-28 14:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0a33f7f-b744-5fe2-8167-ff0f7c2d2bce with scrape type 2
2026-03-28 14:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0a33f7f-b744-5fe2-8167-ff0f7c2d2bce with scrape type 2
2026-03-28 14:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c0a33f7f-b744-5fe2-8167-ff0f7c2d2bce, identifier: UP13396
2026-03-28 14:11:39 [auto1.es] INFO: Found listing with ID: ZH85985
2026-03-28 14:11:39 [auto1.es] INFO: Found listing with ID: YD78878
2026-03-28 14:11:39 [auto1.es] INFO: Found listing with ID: BB57842
2026-03-28 14:11:39 [auto1.es] INFO: Found listing with ID: FP11877
2026-03-28 14:11:39 [auto1.es] INFO: Found listing with ID: XS07722
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS07722%27 HTTP/1.1" 200 None
2026-03-28 14:11:39 [auto1.es] INFO: Scrape type for XS07722: 2
2026-03-28 14:11:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57755c3c-cbe8-500e-b6b1-93308049e358 with identifier: XS07722
2026-03-28 14:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57755c3c-cbe8-500e-b6b1-93308049e358 with scrape type 2
2026-03-28 14:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57755c3c-cbe8-500e-b6b1-93308049e358 with scrape type 2
2026-03-28 14:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 57755c3c-cbe8-500e-b6b1-93308049e358, identifier: XS07722
2026-03-28 14:11:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c0a33f7f-b744-5fe2-8167-ff0f7c2d2bce with identifier: UP13396
2026-03-28 14:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c0a33f7f-b744-5fe2-8167-ff0f7c2d2bce with identifier: UP13396
2026-03-28 14:11:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c0a33f7f-b744-5fe2-8167-ff0f7c2d2bce with identifier: UP13396 to the API
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:11:15Z',
 'fuel_type': 'diesel',
 'id': 'c0a33f7f-b744-5fe2-8167-ff0f7c2d2bce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP13396',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 California',
 'odometer': 80093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-01',
 'seller_name': None,
 'title': 'Volkswagen T5 California 2.5 TDI Comfortline Aufstelldach',
 'transmission': 'manual',
 'trim': 'Comfortline Aufstelldach',
 'year': 2007}
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP13396%27 HTTP/1.1" 200 None
2026-03-28 14:11:39 [auto1.es] INFO: Saving data for UP13396: {'auction_closing_time': 1774714275.0, 'created_time': 1774620447.566496, 'last_price_update_time': 1774707099.62053}
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UP13396') HTTP/1.1" 204 0
2026-03-28 14:11:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 57755c3c-cbe8-500e-b6b1-93308049e358 with identifier: XS07722
2026-03-28 14:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 57755c3c-cbe8-500e-b6b1-93308049e358 with identifier: XS07722
2026-03-28 14:11:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 57755c3c-cbe8-500e-b6b1-93308049e358 with identifier: XS07722 to the API
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-28T16:46:02Z',
 'fuel_type': 'hybrid',
 'id': '57755c3c-cbe8-500e-b6b1-93308049e358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS07722',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 76970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid 4x4 Rivoli +',
 'transmission': 'automatic',
 'trim': '4x4 Rivoli +',
 'year': 2022}
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS07722%27 HTTP/1.1" 200 None
2026-03-28 14:11:39 [auto1.es] INFO: Saving data for XS07722: {'auction_closing_time': 1774716362.0, 'created_time': 1773130764.721538, 'last_price_update_time': 1774707099.899086}
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XS07722') HTTP/1.1" 204 0
2026-03-28 14:11:39 [auto1.es] INFO: Found listing with ID: HF43157
2026-03-28 14:11:39 [auto1.es] INFO: Found listing with ID: RD87944
2026-03-28 14:11:39 [auto1.es] INFO: Found listing with ID: CV42273
2026-03-28 14:11:39 [auto1.es] INFO: Found listing with ID: LV56361
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV56361%27 HTTP/1.1" 200 None
2026-03-28 14:11:39 [auto1.es] INFO: Scrape type for LV56361: 0
2026-03-28 14:11:39 [auto1.es] INFO: Found listing with ID: TW64158
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW64158%27 HTTP/1.1" 200 None
2026-03-28 14:11:39 [auto1.es] INFO: Scrape type for TW64158: 2
2026-03-28 14:11:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00c28f65-be75-55ad-a859-0dd7d95af6bf with identifier: TW64158
2026-03-28 14:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00c28f65-be75-55ad-a859-0dd7d95af6bf with scrape type 2
2026-03-28 14:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00c28f65-be75-55ad-a859-0dd7d95af6bf with scrape type 2
2026-03-28 14:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 00c28f65-be75-55ad-a859-0dd7d95af6bf, identifier: TW64158
2026-03-28 14:11:40 [auto1.es] INFO: Found listing with ID: SM50481
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM50481%27 HTTP/1.1" 200 None
2026-03-28 14:11:40 [auto1.es] INFO: Scrape type for SM50481: 2
2026-03-28 14:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dda60b9-bb0c-5a5d-87f0-7e340344e5e3 with identifier: SM50481
2026-03-28 14:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dda60b9-bb0c-5a5d-87f0-7e340344e5e3 with scrape type 2
2026-03-28 14:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dda60b9-bb0c-5a5d-87f0-7e340344e5e3 with scrape type 2
2026-03-28 14:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0dda60b9-bb0c-5a5d-87f0-7e340344e5e3, identifier: SM50481
2026-03-28 14:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 00c28f65-be75-55ad-a859-0dd7d95af6bf with identifier: TW64158
2026-03-28 14:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 00c28f65-be75-55ad-a859-0dd7d95af6bf with identifier: TW64158
2026-03-28 14:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 00c28f65-be75-55ad-a859-0dd7d95af6bf with identifier: TW64158 to the API
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:52:38Z',
 'fuel_type': 'electro',
 'id': '00c28f65-be75-55ad-a859-0dd7d95af6bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW64158',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 94119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seller_name': None,
 'title': 'Peugeot 2008 electric drive 57 kW e Active',
 'transmission': 'automatic',
 'trim': 'e Active',
 'year': 2021}
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW64158%27 HTTP/1.1" 200 None
2026-03-28 14:11:40 [auto1.es] INFO: Saving data for TW64158: {'auction_closing_time': 1774716758.0, 'created_time': 1773130917.963237, 'last_price_update_time': 1774707100.54883}
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TW64158') HTTP/1.1" 204 0
2026-03-28 14:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0dda60b9-bb0c-5a5d-87f0-7e340344e5e3 with identifier: SM50481
2026-03-28 14:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0dda60b9-bb0c-5a5d-87f0-7e340344e5e3 with identifier: SM50481
2026-03-28 14:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0dda60b9-bb0c-5a5d-87f0-7e340344e5e3 with identifier: SM50481 to the API
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:44:53Z',
 'fuel_type': 'diesel',
 'id': '0dda60b9-bb0c-5a5d-87f0-7e340344e5e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM50481',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 219329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2019}
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM50481%27 HTTP/1.1" 200 None
2026-03-28 14:11:40 [auto1.es] INFO: Saving data for SM50481: {'auction_closing_time': 1774716293.0, 'created_time': 1773127503.060957, 'last_price_update_time': 1774707100.93581}
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SM50481') HTTP/1.1" 204 0
2026-03-28 14:11:40 [auto1.es] INFO: Found listing with ID: KU36165
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU36165%27 HTTP/1.1" 200 None
2026-03-28 14:11:40 [auto1.es] INFO: Scrape type for KU36165: 2
2026-03-28 14:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 064251e0-b4a6-5e71-a7c3-b90915003318 with identifier: KU36165
2026-03-28 14:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 064251e0-b4a6-5e71-a7c3-b90915003318 with scrape type 2
2026-03-28 14:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 064251e0-b4a6-5e71-a7c3-b90915003318 with scrape type 2
2026-03-28 14:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 064251e0-b4a6-5e71-a7c3-b90915003318, identifier: KU36165
2026-03-28 14:11:41 [auto1.es] INFO: Found listing with ID: AM60182
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM60182%27 HTTP/1.1" 200 None
2026-03-28 14:11:41 [auto1.es] INFO: Scrape type for AM60182: 2
2026-03-28 14:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95cf9c3c-7474-5da4-8acf-2e678bf6da59 with identifier: AM60182
2026-03-28 14:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95cf9c3c-7474-5da4-8acf-2e678bf6da59 with scrape type 2
2026-03-28 14:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95cf9c3c-7474-5da4-8acf-2e678bf6da59 with scrape type 2
2026-03-28 14:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 95cf9c3c-7474-5da4-8acf-2e678bf6da59, identifier: AM60182
2026-03-28 14:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 064251e0-b4a6-5e71-a7c3-b90915003318 with identifier: KU36165
2026-03-28 14:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 064251e0-b4a6-5e71-a7c3-b90915003318 with identifier: KU36165
2026-03-28 14:11:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 064251e0-b4a6-5e71-a7c3-b90915003318 with identifier: KU36165 to the API
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:44:10Z',
 'fuel_type': 'diesel',
 'id': '064251e0-b4a6-5e71-a7c3-b90915003318',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU36165',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 189321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU36165%27 HTTP/1.1" 200 None
2026-03-28 14:11:41 [auto1.es] INFO: Saving data for KU36165: {'auction_closing_time': 1774716250.0, 'created_time': 1774382880.391725, 'last_price_update_time': 1774707101.4121}
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KU36165') HTTP/1.1" 204 0
2026-03-28 14:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 95cf9c3c-7474-5da4-8acf-2e678bf6da59 with identifier: AM60182
2026-03-28 14:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 95cf9c3c-7474-5da4-8acf-2e678bf6da59 with identifier: AM60182
2026-03-28 14:11:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 95cf9c3c-7474-5da4-8acf-2e678bf6da59 with identifier: AM60182 to the API
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-28T16:36:43Z',
 'fuel_type': 'hybrid',
 'id': '95cf9c3c-7474-5da4-8acf-2e678bf6da59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM60182',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7',
 'odometer': 29839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seller_name': None,
 'title': 'DS Automobiles DS7 1.6 E-Tense Hybrid 4x4 Rivoli',
 'transmission': 'automatic',
 'trim': '4x4 Rivoli',
 'year': 2022}
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM60182%27 HTTP/1.1" 200 None
2026-03-28 14:11:41 [auto1.es] INFO: Saving data for AM60182: {'auction_closing_time': 1774715803.0, 'created_time': 1773130806.429879, 'last_price_update_time': 1774707101.669616}
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AM60182') HTTP/1.1" 204 0
2026-03-28 14:11:41 [auto1.es] INFO: Found listing with ID: FG19732
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG19732%27 HTTP/1.1" 200 None
2026-03-28 14:11:41 [auto1.es] INFO: Scrape type for FG19732: 2
2026-03-28 14:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e82dae-3fb8-524b-ab8f-672401617265 with identifier: FG19732
2026-03-28 14:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e82dae-3fb8-524b-ab8f-672401617265 with scrape type 2
2026-03-28 14:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33e82dae-3fb8-524b-ab8f-672401617265 with scrape type 2
2026-03-28 14:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 33e82dae-3fb8-524b-ab8f-672401617265, identifier: FG19732
2026-03-28 14:11:41 [auto1.es] INFO: Found listing with ID: WR08352
2026-03-28 14:11:41 [auto1.es] INFO: Found listing with ID: GY73641
2026-03-28 14:11:41 [auto1.es] INFO: Found listing with ID: LB26536
2026-03-28 14:11:41 [auto1.es] INFO: Found listing with ID: FE19310
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE19310%27 HTTP/1.1" 200 None
2026-03-28 14:11:41 [auto1.es] INFO: Scrape type for FE19310: 2
2026-03-28 14:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b553a720-9c9e-56c0-a3fd-d764b5253c10 with identifier: FE19310
2026-03-28 14:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b553a720-9c9e-56c0-a3fd-d764b5253c10 with scrape type 2
2026-03-28 14:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b553a720-9c9e-56c0-a3fd-d764b5253c10 with scrape type 2
2026-03-28 14:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b553a720-9c9e-56c0-a3fd-d764b5253c10, identifier: FE19310
2026-03-28 14:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 33e82dae-3fb8-524b-ab8f-672401617265 with identifier: FG19732
2026-03-28 14:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 33e82dae-3fb8-524b-ab8f-672401617265 with identifier: FG19732
2026-03-28 14:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 33e82dae-3fb8-524b-ab8f-672401617265 with identifier: FG19732 to the API
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:07:07Z',
 'fuel_type': 'diesel',
 'id': '33e82dae-3fb8-524b-ab8f-672401617265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG19732',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 155754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Live Pack Business M',
 'transmission': 'manual',
 'trim': 'Live Pack Business M',
 'year': 2022}
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG19732%27 HTTP/1.1" 200 None
2026-03-28 14:11:42 [auto1.es] INFO: Saving data for FG19732: {'auction_closing_time': 1774714027.0, 'created_time': 1773130896.729942, 'last_price_update_time': 1774707102.182714}
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FG19732') HTTP/1.1" 204 0
2026-03-28 14:11:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b553a720-9c9e-56c0-a3fd-d764b5253c10 with identifier: FE19310
2026-03-28 14:11:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b553a720-9c9e-56c0-a3fd-d764b5253c10 with identifier: FE19310
2026-03-28 14:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b553a720-9c9e-56c0-a3fd-d764b5253c10 with identifier: FE19310 to the API
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:30:21Z',
 'fuel_type': 'diesel',
 'id': 'b553a720-9c9e-56c0-a3fd-d764b5253c10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE19310',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 142534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-28',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE19310%27 HTTP/1.1" 200 None
2026-03-28 14:11:42 [auto1.es] INFO: Saving data for FE19310: {'auction_closing_time': 1774715421.0, 'created_time': 1774382838.941911, 'last_price_update_time': 1774707102.445911}
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FE19310') HTTP/1.1" 204 0
2026-03-28 14:11:42 [auto1.es] INFO: Found listing with ID: BP57031
2026-03-28 14:11:42 [auto1.es] INFO: Found listing with ID: RY21508
2026-03-28 14:11:42 [auto1.es] INFO: Found listing with ID: FV98550
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV98550%27 HTTP/1.1" 200 None
2026-03-28 14:11:42 [auto1.es] INFO: Scrape type for FV98550: 2
2026-03-28 14:11:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53eb734-9f85-5b69-9861-5858f18c7942 with identifier: FV98550
2026-03-28 14:11:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53eb734-9f85-5b69-9861-5858f18c7942 with scrape type 2
2026-03-28 14:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e53eb734-9f85-5b69-9861-5858f18c7942 with scrape type 2
2026-03-28 14:11:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e53eb734-9f85-5b69-9861-5858f18c7942, identifier: FV98550
2026-03-28 14:11:42 [auto1.es] INFO: Found listing with ID: XB79448
2026-03-28 14:11:42 [auto1.es] INFO: Found listing with ID: ME14626
2026-03-28 14:11:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e53eb734-9f85-5b69-9861-5858f18c7942 with identifier: FV98550
2026-03-28 14:11:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e53eb734-9f85-5b69-9861-5858f18c7942 with identifier: FV98550
2026-03-28 14:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e53eb734-9f85-5b69-9861-5858f18c7942 with identifier: FV98550 to the API
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:47:56Z',
 'fuel_type': 'diesel',
 'id': 'e53eb734-9f85-5b69-9861-5858f18c7942',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV98550',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 80603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-21',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV98550%27 HTTP/1.1" 200 None
2026-03-28 14:11:42 [auto1.es] INFO: Saving data for FV98550: {'auction_closing_time': 1774716476.0, 'created_time': 1773126755.367944, 'last_price_update_time': 1774707102.946977}
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FV98550') HTTP/1.1" 204 0
2026-03-28 14:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:11:43 [auto1.es] INFO: Found listing with ID: NN72545
2026-03-28 14:11:43 [auto1.es] INFO: Found listing with ID: PX05110
2026-03-28 14:11:43 [auto1.es] INFO: Found listing with ID: VK69645
2026-03-28 14:11:43 [auto1.es] INFO: Found listing with ID: MV52589
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV52589%27 HTTP/1.1" 200 None
2026-03-28 14:11:43 [auto1.es] INFO: Scrape type for MV52589: 2
2026-03-28 14:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b83ceb4c-29dd-5a7e-8ec5-439efb40f8ef with identifier: MV52589
2026-03-28 14:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b83ceb4c-29dd-5a7e-8ec5-439efb40f8ef with scrape type 2
2026-03-28 14:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b83ceb4c-29dd-5a7e-8ec5-439efb40f8ef with scrape type 2
2026-03-28 14:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b83ceb4c-29dd-5a7e-8ec5-439efb40f8ef, identifier: MV52589
2026-03-28 14:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b83ceb4c-29dd-5a7e-8ec5-439efb40f8ef with identifier: MV52589
2026-03-28 14:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b83ceb4c-29dd-5a7e-8ec5-439efb40f8ef with identifier: MV52589
2026-03-28 14:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b83ceb4c-29dd-5a7e-8ec5-439efb40f8ef with identifier: MV52589 to the API
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:17Z',
 'fuel_type': 'diesel',
 'id': 'b83ceb4c-29dd-5a7e-8ec5-439efb40f8ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV52589',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 147627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV52589%27 HTTP/1.1" 200 None
2026-03-28 14:11:43 [auto1.es] INFO: Saving data for MV52589: {'auction_closing_time': 1774714397.0, 'created_time': 1774382882.417786, 'last_price_update_time': 1774707103.42914}
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MV52589') HTTP/1.1" 204 0
2026-03-28 14:11:43 [auto1.es] INFO: Found listing with ID: YT36266
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT36266%27 HTTP/1.1" 200 None
2026-03-28 14:11:43 [auto1.es] INFO: Scrape type for YT36266: 2
2026-03-28 14:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42948e3f-99bc-5b31-8bf1-d92fb726475a with identifier: YT36266
2026-03-28 14:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42948e3f-99bc-5b31-8bf1-d92fb726475a with scrape type 2
2026-03-28 14:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42948e3f-99bc-5b31-8bf1-d92fb726475a with scrape type 2
2026-03-28 14:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 42948e3f-99bc-5b31-8bf1-d92fb726475a, identifier: YT36266
2026-03-28 14:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 42948e3f-99bc-5b31-8bf1-d92fb726475a with identifier: YT36266
2026-03-28 14:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 42948e3f-99bc-5b31-8bf1-d92fb726475a with identifier: YT36266
2026-03-28 14:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 42948e3f-99bc-5b31-8bf1-d92fb726475a with identifier: YT36266 to the API
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:28:19Z',
 'fuel_type': 'diesel',
 'id': '42948e3f-99bc-5b31-8bf1-d92fb726475a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT36266',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 89363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-13',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT36266%27 HTTP/1.1" 200 None
2026-03-28 14:11:43 [auto1.es] INFO: Saving data for YT36266: {'auction_closing_time': 1774715299.0, 'created_time': 1773130934.249131, 'last_price_update_time': 1774707103.790199}
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YT36266') HTTP/1.1" 204 0
2026-03-28 14:11:43 [auto1.es] INFO: Found listing with ID: BM28897
2026-03-28 14:11:43 [auto1.es] INFO: Found listing with ID: YJ05760
2026-03-28 14:11:43 [auto1.es] INFO: Found listing with ID: PH65326
2026-03-28 14:11:43 [auto1.es] INFO: Found listing with ID: ED82323
2026-03-28 14:11:43 [auto1.es] INFO: Found listing with ID: YF71759
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF71759%27 HTTP/1.1" 200 None
2026-03-28 14:11:43 [auto1.es] INFO: Scrape type for YF71759: 2
2026-03-28 14:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d56be79-024c-5e93-ac29-a982df34edb1 with identifier: YF71759
2026-03-28 14:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d56be79-024c-5e93-ac29-a982df34edb1 with scrape type 2
2026-03-28 14:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d56be79-024c-5e93-ac29-a982df34edb1 with scrape type 2
2026-03-28 14:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5d56be79-024c-5e93-ac29-a982df34edb1, identifier: YF71759
2026-03-28 14:11:43 [auto1.es] INFO: Channel: 24h | Page: 55 | totalHits: 2698 | hits on page: 40
2026-03-28 14:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5d56be79-024c-5e93-ac29-a982df34edb1 with identifier: YF71759
2026-03-28 14:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5d56be79-024c-5e93-ac29-a982df34edb1 with identifier: YF71759
2026-03-28 14:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5d56be79-024c-5e93-ac29-a982df34edb1 with identifier: YF71759 to the API
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:12:43Z',
 'fuel_type': 'hybrid',
 'id': '5d56be79-024c-5e93-ac29-a982df34edb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF71759',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 65165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-30',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.5 Dualjet Hybrid Comfort 4x4',
 'transmission': 'automatic',
 'trim': 'Comfort 4x4',
 'year': 2022}
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF71759%27 HTTP/1.1" 200 None
2026-03-28 14:11:44 [auto1.es] INFO: Saving data for YF71759: {'auction_closing_time': 1774714363.0, 'created_time': 1773130413.30341, 'last_price_update_time': 1774707104.240957}
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YF71759') HTTP/1.1" 204 0
2026-03-28 14:11:44 [auto1.es] INFO: Found listing with ID: HJ36466
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ36466%27 HTTP/1.1" 200 None
2026-03-28 14:11:44 [auto1.es] INFO: Scrape type for HJ36466: 2
2026-03-28 14:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be246c4e-ceed-50f1-ac46-1c6d8f054c6e with identifier: HJ36466
2026-03-28 14:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be246c4e-ceed-50f1-ac46-1c6d8f054c6e with scrape type 2
2026-03-28 14:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be246c4e-ceed-50f1-ac46-1c6d8f054c6e with scrape type 2
2026-03-28 14:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be246c4e-ceed-50f1-ac46-1c6d8f054c6e, identifier: HJ36466
2026-03-28 14:11:44 [auto1.es] INFO: Found listing with ID: UB63669
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB63669%27 HTTP/1.1" 200 None
2026-03-28 14:11:44 [auto1.es] INFO: Scrape type for UB63669: 2
2026-03-28 14:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2def16f4-dec7-558b-aed5-ffa15621af13 with identifier: UB63669
2026-03-28 14:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2def16f4-dec7-558b-aed5-ffa15621af13 with scrape type 2
2026-03-28 14:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2def16f4-dec7-558b-aed5-ffa15621af13 with scrape type 2
2026-03-28 14:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2def16f4-dec7-558b-aed5-ffa15621af13, identifier: UB63669
2026-03-28 14:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be246c4e-ceed-50f1-ac46-1c6d8f054c6e with identifier: HJ36466
2026-03-28 14:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be246c4e-ceed-50f1-ac46-1c6d8f054c6e with identifier: HJ36466
2026-03-28 14:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be246c4e-ceed-50f1-ac46-1c6d8f054c6e with identifier: HJ36466 to the API
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:33:37Z',
 'fuel_type': 'diesel',
 'id': 'be246c4e-ceed-50f1-ac46-1c6d8f054c6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ36466',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 322210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-29',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Tekna Sport',
 'transmission': 'manual',
 'trim': 'Tekna Sport',
 'year': 2009}
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ36466%27 HTTP/1.1" 200 None
2026-03-28 14:11:44 [auto1.es] INFO: Saving data for HJ36466: {'auction_closing_time': 1774715617.0, 'created_time': 1774620576.58327, 'last_price_update_time': 1774707104.704734}
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HJ36466') HTTP/1.1" 204 0
2026-03-28 14:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2def16f4-dec7-558b-aed5-ffa15621af13 with identifier: UB63669
2026-03-28 14:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2def16f4-dec7-558b-aed5-ffa15621af13 with identifier: UB63669
2026-03-28 14:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2def16f4-dec7-558b-aed5-ffa15621af13 with identifier: UB63669 to the API
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 209,
 'expiration_date': '2026-03-28T16:33:23Z',
 'fuel_type': 'diesel',
 'id': '2def16f4-dec7-558b-aed5-ffa15621af13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB63669',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 118127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-28',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Veloce Q4',
 'transmission': 'automatic',
 'trim': 'Veloce Q4',
 'year': 2023}
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB63669%27 HTTP/1.1" 200 None
2026-03-28 14:11:45 [auto1.es] INFO: Saving data for UB63669: {'auction_closing_time': 1774715603.0, 'created_time': 1774383050.044895, 'last_price_update_time': 1774707105.097109}
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UB63669') HTTP/1.1" 204 0
2026-03-28 14:11:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:11:45 [auto1.es] INFO: Found listing with ID: AC34566
2026-03-28 14:11:45 [auto1.es] INFO: Found listing with ID: SV63508
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV63508%27 HTTP/1.1" 200 None
2026-03-28 14:11:45 [auto1.es] INFO: Scrape type for SV63508: 2
2026-03-28 14:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2 with identifier: SV63508
2026-03-28 14:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2 with scrape type 2
2026-03-28 14:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2 with scrape type 2
2026-03-28 14:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2, identifier: SV63508
2026-03-28 14:11:45 [auto1.es] INFO: Found listing with ID: NP13134
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP13134%27 HTTP/1.1" 200 None
2026-03-28 14:11:45 [auto1.es] INFO: Scrape type for NP13134: 2
2026-03-28 14:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ba23d0-c068-5dbf-853d-1c5bdd431114 with identifier: NP13134
2026-03-28 14:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ba23d0-c068-5dbf-853d-1c5bdd431114 with scrape type 2
2026-03-28 14:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20ba23d0-c068-5dbf-853d-1c5bdd431114 with scrape type 2
2026-03-28 14:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 20ba23d0-c068-5dbf-853d-1c5bdd431114, identifier: NP13134
2026-03-28 14:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2 with identifier: SV63508
2026-03-28 14:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2 with identifier: SV63508
2026-03-28 14:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5c7767de-c6b4-5eb4-8dd1-337737fbe1b2 with identifier: SV63508 to the API
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:43:18Z',
 'fuel_type': 'diesel',
 'id': '5c7767de-c6b4-5eb4-8dd1-337737fbe1b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV63508',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 159298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV63508%27 HTTP/1.1" 200 None
2026-03-28 14:11:45 [auto1.es] INFO: Saving data for SV63508: {'auction_closing_time': 1774716198.0, 'created_time': 1773131082.712723, 'last_price_update_time': 1774707105.595385}
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SV63508') HTTP/1.1" 204 0
2026-03-28 14:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 20ba23d0-c068-5dbf-853d-1c5bdd431114 with identifier: NP13134
2026-03-28 14:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 20ba23d0-c068-5dbf-853d-1c5bdd431114 with identifier: NP13134
2026-03-28 14:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 20ba23d0-c068-5dbf-853d-1c5bdd431114 with identifier: NP13134 to the API
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:02:33Z',
 'fuel_type': 'diesel',
 'id': '20ba23d0-c068-5dbf-853d-1c5bdd431114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP13134',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 71468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP13134%27 HTTP/1.1" 200 None
2026-03-28 14:11:45 [auto1.es] INFO: Saving data for NP13134: {'auction_closing_time': 1774713753.0, 'created_time': 1773691870.612931, 'last_price_update_time': 1774707105.867263}
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NP13134') HTTP/1.1" 204 0
2026-03-28 14:11:45 [auto1.es] INFO: Found listing with ID: XR63585
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR63585%27 HTTP/1.1" 200 None
2026-03-28 14:11:45 [auto1.es] INFO: Scrape type for XR63585: 2
2026-03-28 14:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e0efc9b-3af4-5c15-a2b0-2410cef67347 with identifier: XR63585
2026-03-28 14:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e0efc9b-3af4-5c15-a2b0-2410cef67347 with scrape type 2
2026-03-28 14:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e0efc9b-3af4-5c15-a2b0-2410cef67347 with scrape type 2
2026-03-28 14:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4e0efc9b-3af4-5c15-a2b0-2410cef67347, identifier: XR63585
2026-03-28 14:11:45 [auto1.es] INFO: Found listing with ID: ES80363
2026-03-28 14:11:46 [auto1.es] INFO: Found listing with ID: NA66808
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA66808%27 HTTP/1.1" 200 None
2026-03-28 14:11:46 [auto1.es] INFO: Scrape type for NA66808: 2
2026-03-28 14:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15e9b200-a03e-5322-8cf2-159dccf647d0 with identifier: NA66808
2026-03-28 14:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15e9b200-a03e-5322-8cf2-159dccf647d0 with scrape type 2
2026-03-28 14:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15e9b200-a03e-5322-8cf2-159dccf647d0 with scrape type 2
2026-03-28 14:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15e9b200-a03e-5322-8cf2-159dccf647d0, identifier: NA66808
2026-03-28 14:11:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4e0efc9b-3af4-5c15-a2b0-2410cef67347 with identifier: XR63585
2026-03-28 14:11:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4e0efc9b-3af4-5c15-a2b0-2410cef67347 with identifier: XR63585
2026-03-28 14:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4e0efc9b-3af4-5c15-a2b0-2410cef67347 with identifier: XR63585 to the API
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:22:23Z',
 'fuel_type': 'diesel',
 'id': '4e0efc9b-3af4-5c15-a2b0-2410cef67347',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR63585',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 76648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi L3',
 'transmission': 'manual',
 'trim': 'L3',
 'year': 2020}
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR63585%27 HTTP/1.1" 200 None
2026-03-28 14:11:46 [auto1.es] INFO: Saving data for XR63585: {'auction_closing_time': 1774714943.0, 'created_time': 1773131050.212013, 'last_price_update_time': 1774707106.371313}
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XR63585') HTTP/1.1" 204 0
2026-03-28 14:11:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15e9b200-a03e-5322-8cf2-159dccf647d0 with identifier: NA66808
2026-03-28 14:11:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15e9b200-a03e-5322-8cf2-159dccf647d0 with identifier: NA66808
2026-03-28 14:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 15e9b200-a03e-5322-8cf2-159dccf647d0 with identifier: NA66808 to the API
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:25:24Z',
 'fuel_type': 'petrol',
 'id': '15e9b200-a03e-5322-8cf2-159dccf647d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA66808',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 115345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA66808%27 HTTP/1.1" 200 None
2026-03-28 14:11:46 [auto1.es] INFO: Saving data for NA66808: {'auction_closing_time': 1774715124.0, 'created_time': 1773127397.030831, 'last_price_update_time': 1774707106.661471}
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NA66808') HTTP/1.1" 204 0
2026-03-28 14:11:46 [auto1.es] INFO: Found listing with ID: FM92662
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM92662%27 HTTP/1.1" 200 None
2026-03-28 14:11:46 [auto1.es] INFO: Scrape type for FM92662: 2
2026-03-28 14:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 805abea3-6636-5b52-bb96-793aa7fd1043 with identifier: FM92662
2026-03-28 14:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 805abea3-6636-5b52-bb96-793aa7fd1043 with scrape type 2
2026-03-28 14:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 805abea3-6636-5b52-bb96-793aa7fd1043 with scrape type 2
2026-03-28 14:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 805abea3-6636-5b52-bb96-793aa7fd1043, identifier: FM92662
2026-03-28 14:11:46 [auto1.es] INFO: Found listing with ID: GH55887
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH55887%27 HTTP/1.1" 200 None
2026-03-28 14:11:46 [auto1.es] INFO: Scrape type for GH55887: 2
2026-03-28 14:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 585ac8f2-7729-572c-abfc-24b37c0bb416 with identifier: GH55887
2026-03-28 14:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 585ac8f2-7729-572c-abfc-24b37c0bb416 with scrape type 2
2026-03-28 14:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 585ac8f2-7729-572c-abfc-24b37c0bb416 with scrape type 2
2026-03-28 14:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 585ac8f2-7729-572c-abfc-24b37c0bb416, identifier: GH55887
2026-03-28 14:11:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 805abea3-6636-5b52-bb96-793aa7fd1043 with identifier: FM92662
2026-03-28 14:11:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 805abea3-6636-5b52-bb96-793aa7fd1043 with identifier: FM92662
2026-03-28 14:11:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 805abea3-6636-5b52-bb96-793aa7fd1043 with identifier: FM92662 to the API
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:42Z',
 'fuel_type': 'diesel',
 'id': '805abea3-6636-5b52-bb96-793aa7fd1043',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM92662',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 24167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM92662%27 HTTP/1.1" 200 None
2026-03-28 14:11:47 [auto1.es] INFO: Saving data for FM92662: {'auction_closing_time': 1774715862.0, 'created_time': 1773131404.949862, 'last_price_update_time': 1774707107.35161}
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FM92662') HTTP/1.1" 204 0
2026-03-28 14:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 585ac8f2-7729-572c-abfc-24b37c0bb416 with identifier: GH55887
2026-03-28 14:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 585ac8f2-7729-572c-abfc-24b37c0bb416 with identifier: GH55887
2026-03-28 14:11:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 585ac8f2-7729-572c-abfc-24b37c0bb416 with identifier: GH55887 to the API
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:00:27Z',
 'fuel_type': 'diesel',
 'id': '585ac8f2-7729-572c-abfc-24b37c0bb416',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH55887',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 79706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH55887%27 HTTP/1.1" 200 None
2026-03-28 14:11:47 [auto1.es] INFO: Saving data for GH55887: {'auction_closing_time': 1774713627.0, 'created_time': 1773691885.748102, 'last_price_update_time': 1774707107.653393}
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GH55887') HTTP/1.1" 204 0
2026-03-28 14:11:47 [auto1.es] INFO: Found listing with ID: LG55317
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG55317%27 HTTP/1.1" 200 None
2026-03-28 14:11:47 [auto1.es] INFO: Scrape type for LG55317: 2
2026-03-28 14:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24393236-1cb5-542d-a14e-a08983433124 with identifier: LG55317
2026-03-28 14:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24393236-1cb5-542d-a14e-a08983433124 with scrape type 2
2026-03-28 14:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24393236-1cb5-542d-a14e-a08983433124 with scrape type 2
2026-03-28 14:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 24393236-1cb5-542d-a14e-a08983433124, identifier: LG55317
2026-03-28 14:11:47 [auto1.es] INFO: Found listing with ID: LL24572
2026-03-28 14:11:47 [auto1.es] INFO: Found listing with ID: WA42706
2026-03-28 14:11:47 [auto1.es] INFO: Found listing with ID: UJ02953
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ02953%27 HTTP/1.1" 200 None
2026-03-28 14:11:47 [auto1.es] INFO: Scrape type for UJ02953: 2
2026-03-28 14:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61007845-e139-53b9-8686-09988d89e67a with identifier: UJ02953
2026-03-28 14:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61007845-e139-53b9-8686-09988d89e67a with scrape type 2
2026-03-28 14:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61007845-e139-53b9-8686-09988d89e67a with scrape type 2
2026-03-28 14:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 61007845-e139-53b9-8686-09988d89e67a, identifier: UJ02953
2026-03-28 14:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 24393236-1cb5-542d-a14e-a08983433124 with identifier: LG55317
2026-03-28 14:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 24393236-1cb5-542d-a14e-a08983433124 with identifier: LG55317
2026-03-28 14:11:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 24393236-1cb5-542d-a14e-a08983433124 with identifier: LG55317 to the API
2026-03-28 14:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:39:44Z',
 'fuel_type': 'diesel',
 'id': '24393236-1cb5-542d-a14e-a08983433124',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG55317',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 215859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-12',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2014}
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG55317%27 HTTP/1.1" 200 None
2026-03-28 14:11:48 [auto1.es] INFO: Saving data for LG55317: {'auction_closing_time': 1774715984.0, 'created_time': 1773129138.719528, 'last_price_update_time': 1774707108.148644}
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LG55317') HTTP/1.1" 204 0
2026-03-28 14:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 61007845-e139-53b9-8686-09988d89e67a with identifier: UJ02953
2026-03-28 14:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 61007845-e139-53b9-8686-09988d89e67a with identifier: UJ02953
2026-03-28 14:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 61007845-e139-53b9-8686-09988d89e67a with identifier: UJ02953 to the API
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-28T16:17:28Z',
 'fuel_type': 'hybrid',
 'id': '61007845-e139-53b9-8686-09988d89e67a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ02953',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 99557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-14',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid 4x4 Louvre',
 'transmission': 'automatic',
 'trim': '4x4 Louvre',
 'year': 2022}
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ02953%27 HTTP/1.1" 200 None
2026-03-28 14:11:48 [auto1.es] INFO: Saving data for UJ02953: {'auction_closing_time': 1774714648.0, 'created_time': 1773130928.004529, 'last_price_update_time': 1774707108.503792}
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UJ02953') HTTP/1.1" 204 0
2026-03-28 14:11:48 [auto1.es] INFO: Found listing with ID: DY55894
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY55894%27 HTTP/1.1" 200 None
2026-03-28 14:11:48 [auto1.es] INFO: Scrape type for DY55894: 2
2026-03-28 14:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc0894b5-71d2-5307-9319-a507c4910562 with identifier: DY55894
2026-03-28 14:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc0894b5-71d2-5307-9319-a507c4910562 with scrape type 2
2026-03-28 14:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc0894b5-71d2-5307-9319-a507c4910562 with scrape type 2
2026-03-28 14:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc0894b5-71d2-5307-9319-a507c4910562, identifier: DY55894
2026-03-28 14:11:48 [auto1.es] INFO: Found listing with ID: ZZ48834
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ48834%27 HTTP/1.1" 200 None
2026-03-28 14:11:48 [auto1.es] INFO: Scrape type for ZZ48834: 2
2026-03-28 14:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd65536e-74de-587b-8292-50695c584229 with identifier: ZZ48834
2026-03-28 14:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd65536e-74de-587b-8292-50695c584229 with scrape type 2
2026-03-28 14:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd65536e-74de-587b-8292-50695c584229 with scrape type 2
2026-03-28 14:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fd65536e-74de-587b-8292-50695c584229, identifier: ZZ48834
2026-03-28 14:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc0894b5-71d2-5307-9319-a507c4910562 with identifier: DY55894
2026-03-28 14:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc0894b5-71d2-5307-9319-a507c4910562 with identifier: DY55894
2026-03-28 14:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc0894b5-71d2-5307-9319-a507c4910562 with identifier: DY55894 to the API
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:48:04Z',
 'fuel_type': 'diesel',
 'id': 'dc0894b5-71d2-5307-9319-a507c4910562',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY55894',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 146055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2020}
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY55894%27 HTTP/1.1" 200 None
2026-03-28 14:11:49 [auto1.es] INFO: Saving data for DY55894: {'auction_closing_time': 1774716484.0, 'created_time': 1773127018.013099, 'last_price_update_time': 1774707109.030767}
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DY55894') HTTP/1.1" 204 0
2026-03-28 14:11:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fd65536e-74de-587b-8292-50695c584229 with identifier: ZZ48834
2026-03-28 14:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fd65536e-74de-587b-8292-50695c584229 with identifier: ZZ48834
2026-03-28 14:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fd65536e-74de-587b-8292-50695c584229 with identifier: ZZ48834 to the API
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:17:24Z',
 'fuel_type': 'diesel',
 'id': 'fd65536e-74de-587b-8292-50695c584229',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ48834',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 124598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 220 d 4Matic Progressive',
 'transmission': 'automatic',
 'trim': '4Matic Progressive',
 'year': 2022}
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ48834%27 HTTP/1.1" 200 None
2026-03-28 14:11:49 [auto1.es] INFO: Saving data for ZZ48834: {'auction_closing_time': 1774714644.0, 'created_time': 1773130641.189495, 'last_price_update_time': 1774707109.305708}
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZZ48834') HTTP/1.1" 204 0
2026-03-28 14:11:49 [auto1.es] INFO: Found listing with ID: LN78930
2026-03-28 14:11:49 [auto1.es] INFO: Found listing with ID: EZ26896
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ26896%27 HTTP/1.1" 200 None
2026-03-28 14:11:49 [auto1.es] INFO: Scrape type for EZ26896: 2
2026-03-28 14:11:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0335d06d-36ee-54b1-a120-60846dc4181f with identifier: EZ26896
2026-03-28 14:11:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0335d06d-36ee-54b1-a120-60846dc4181f with scrape type 2
2026-03-28 14:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0335d06d-36ee-54b1-a120-60846dc4181f with scrape type 2
2026-03-28 14:11:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0335d06d-36ee-54b1-a120-60846dc4181f, identifier: EZ26896
2026-03-28 14:11:49 [auto1.es] INFO: Found listing with ID: VJ40506
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ40506%27 HTTP/1.1" 200 None
2026-03-28 14:11:49 [auto1.es] INFO: Scrape type for VJ40506: 2
2026-03-28 14:11:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd187e00-2c39-5e10-86b4-19383df0652e with identifier: VJ40506
2026-03-28 14:11:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd187e00-2c39-5e10-86b4-19383df0652e with scrape type 2
2026-03-28 14:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd187e00-2c39-5e10-86b4-19383df0652e with scrape type 2
2026-03-28 14:11:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cd187e00-2c39-5e10-86b4-19383df0652e, identifier: VJ40506
2026-03-28 14:11:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0335d06d-36ee-54b1-a120-60846dc4181f with identifier: EZ26896
2026-03-28 14:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0335d06d-36ee-54b1-a120-60846dc4181f with identifier: EZ26896
2026-03-28 14:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0335d06d-36ee-54b1-a120-60846dc4181f with identifier: EZ26896 to the API
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:05:36Z',
 'fuel_type': 'diesel',
 'id': '0335d06d-36ee-54b1-a120-60846dc4181f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ26896',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 181816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid xDrive Luxury Line',
 'transmission': 'automatic',
 'trim': 'xDrive Luxury Line',
 'year': 2021}
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ26896%27 HTTP/1.1" 200 None
2026-03-28 14:11:50 [auto1.es] INFO: Saving data for EZ26896: {'auction_closing_time': 1774713936.0, 'created_time': 1773126784.881116, 'last_price_update_time': 1774707110.04332}
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EZ26896') HTTP/1.1" 204 0
2026-03-28 14:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cd187e00-2c39-5e10-86b4-19383df0652e with identifier: VJ40506
2026-03-28 14:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cd187e00-2c39-5e10-86b4-19383df0652e with identifier: VJ40506
2026-03-28 14:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cd187e00-2c39-5e10-86b4-19383df0652e with identifier: VJ40506 to the API
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:36:30Z',
 'fuel_type': 'diesel',
 'id': 'cd187e00-2c39-5e10-86b4-19383df0652e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ40506',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 294034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-29',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2010}
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ40506%27 HTTP/1.1" 200 None
2026-03-28 14:11:50 [auto1.es] INFO: Saving data for VJ40506: {'auction_closing_time': 1774715790.0, 'created_time': 1773324440.119594, 'last_price_update_time': 1774707110.439198}
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VJ40506') HTTP/1.1" 204 0
2026-03-28 14:11:50 [auto1.es] INFO: Found listing with ID: WA45592
2026-03-28 14:11:50 [auto1.es] INFO: Found listing with ID: BG56736
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG56736%27 HTTP/1.1" 200 None
2026-03-28 14:11:50 [auto1.es] INFO: Scrape type for BG56736: 2
2026-03-28 14:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d6caffe-f69b-53eb-84c4-6f3dc9d40b06 with identifier: BG56736
2026-03-28 14:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d6caffe-f69b-53eb-84c4-6f3dc9d40b06 with scrape type 2
2026-03-28 14:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d6caffe-f69b-53eb-84c4-6f3dc9d40b06 with scrape type 2
2026-03-28 14:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4d6caffe-f69b-53eb-84c4-6f3dc9d40b06, identifier: BG56736
2026-03-28 14:11:50 [auto1.es] INFO: Found listing with ID: RN82930
2026-03-28 14:11:50 [auto1.es] INFO: Found listing with ID: GZ65389
2026-03-28 14:11:50 [auto1.es] INFO: Found listing with ID: WU84058
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU84058%27 HTTP/1.1" 200 None
2026-03-28 14:11:50 [auto1.es] INFO: Scrape type for WU84058: 2
2026-03-28 14:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f29ffbd6-4410-5ac7-9f59-879d6869060d with identifier: WU84058
2026-03-28 14:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f29ffbd6-4410-5ac7-9f59-879d6869060d with scrape type 2
2026-03-28 14:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f29ffbd6-4410-5ac7-9f59-879d6869060d with scrape type 2
2026-03-28 14:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f29ffbd6-4410-5ac7-9f59-879d6869060d, identifier: WU84058
2026-03-28 14:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4d6caffe-f69b-53eb-84c4-6f3dc9d40b06 with identifier: BG56736
2026-03-28 14:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4d6caffe-f69b-53eb-84c4-6f3dc9d40b06 with identifier: BG56736
2026-03-28 14:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4d6caffe-f69b-53eb-84c4-6f3dc9d40b06 with identifier: BG56736 to the API
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:04:32Z',
 'fuel_type': 'diesel',
 'id': '4d6caffe-f69b-53eb-84c4-6f3dc9d40b06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG56736',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 165638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-10',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 HDi Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2009}
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG56736%27 HTTP/1.1" 200 None
2026-03-28 14:11:50 [auto1.es] INFO: Saving data for BG56736: {'auction_closing_time': 1774713872.0, 'created_time': 1774620453.320359, 'last_price_update_time': 1774707110.928692}
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BG56736') HTTP/1.1" 204 0
2026-03-28 14:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f29ffbd6-4410-5ac7-9f59-879d6869060d with identifier: WU84058
2026-03-28 14:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f29ffbd6-4410-5ac7-9f59-879d6869060d with identifier: WU84058
2026-03-28 14:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f29ffbd6-4410-5ac7-9f59-879d6869060d with identifier: WU84058 to the API
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:12:10Z',
 'fuel_type': 'diesel',
 'id': 'f29ffbd6-4410-5ac7-9f59-879d6869060d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU84058',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 214683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-27',
 'seller_name': None,
 'title': 'Peugeot Expert 1.6 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2017}
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU84058%27 HTTP/1.1" 200 None
2026-03-28 14:11:51 [auto1.es] INFO: Saving data for WU84058: {'auction_closing_time': 1774714330.0, 'created_time': 1774620465.701094, 'last_price_update_time': 1774707111.186932}
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WU84058') HTTP/1.1" 204 0
2026-03-28 14:11:51 [auto1.es] INFO: Found listing with ID: KH43607
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH43607%27 HTTP/1.1" 200 None
2026-03-28 14:11:51 [auto1.es] INFO: Scrape type for KH43607: 2
2026-03-28 14:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffd0a836-1346-559c-ad01-781d4b2a796b with identifier: KH43607
2026-03-28 14:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd0a836-1346-559c-ad01-781d4b2a796b with scrape type 2
2026-03-28 14:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffd0a836-1346-559c-ad01-781d4b2a796b with scrape type 2
2026-03-28 14:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ffd0a836-1346-559c-ad01-781d4b2a796b, identifier: KH43607
2026-03-28 14:11:51 [auto1.es] INFO: Found listing with ID: ZN70323
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN70323%27 HTTP/1.1" 200 None
2026-03-28 14:11:51 [auto1.es] INFO: Scrape type for ZN70323: 2
2026-03-28 14:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a57c6bf4-49bd-5417-8a73-864b417356ae with identifier: ZN70323
2026-03-28 14:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a57c6bf4-49bd-5417-8a73-864b417356ae with scrape type 2
2026-03-28 14:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a57c6bf4-49bd-5417-8a73-864b417356ae with scrape type 2
2026-03-28 14:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a57c6bf4-49bd-5417-8a73-864b417356ae, identifier: ZN70323
2026-03-28 14:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ffd0a836-1346-559c-ad01-781d4b2a796b with identifier: KH43607
2026-03-28 14:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ffd0a836-1346-559c-ad01-781d4b2a796b with identifier: KH43607
2026-03-28 14:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ffd0a836-1346-559c-ad01-781d4b2a796b with identifier: KH43607 to the API
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:02Z',
 'fuel_type': 'diesel',
 'id': 'ffd0a836-1346-559c-ad01-781d4b2a796b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH43607',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 191608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style Go',
 'transmission': 'automatic',
 'trim': 'Style Go',
 'year': 2020}
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH43607%27 HTTP/1.1" 200 None
2026-03-28 14:11:51 [auto1.es] INFO: Saving data for KH43607: {'auction_closing_time': 1774715822.0, 'created_time': 1773126758.240493, 'last_price_update_time': 1774707111.645354}
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KH43607') HTTP/1.1" 204 0
2026-03-28 14:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a57c6bf4-49bd-5417-8a73-864b417356ae with identifier: ZN70323
2026-03-28 14:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a57c6bf4-49bd-5417-8a73-864b417356ae with identifier: ZN70323
2026-03-28 14:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a57c6bf4-49bd-5417-8a73-864b417356ae with identifier: ZN70323 to the API
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:36:46Z',
 'fuel_type': 'petrol',
 'id': 'a57c6bf4-49bd-5417-8a73-864b417356ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN70323',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 126743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-18',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Style I-Tech 30 Aniversario',
 'transmission': 'manual',
 'trim': 'Style I-Tech 30 Aniversario',
 'year': 2014}
2026-03-28 14:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN70323%27 HTTP/1.1" 200 None
2026-03-28 14:11:52 [auto1.es] INFO: Saving data for ZN70323: {'auction_closing_time': 1774715806.0, 'created_time': 1774620587.297062, 'last_price_update_time': 1774707112.005942}
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZN70323') HTTP/1.1" 204 0
2026-03-28 14:11:52 [auto1.es] INFO: Found listing with ID: EE39278
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE39278%27 HTTP/1.1" 200 None
2026-03-28 14:11:52 [auto1.es] INFO: Scrape type for EE39278: 2
2026-03-28 14:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bedb3d25-8a71-5807-8532-e6f7896b5496 with identifier: EE39278
2026-03-28 14:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedb3d25-8a71-5807-8532-e6f7896b5496 with scrape type 2
2026-03-28 14:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bedb3d25-8a71-5807-8532-e6f7896b5496 with scrape type 2
2026-03-28 14:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bedb3d25-8a71-5807-8532-e6f7896b5496, identifier: EE39278
2026-03-28 14:11:52 [auto1.es] INFO: Found listing with ID: JD05776
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JD05776%27 HTTP/1.1" 200 None
2026-03-28 14:11:52 [auto1.es] INFO: Scrape type for JD05776: 2
2026-03-28 14:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12377879-52b3-5add-9e21-22da53fd3ff4 with identifier: JD05776
2026-03-28 14:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12377879-52b3-5add-9e21-22da53fd3ff4 with scrape type 2
2026-03-28 14:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12377879-52b3-5add-9e21-22da53fd3ff4 with scrape type 2
2026-03-28 14:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 12377879-52b3-5add-9e21-22da53fd3ff4, identifier: JD05776
2026-03-28 14:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bedb3d25-8a71-5807-8532-e6f7896b5496 with identifier: EE39278
2026-03-28 14:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bedb3d25-8a71-5807-8532-e6f7896b5496 with identifier: EE39278
2026-03-28 14:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bedb3d25-8a71-5807-8532-e6f7896b5496 with identifier: EE39278 to the API
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:03Z',
 'fuel_type': 'diesel',
 'id': 'bedb3d25-8a71-5807-8532-e6f7896b5496',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE39278',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 129108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-04',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten 4Motion',
 'transmission': 'automatic',
 'trim': 'Kasten 4Motion',
 'year': 2022}
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE39278%27 HTTP/1.1" 200 None
2026-03-28 14:11:52 [auto1.es] INFO: Saving data for EE39278: {'auction_closing_time': 1774715343.0, 'created_time': 1773131055.665962, 'last_price_update_time': 1774707112.4864}
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EE39278') HTTP/1.1" 204 0
2026-03-28 14:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 12377879-52b3-5add-9e21-22da53fd3ff4 with identifier: JD05776
2026-03-28 14:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 12377879-52b3-5add-9e21-22da53fd3ff4 with identifier: JD05776
2026-03-28 14:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 12377879-52b3-5add-9e21-22da53fd3ff4 with identifier: JD05776 to the API
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:25:27Z',
 'fuel_type': 'diesel',
 'id': '12377879-52b3-5add-9e21-22da53fd3ff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD05776',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 171102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-28',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JD05776%27 HTTP/1.1" 200 None
2026-03-28 14:11:52 [auto1.es] INFO: Saving data for JD05776: {'auction_closing_time': 1774715127.0, 'created_time': 1774361478.751693, 'last_price_update_time': 1774707112.752987}
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JD05776') HTTP/1.1" 204 0
2026-03-28 14:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:11:52 [auto1.es] INFO: Found listing with ID: XZ84742
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ84742%27 HTTP/1.1" 200 None
2026-03-28 14:11:52 [auto1.es] INFO: Scrape type for XZ84742: 2
2026-03-28 14:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04951d82-0d29-5df2-bc34-5646d9cb67af with identifier: XZ84742
2026-03-28 14:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04951d82-0d29-5df2-bc34-5646d9cb67af with scrape type 2
2026-03-28 14:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04951d82-0d29-5df2-bc34-5646d9cb67af with scrape type 2
2026-03-28 14:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 04951d82-0d29-5df2-bc34-5646d9cb67af, identifier: XZ84742
2026-03-28 14:11:52 [auto1.es] INFO: Found listing with ID: ZT28887
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT28887%27 HTTP/1.1" 200 None
2026-03-28 14:11:52 [auto1.es] INFO: Scrape type for ZT28887: 2
2026-03-28 14:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da8feb41-b492-55b9-81d7-e48aeaab39be with identifier: ZT28887
2026-03-28 14:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da8feb41-b492-55b9-81d7-e48aeaab39be with scrape type 2
2026-03-28 14:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da8feb41-b492-55b9-81d7-e48aeaab39be with scrape type 2
2026-03-28 14:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: da8feb41-b492-55b9-81d7-e48aeaab39be, identifier: ZT28887
2026-03-28 14:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 04951d82-0d29-5df2-bc34-5646d9cb67af with identifier: XZ84742
2026-03-28 14:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 04951d82-0d29-5df2-bc34-5646d9cb67af with identifier: XZ84742
2026-03-28 14:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 04951d82-0d29-5df2-bc34-5646d9cb67af with identifier: XZ84742 to the API
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:46Z',
 'fuel_type': 'diesel',
 'id': '04951d82-0d29-5df2-bc34-5646d9cb67af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ84742',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 121085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style Go',
 'transmission': 'automatic',
 'trim': 'Style Go',
 'year': 2020}
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ84742%27 HTTP/1.1" 200 None
2026-03-28 14:11:53 [auto1.es] INFO: Saving data for XZ84742: {'auction_closing_time': 1774713646.0, 'created_time': 1773127020.737148, 'last_price_update_time': 1774707113.348526}
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ84742') HTTP/1.1" 204 0
2026-03-28 14:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: da8feb41-b492-55b9-81d7-e48aeaab39be with identifier: ZT28887
2026-03-28 14:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: da8feb41-b492-55b9-81d7-e48aeaab39be with identifier: ZT28887
2026-03-28 14:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: da8feb41-b492-55b9-81d7-e48aeaab39be with identifier: ZT28887 to the API
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:52:00Z',
 'fuel_type': 'petrol',
 'id': 'da8feb41-b492-55b9-81d7-e48aeaab39be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT28887',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 209671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-02',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT28887%27 HTTP/1.1" 200 None
2026-03-28 14:11:53 [auto1.es] INFO: Saving data for ZT28887: {'auction_closing_time': 1774716720.0, 'created_time': 1774015699.878968, 'last_price_update_time': 1774707113.639625}
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZT28887') HTTP/1.1" 204 0
2026-03-28 14:11:53 [auto1.es] INFO: Found listing with ID: BK86158
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK86158%27 HTTP/1.1" 200 None
2026-03-28 14:11:53 [auto1.es] INFO: Scrape type for BK86158: 2
2026-03-28 14:11:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e235fe4d-5a7b-5d50-9bd5-b379ac377a75 with identifier: BK86158
2026-03-28 14:11:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e235fe4d-5a7b-5d50-9bd5-b379ac377a75 with scrape type 2
2026-03-28 14:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e235fe4d-5a7b-5d50-9bd5-b379ac377a75 with scrape type 2
2026-03-28 14:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e235fe4d-5a7b-5d50-9bd5-b379ac377a75, identifier: BK86158
2026-03-28 14:11:53 [auto1.es] INFO: Found listing with ID: KF15980
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF15980%27 HTTP/1.1" 200 None
2026-03-28 14:11:53 [auto1.es] INFO: Scrape type for KF15980: 2
2026-03-28 14:11:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2b56bce-effa-5d0f-8fc8-929db18c3e59 with identifier: KF15980
2026-03-28 14:11:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2b56bce-effa-5d0f-8fc8-929db18c3e59 with scrape type 2
2026-03-28 14:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2b56bce-effa-5d0f-8fc8-929db18c3e59 with scrape type 2
2026-03-28 14:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d2b56bce-effa-5d0f-8fc8-929db18c3e59, identifier: KF15980
2026-03-28 14:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e235fe4d-5a7b-5d50-9bd5-b379ac377a75 with identifier: BK86158
2026-03-28 14:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e235fe4d-5a7b-5d50-9bd5-b379ac377a75 with identifier: BK86158
2026-03-28 14:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e235fe4d-5a7b-5d50-9bd5-b379ac377a75 with identifier: BK86158 to the API
2026-03-28 14:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:38Z',
 'fuel_type': 'diesel',
 'id': 'e235fe4d-5a7b-5d50-9bd5-b379ac377a75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK86158',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 130058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-22',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Advance R-Line',
 'transmission': 'automatic',
 'trim': 'Advance R-Line',
 'year': 2021}
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK86158%27 HTTP/1.1" 200 None
2026-03-28 14:11:54 [auto1.es] INFO: Saving data for BK86158: {'auction_closing_time': 1774714418.0, 'created_time': 1773131075.135997, 'last_price_update_time': 1774707114.142684}
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BK86158') HTTP/1.1" 204 0
2026-03-28 14:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d2b56bce-effa-5d0f-8fc8-929db18c3e59 with identifier: KF15980
2026-03-28 14:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d2b56bce-effa-5d0f-8fc8-929db18c3e59 with identifier: KF15980
2026-03-28 14:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d2b56bce-effa-5d0f-8fc8-929db18c3e59 with identifier: KF15980 to the API
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:30:56Z',
 'fuel_type': 'diesel',
 'id': 'd2b56bce-effa-5d0f-8fc8-929db18c3e59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF15980',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 207584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-18',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF15980%27 HTTP/1.1" 200 None
2026-03-28 14:11:54 [auto1.es] INFO: Saving data for KF15980: {'auction_closing_time': 1774715456.0, 'created_time': 1773126756.689712, 'last_price_update_time': 1774707114.409813}
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KF15980') HTTP/1.1" 204 0
2026-03-28 14:11:54 [auto1.es] INFO: Channel: 24h | Page: 56 | totalHits: 2699 | hits on page: 40
2026-03-28 14:11:54 [auto1.es] INFO: Found listing with ID: BU12450
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU12450%27 HTTP/1.1" 200 None
2026-03-28 14:11:54 [auto1.es] INFO: Scrape type for BU12450: 2
2026-03-28 14:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea93118f-84ec-588c-ab4b-459305fc1993 with identifier: BU12450
2026-03-28 14:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea93118f-84ec-588c-ab4b-459305fc1993 with scrape type 2
2026-03-28 14:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea93118f-84ec-588c-ab4b-459305fc1993 with scrape type 2
2026-03-28 14:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ea93118f-84ec-588c-ab4b-459305fc1993, identifier: BU12450
2026-03-28 14:11:54 [auto1.es] INFO: Found listing with ID: XH14423
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH14423%27 HTTP/1.1" 200 None
2026-03-28 14:11:54 [auto1.es] INFO: Scrape type for XH14423: 2
2026-03-28 14:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92d96bbd-5a02-5eb8-96a9-84104e380fe0 with identifier: XH14423
2026-03-28 14:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92d96bbd-5a02-5eb8-96a9-84104e380fe0 with scrape type 2
2026-03-28 14:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92d96bbd-5a02-5eb8-96a9-84104e380fe0 with scrape type 2
2026-03-28 14:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92d96bbd-5a02-5eb8-96a9-84104e380fe0, identifier: XH14423
2026-03-28 14:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ea93118f-84ec-588c-ab4b-459305fc1993 with identifier: BU12450
2026-03-28 14:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ea93118f-84ec-588c-ab4b-459305fc1993 with identifier: BU12450
2026-03-28 14:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ea93118f-84ec-588c-ab4b-459305fc1993 with identifier: BU12450 to the API
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:08Z',
 'fuel_type': 'diesel',
 'id': 'ea93118f-84ec-588c-ab4b-459305fc1993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU12450',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 213658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style Go',
 'transmission': 'automatic',
 'trim': 'Style Go',
 'year': 2020}
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU12450%27 HTTP/1.1" 200 None
2026-03-28 14:11:54 [auto1.es] INFO: Saving data for BU12450: {'auction_closing_time': 1774715348.0, 'created_time': 1773127019.352736, 'last_price_update_time': 1774707114.885433}
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BU12450') HTTP/1.1" 204 0
2026-03-28 14:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92d96bbd-5a02-5eb8-96a9-84104e380fe0 with identifier: XH14423
2026-03-28 14:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92d96bbd-5a02-5eb8-96a9-84104e380fe0 with identifier: XH14423
2026-03-28 14:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92d96bbd-5a02-5eb8-96a9-84104e380fe0 with identifier: XH14423 to the API
2026-03-28 14:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:13:18Z',
 'fuel_type': 'petrol',
 'id': '92d96bbd-5a02-5eb8-96a9-84104e380fe0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH14423',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 27271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-27',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 T-GDI N Line 30 Aniversario 2WD',
 'transmission': 'manual',
 'trim': 'N Line 30 Aniversario 2WD',
 'year': 2023}
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH14423%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Saving data for XH14423: {'auction_closing_time': 1774714398.0, 'created_time': 1773130625.783663, 'last_price_update_time': 1774707115.16083}
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XH14423') HTTP/1.1" 204 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: SN85132
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN85132%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for SN85132: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: PZ83937
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ83937%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for PZ83937: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: MJ22507
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: WA67007
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: AX74159
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: SL25416
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL25416%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for SL25416: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: GG82225
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG82225%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for GG82225: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: LV49535
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: DJ04712
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: GX78430
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX78430%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for GX78430: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: XA13214
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA13214%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for XA13214: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: XH50909
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH50909%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for XH50909: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: DE67964
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: TX42049
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX42049%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for TX42049: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: SG65714
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: XJ18059
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ18059%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for XJ18059: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: CY15368
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: UP27315
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP27315%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for UP27315: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: JG12289
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG12289%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for JG12289: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: RX15442
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: HT69965
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: KW14097
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW14097%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for KW14097: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: TE55978
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: DG64903
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG64903%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for DG64903: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: YE59618
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: FJ48335
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: YP50704
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: ML86623
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML86623%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for ML86623: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: AE33071
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: EY16008
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: WB62155
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB62155%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for WB62155: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: XZ16571
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: BZ14545
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ14545%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for BZ14545: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: SP81388
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP81388%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for SP81388: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: YL98507
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL98507%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for YL98507: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: UZ13447
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ13447%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for UZ13447: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: KX02596
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: VC76613
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC76613%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for VC76613: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: FE56951
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE56951%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for FE56951: 0
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: RD14633
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD14633%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for RD14633: 0
2026-03-28 14:11:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: BK45760
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: BM13295
2026-03-28 14:11:55 [auto1.es] INFO: Found listing with ID: TR57503
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR57503%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Scrape type for TR57503: 2
2026-03-28 14:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d959d8e-bae2-585a-a5dc-a236e0da5b0c with identifier: TR57503
2026-03-28 14:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d959d8e-bae2-585a-a5dc-a236e0da5b0c with scrape type 2
2026-03-28 14:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d959d8e-bae2-585a-a5dc-a236e0da5b0c with scrape type 2
2026-03-28 14:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8d959d8e-bae2-585a-a5dc-a236e0da5b0c, identifier: TR57503
2026-03-28 14:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8d959d8e-bae2-585a-a5dc-a236e0da5b0c with identifier: TR57503
2026-03-28 14:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8d959d8e-bae2-585a-a5dc-a236e0da5b0c with identifier: TR57503
2026-03-28 14:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8d959d8e-bae2-585a-a5dc-a236e0da5b0c with identifier: TR57503 to the API
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:28:43Z',
 'fuel_type': 'diesel',
 'id': '8d959d8e-bae2-585a-a5dc-a236e0da5b0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR57503',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 143135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-16',
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR57503%27 HTTP/1.1" 200 None
2026-03-28 14:11:55 [auto1.es] INFO: Saving data for TR57503: {'auction_closing_time': 1774715323.0, 'created_time': 1773952493.858692, 'last_price_update_time': 1774707115.911606}
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TR57503') HTTP/1.1" 204 0
2026-03-28 14:11:56 [auto1.es] INFO: Found listing with ID: XW97577
2026-03-28 14:11:56 [auto1.es] INFO: Found listing with ID: PF88217
2026-03-28 14:11:56 [auto1.es] INFO: Found listing with ID: MB16167
2026-03-28 14:11:56 [auto1.es] INFO: Found listing with ID: EG85848
2026-03-28 14:11:56 [auto1.es] INFO: Found listing with ID: UZ66881
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ66881%27 HTTP/1.1" 200 None
2026-03-28 14:11:56 [auto1.es] INFO: Scrape type for UZ66881: 2
2026-03-28 14:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f719be1-5e7e-5870-ad32-ee4f5ab65331 with identifier: UZ66881
2026-03-28 14:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f719be1-5e7e-5870-ad32-ee4f5ab65331 with scrape type 2
2026-03-28 14:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f719be1-5e7e-5870-ad32-ee4f5ab65331 with scrape type 2
2026-03-28 14:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f719be1-5e7e-5870-ad32-ee4f5ab65331, identifier: UZ66881
2026-03-28 14:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f719be1-5e7e-5870-ad32-ee4f5ab65331 with identifier: UZ66881
2026-03-28 14:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f719be1-5e7e-5870-ad32-ee4f5ab65331 with identifier: UZ66881
2026-03-28 14:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f719be1-5e7e-5870-ad32-ee4f5ab65331 with identifier: UZ66881 to the API
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:55:36Z',
 'fuel_type': 'diesel',
 'id': '3f719be1-5e7e-5870-ad32-ee4f5ab65331',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ66881',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 77394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-04',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ66881%27 HTTP/1.1" 200 None
2026-03-28 14:11:56 [auto1.es] INFO: Saving data for UZ66881: {'auction_closing_time': 1774716936.0, 'created_time': 1773130442.807556, 'last_price_update_time': 1774707116.38433}
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UZ66881') HTTP/1.1" 204 0
2026-03-28 14:11:56 [auto1.es] INFO: Found listing with ID: BL63813
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL63813%27 HTTP/1.1" 200 None
2026-03-28 14:11:56 [auto1.es] INFO: Scrape type for BL63813: 2
2026-03-28 14:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7ec2c3-549e-5211-b583-f9e108e525bd with identifier: BL63813
2026-03-28 14:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7ec2c3-549e-5211-b583-f9e108e525bd with scrape type 2
2026-03-28 14:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f7ec2c3-549e-5211-b583-f9e108e525bd with scrape type 2
2026-03-28 14:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f7ec2c3-549e-5211-b583-f9e108e525bd, identifier: BL63813
2026-03-28 14:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f7ec2c3-549e-5211-b583-f9e108e525bd with identifier: BL63813
2026-03-28 14:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f7ec2c3-549e-5211-b583-f9e108e525bd with identifier: BL63813
2026-03-28 14:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f7ec2c3-549e-5211-b583-f9e108e525bd with identifier: BL63813 to the API
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:50:25Z',
 'fuel_type': 'hybrid',
 'id': '7f7ec2c3-549e-5211-b583-f9e108e525bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL63813',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4',
 'odometer': 9611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-26',
 'seller_name': None,
 'title': 'DS Automobiles DS4 1.6 E-Tense Hybrid Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2024}
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL63813%27 HTTP/1.1" 200 None
2026-03-28 14:11:56 [auto1.es] INFO: Saving data for BL63813: {'auction_closing_time': 1774716625.0, 'created_time': 1773130593.758618, 'last_price_update_time': 1774707116.759969}
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BL63813') HTTP/1.1" 204 0
2026-03-28 14:11:56 [auto1.es] INFO: Found listing with ID: EN12947
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN12947%27 HTTP/1.1" 200 None
2026-03-28 14:11:56 [auto1.es] INFO: Scrape type for EN12947: 2
2026-03-28 14:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fee7efa-1669-543d-831e-d261ab8c3a5d with identifier: EN12947
2026-03-28 14:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fee7efa-1669-543d-831e-d261ab8c3a5d with scrape type 2
2026-03-28 14:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fee7efa-1669-543d-831e-d261ab8c3a5d with scrape type 2
2026-03-28 14:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3fee7efa-1669-543d-831e-d261ab8c3a5d, identifier: EN12947
2026-03-28 14:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3fee7efa-1669-543d-831e-d261ab8c3a5d with identifier: EN12947
2026-03-28 14:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3fee7efa-1669-543d-831e-d261ab8c3a5d with identifier: EN12947
2026-03-28 14:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3fee7efa-1669-543d-831e-d261ab8c3a5d with identifier: EN12947 to the API
2026-03-28 14:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:24:16Z',
 'fuel_type': 'petrol',
 'id': '3fee7efa-1669-543d-831e-d261ab8c3a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN12947',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 246705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-28',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN12947%27 HTTP/1.1" 200 None
2026-03-28 14:11:57 [auto1.es] INFO: Saving data for EN12947: {'auction_closing_time': 1774715056.0, 'created_time': 1773346247.895184, 'last_price_update_time': 1774707117.142503}
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EN12947') HTTP/1.1" 204 0
2026-03-28 14:11:57 [auto1.es] INFO: Found listing with ID: TU33340
2026-03-28 14:11:57 [auto1.es] INFO: Found listing with ID: DV32133
2026-03-28 14:11:57 [auto1.es] INFO: Found listing with ID: ZV69106
2026-03-28 14:11:57 [auto1.es] INFO: Found listing with ID: MD70003
2026-03-28 14:11:57 [auto1.es] INFO: Found listing with ID: LA48157
2026-03-28 14:11:57 [auto1.es] INFO: Found listing with ID: EP39863
2026-03-28 14:11:57 [auto1.es] INFO: Found listing with ID: WW33252
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW33252%27 HTTP/1.1" 200 None
2026-03-28 14:11:57 [auto1.es] INFO: Scrape type for WW33252: 2
2026-03-28 14:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fdbfafa-e816-5c90-a85d-eef9e459efb3 with identifier: WW33252
2026-03-28 14:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fdbfafa-e816-5c90-a85d-eef9e459efb3 with scrape type 2
2026-03-28 14:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fdbfafa-e816-5c90-a85d-eef9e459efb3 with scrape type 2
2026-03-28 14:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5fdbfafa-e816-5c90-a85d-eef9e459efb3, identifier: WW33252
2026-03-28 14:11:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5fdbfafa-e816-5c90-a85d-eef9e459efb3 with identifier: WW33252
2026-03-28 14:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5fdbfafa-e816-5c90-a85d-eef9e459efb3 with identifier: WW33252
2026-03-28 14:11:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5fdbfafa-e816-5c90-a85d-eef9e459efb3 with identifier: WW33252 to the API
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:18:16Z',
 'fuel_type': 'diesel',
 'id': '5fdbfafa-e816-5c90-a85d-eef9e459efb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW33252',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 104101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-16',
 'seller_name': None,
 'title': 'BMW X2 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW33252%27 HTTP/1.1" 200 None
2026-03-28 14:11:57 [auto1.es] INFO: Saving data for WW33252: {'auction_closing_time': 1774714696.0, 'created_time': 1774620461.66994, 'last_price_update_time': 1774707117.500825}
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WW33252') HTTP/1.1" 204 0
2026-03-28 14:11:57 [auto1.es] INFO: Found listing with ID: GK53380
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK53380%27 HTTP/1.1" 200 None
2026-03-28 14:11:57 [auto1.es] INFO: Scrape type for GK53380: 2
2026-03-28 14:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41e0fa5-066a-51ce-9f57-95bce19e95f4 with identifier: GK53380
2026-03-28 14:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41e0fa5-066a-51ce-9f57-95bce19e95f4 with scrape type 2
2026-03-28 14:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a41e0fa5-066a-51ce-9f57-95bce19e95f4 with scrape type 2
2026-03-28 14:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a41e0fa5-066a-51ce-9f57-95bce19e95f4, identifier: GK53380
2026-03-28 14:11:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a41e0fa5-066a-51ce-9f57-95bce19e95f4 with identifier: GK53380
2026-03-28 14:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a41e0fa5-066a-51ce-9f57-95bce19e95f4 with identifier: GK53380
2026-03-28 14:11:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a41e0fa5-066a-51ce-9f57-95bce19e95f4 with identifier: GK53380 to the API
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:40Z',
 'fuel_type': 'diesel',
 'id': 'a41e0fa5-066a-51ce-9f57-95bce19e95f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK53380',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 135100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK53380%27 HTTP/1.1" 200 None
2026-03-28 14:11:57 [auto1.es] INFO: Saving data for GK53380: {'auction_closing_time': 1774716280.0, 'created_time': 1773126772.176371, 'last_price_update_time': 1774707117.953173}
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GK53380') HTTP/1.1" 204 0
2026-03-28 14:11:57 [auto1.es] INFO: Found listing with ID: GX06456
2026-03-28 14:11:57 [auto1.es] INFO: Found listing with ID: MV28926
2026-03-28 14:11:57 [auto1.es] INFO: Found listing with ID: HZ84403
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ84403%27 HTTP/1.1" 200 None
2026-03-28 14:11:57 [auto1.es] INFO: Scrape type for HZ84403: 0
2026-03-28 14:11:57 [auto1.es] INFO: Found listing with ID: SN85132
2026-03-28 14:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN85132%27 HTTP/1.1" 200 None
2026-03-28 14:11:58 [auto1.es] INFO: Scrape type for SN85132: 0
2026-03-28 14:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:11:58 [auto1.es] INFO: Channel: 24h | Page: 57 | totalHits: 2699 | hits on page: 40
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: GT51555
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: ZM80152
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: FN90345
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: ZA28450
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA28450%27 HTTP/1.1" 200 None
2026-03-28 14:11:58 [auto1.es] INFO: Scrape type for ZA28450: 0
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: VV73300
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV73300%27 HTTP/1.1" 200 None
2026-03-28 14:11:58 [auto1.es] INFO: Scrape type for VV73300: 0
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: AT54546
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: PB23846
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: VN77018
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: WG01714
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG01714%27 HTTP/1.1" 200 None
2026-03-28 14:11:58 [auto1.es] INFO: Scrape type for WG01714: 0
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: TB50178
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB50178%27 HTTP/1.1" 200 None
2026-03-28 14:11:58 [auto1.es] INFO: Scrape type for TB50178: 0
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: JK29035
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: VL72913
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL72913%27 HTTP/1.1" 200 None
2026-03-28 14:11:58 [auto1.es] INFO: Scrape type for VL72913: 2
2026-03-28 14:11:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b8caf4-8bfe-55d6-ab93-7edf960178dc with identifier: VL72913
2026-03-28 14:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b8caf4-8bfe-55d6-ab93-7edf960178dc with scrape type 2
2026-03-28 14:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46b8caf4-8bfe-55d6-ab93-7edf960178dc with scrape type 2
2026-03-28 14:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 46b8caf4-8bfe-55d6-ab93-7edf960178dc, identifier: VL72913
2026-03-28 14:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 46b8caf4-8bfe-55d6-ab93-7edf960178dc with identifier: VL72913
2026-03-28 14:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 46b8caf4-8bfe-55d6-ab93-7edf960178dc with identifier: VL72913
2026-03-28 14:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 46b8caf4-8bfe-55d6-ab93-7edf960178dc with identifier: VL72913 to the API
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:31:36Z',
 'fuel_type': 'diesel',
 'id': '46b8caf4-8bfe-55d6-ab93-7edf960178dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL72913',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 288703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL72913%27 HTTP/1.1" 200 None
2026-03-28 14:11:58 [auto1.es] INFO: Saving data for VL72913: {'auction_closing_time': 1774715496.0, 'created_time': 1773129523.870768, 'last_price_update_time': 1774707118.607304}
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VL72913') HTTP/1.1" 204 0
2026-03-28 14:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: ZZ62546
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: XP57901
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: JW76352
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW76352%27 HTTP/1.1" 200 None
2026-03-28 14:11:58 [auto1.es] INFO: Scrape type for JW76352: 0
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: AB11386
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB11386%27 HTTP/1.1" 200 None
2026-03-28 14:11:58 [auto1.es] INFO: Scrape type for AB11386: 0
2026-03-28 14:11:58 [auto1.es] INFO: Found listing with ID: XR29035
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR29035%27 HTTP/1.1" 200 None
2026-03-28 14:11:58 [auto1.es] INFO: Scrape type for XR29035: 2
2026-03-28 14:11:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39e347f9-d295-5de5-a3df-608828f432ce with identifier: XR29035
2026-03-28 14:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e347f9-d295-5de5-a3df-608828f432ce with scrape type 2
2026-03-28 14:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39e347f9-d295-5de5-a3df-608828f432ce with scrape type 2
2026-03-28 14:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 39e347f9-d295-5de5-a3df-608828f432ce, identifier: XR29035
2026-03-28 14:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 39e347f9-d295-5de5-a3df-608828f432ce with identifier: XR29035
2026-03-28 14:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 39e347f9-d295-5de5-a3df-608828f432ce with identifier: XR29035
2026-03-28 14:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 39e347f9-d295-5de5-a3df-608828f432ce with identifier: XR29035 to the API
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:55:23Z',
 'fuel_type': 'petrol',
 'id': '39e347f9-d295-5de5-a3df-608828f432ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR29035',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 310512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-10',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR29035%27 HTTP/1.1" 200 None
2026-03-28 14:11:59 [auto1.es] INFO: Saving data for XR29035: {'auction_closing_time': 1774716923.0, 'created_time': 1774620626.177833, 'last_price_update_time': 1774707119.105119}
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XR29035') HTTP/1.1" 204 0
2026-03-28 14:11:59 [auto1.es] INFO: Found listing with ID: YF06119
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF06119%27 HTTP/1.1" 200 None
2026-03-28 14:11:59 [auto1.es] INFO: Scrape type for YF06119: 2
2026-03-28 14:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cae61e0d-bc5b-5aec-90c0-01b145fe2dc0 with identifier: YF06119
2026-03-28 14:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae61e0d-bc5b-5aec-90c0-01b145fe2dc0 with scrape type 2
2026-03-28 14:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cae61e0d-bc5b-5aec-90c0-01b145fe2dc0 with scrape type 2
2026-03-28 14:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cae61e0d-bc5b-5aec-90c0-01b145fe2dc0, identifier: YF06119
2026-03-28 14:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cae61e0d-bc5b-5aec-90c0-01b145fe2dc0 with identifier: YF06119
2026-03-28 14:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cae61e0d-bc5b-5aec-90c0-01b145fe2dc0 with identifier: YF06119
2026-03-28 14:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cae61e0d-bc5b-5aec-90c0-01b145fe2dc0 with identifier: YF06119 to the API
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:17:01Z',
 'fuel_type': 'diesel',
 'id': 'cae61e0d-bc5b-5aec-90c0-01b145fe2dc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF06119',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 204573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-27',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2005}
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF06119%27 HTTP/1.1" 200 None
2026-03-28 14:11:59 [auto1.es] INFO: Saving data for YF06119: {'auction_closing_time': 1774714621.0, 'created_time': 1774620601.508314, 'last_price_update_time': 1774707119.471445}
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YF06119') HTTP/1.1" 204 0
2026-03-28 14:11:59 [auto1.es] INFO: Found listing with ID: MC71487
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC71487%27 HTTP/1.1" 200 None
2026-03-28 14:11:59 [auto1.es] INFO: Scrape type for MC71487: 2
2026-03-28 14:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54839bfb-fc94-5473-a211-370b62d482e8 with identifier: MC71487
2026-03-28 14:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54839bfb-fc94-5473-a211-370b62d482e8 with scrape type 2
2026-03-28 14:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54839bfb-fc94-5473-a211-370b62d482e8 with scrape type 2
2026-03-28 14:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 54839bfb-fc94-5473-a211-370b62d482e8, identifier: MC71487
2026-03-28 14:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 54839bfb-fc94-5473-a211-370b62d482e8 with identifier: MC71487
2026-03-28 14:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 54839bfb-fc94-5473-a211-370b62d482e8 with identifier: MC71487
2026-03-28 14:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 54839bfb-fc94-5473-a211-370b62d482e8 with identifier: MC71487 to the API
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:00:43Z',
 'fuel_type': 'diesel',
 'id': '54839bfb-fc94-5473-a211-370b62d482e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC71487',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90 Cross Country',
 'odometer': 86663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seller_name': None,
 'title': 'Volvo V90 Cross Country 2.0 D4 AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2022}
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC71487%27 HTTP/1.1" 200 None
2026-03-28 14:11:59 [auto1.es] INFO: Saving data for MC71487: {'auction_closing_time': 1774713643.0, 'created_time': 1774470996.484113, 'last_price_update_time': 1774707119.845005}
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MC71487') HTTP/1.1" 204 0
2026-03-28 14:11:59 [auto1.es] INFO: Found listing with ID: LT61588
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LT61588%27 HTTP/1.1" 200 None
2026-03-28 14:11:59 [auto1.es] INFO: Scrape type for LT61588: 2
2026-03-28 14:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 944f0394-5b06-5165-a891-665258748c50 with identifier: LT61588
2026-03-28 14:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944f0394-5b06-5165-a891-665258748c50 with scrape type 2
2026-03-28 14:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 944f0394-5b06-5165-a891-665258748c50 with scrape type 2
2026-03-28 14:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 944f0394-5b06-5165-a891-665258748c50, identifier: LT61588
2026-03-28 14:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 944f0394-5b06-5165-a891-665258748c50 with identifier: LT61588
2026-03-28 14:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 944f0394-5b06-5165-a891-665258748c50 with identifier: LT61588
2026-03-28 14:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 944f0394-5b06-5165-a891-665258748c50 with identifier: LT61588 to the API
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:46:52Z',
 'fuel_type': 'diesel',
 'id': '944f0394-5b06-5165-a891-665258748c50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT61588',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 248706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-21',
 'seller_name': None,
 'title': 'Toyota Corolla 1.4 D-4D Terra Sedán',
 'transmission': 'automatic',
 'trim': 'Terra Sedán',
 'year': 2005}
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LT61588%27 HTTP/1.1" 200 None
2026-03-28 14:12:00 [auto1.es] INFO: Saving data for LT61588: {'auction_closing_time': 1774716412.0, 'created_time': 1774620600.756511, 'last_price_update_time': 1774707120.22823}
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LT61588') HTTP/1.1" 204 0
2026-03-28 14:12:00 [auto1.es] INFO: Found listing with ID: MP31569
2026-03-28 14:12:00 [auto1.es] INFO: Found listing with ID: UL23725
2026-03-28 14:12:00 [auto1.es] INFO: Found listing with ID: YC43770
2026-03-28 14:12:00 [auto1.es] INFO: Found listing with ID: FZ62617
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ62617%27 HTTP/1.1" 200 None
2026-03-28 14:12:00 [auto1.es] INFO: Scrape type for FZ62617: 2
2026-03-28 14:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 974f2a54-7659-591f-93f5-9c8a46cdc9bb with identifier: FZ62617
2026-03-28 14:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 974f2a54-7659-591f-93f5-9c8a46cdc9bb with scrape type 2
2026-03-28 14:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 974f2a54-7659-591f-93f5-9c8a46cdc9bb with scrape type 2
2026-03-28 14:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 974f2a54-7659-591f-93f5-9c8a46cdc9bb, identifier: FZ62617
2026-03-28 14:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 974f2a54-7659-591f-93f5-9c8a46cdc9bb with identifier: FZ62617
2026-03-28 14:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 974f2a54-7659-591f-93f5-9c8a46cdc9bb with identifier: FZ62617
2026-03-28 14:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 974f2a54-7659-591f-93f5-9c8a46cdc9bb with identifier: FZ62617 to the API
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:27Z',
 'fuel_type': 'petrol',
 'id': '974f2a54-7659-591f-93f5-9c8a46cdc9bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ62617',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 176579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-19',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2007}
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ62617%27 HTTP/1.1" 200 None
2026-03-28 14:12:00 [auto1.es] INFO: Saving data for FZ62617: {'auction_closing_time': 1774716807.0, 'created_time': 1773127842.106002, 'last_price_update_time': 1774707120.602587}
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FZ62617') HTTP/1.1" 204 0
2026-03-28 14:12:00 [auto1.es] INFO: Found listing with ID: UZ90227
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ90227%27 HTTP/1.1" 200 None
2026-03-28 14:12:00 [auto1.es] INFO: Scrape type for UZ90227: 2
2026-03-28 14:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0afd55b-f672-5564-99ff-33e8770dfc7a with identifier: UZ90227
2026-03-28 14:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0afd55b-f672-5564-99ff-33e8770dfc7a with scrape type 2
2026-03-28 14:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0afd55b-f672-5564-99ff-33e8770dfc7a with scrape type 2
2026-03-28 14:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f0afd55b-f672-5564-99ff-33e8770dfc7a, identifier: UZ90227
2026-03-28 14:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f0afd55b-f672-5564-99ff-33e8770dfc7a with identifier: UZ90227
2026-03-28 14:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f0afd55b-f672-5564-99ff-33e8770dfc7a with identifier: UZ90227
2026-03-28 14:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f0afd55b-f672-5564-99ff-33e8770dfc7a with identifier: UZ90227 to the API
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:37:40Z',
 'fuel_type': 'diesel',
 'id': 'f0afd55b-f672-5564-99ff-33e8770dfc7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ90227',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 186908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-27',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2022}
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ90227%27 HTTP/1.1" 200 None
2026-03-28 14:12:01 [auto1.es] INFO: Saving data for UZ90227: {'auction_closing_time': 1774715860.0, 'created_time': 1773691948.429039, 'last_price_update_time': 1774707121.082245}
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UZ90227') HTTP/1.1" 204 0
2026-03-28 14:12:01 [auto1.es] INFO: Found listing with ID: CT66486
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT66486%27 HTTP/1.1" 200 None
2026-03-28 14:12:01 [auto1.es] INFO: Scrape type for CT66486: 2
2026-03-28 14:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9a2f62c-3155-5526-adda-ed0895908f92 with identifier: CT66486
2026-03-28 14:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a2f62c-3155-5526-adda-ed0895908f92 with scrape type 2
2026-03-28 14:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9a2f62c-3155-5526-adda-ed0895908f92 with scrape type 2
2026-03-28 14:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d9a2f62c-3155-5526-adda-ed0895908f92, identifier: CT66486
2026-03-28 14:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d9a2f62c-3155-5526-adda-ed0895908f92 with identifier: CT66486
2026-03-28 14:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d9a2f62c-3155-5526-adda-ed0895908f92 with identifier: CT66486
2026-03-28 14:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d9a2f62c-3155-5526-adda-ed0895908f92 with identifier: CT66486 to the API
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:38:31Z',
 'fuel_type': 'diesel',
 'id': 'd9a2f62c-3155-5526-adda-ed0895908f92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT66486',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 254470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2021}
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT66486%27 HTTP/1.1" 200 None
2026-03-28 14:12:01 [auto1.es] INFO: Saving data for CT66486: {'auction_closing_time': 1774715911.0, 'created_time': 1773918790.88349, 'last_price_update_time': 1774707121.463713}
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CT66486') HTTP/1.1" 204 0
2026-03-28 14:12:01 [auto1.es] INFO: Found listing with ID: TN50205
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN50205%27 HTTP/1.1" 200 None
2026-03-28 14:12:01 [auto1.es] INFO: Scrape type for TN50205: 2
2026-03-28 14:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d90315d-cf71-577d-8ef3-e677c2be886d with identifier: TN50205
2026-03-28 14:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d90315d-cf71-577d-8ef3-e677c2be886d with scrape type 2
2026-03-28 14:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d90315d-cf71-577d-8ef3-e677c2be886d with scrape type 2
2026-03-28 14:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6d90315d-cf71-577d-8ef3-e677c2be886d, identifier: TN50205
2026-03-28 14:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6d90315d-cf71-577d-8ef3-e677c2be886d with identifier: TN50205
2026-03-28 14:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6d90315d-cf71-577d-8ef3-e677c2be886d with identifier: TN50205
2026-03-28 14:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6d90315d-cf71-577d-8ef3-e677c2be886d with identifier: TN50205 to the API
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:03:35Z',
 'fuel_type': 'diesel',
 'id': '6d90315d-cf71-577d-8ef3-e677c2be886d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN50205',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 145554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-27',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2022}
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN50205%27 HTTP/1.1" 200 None
2026-03-28 14:12:01 [auto1.es] INFO: Saving data for TN50205: {'auction_closing_time': 1774713815.0, 'created_time': 1773692080.518398, 'last_price_update_time': 1774707121.849123}
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TN50205') HTTP/1.1" 204 0
2026-03-28 14:12:01 [auto1.es] INFO: Found listing with ID: FJ32217
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ32217%27 HTTP/1.1" 200 None
2026-03-28 14:12:01 [auto1.es] INFO: Scrape type for FJ32217: 2
2026-03-28 14:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc05495-c3b9-5752-aa65-cd9783d87066 with identifier: FJ32217
2026-03-28 14:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc05495-c3b9-5752-aa65-cd9783d87066 with scrape type 2
2026-03-28 14:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dc05495-c3b9-5752-aa65-cd9783d87066 with scrape type 2
2026-03-28 14:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0dc05495-c3b9-5752-aa65-cd9783d87066, identifier: FJ32217
2026-03-28 14:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0dc05495-c3b9-5752-aa65-cd9783d87066 with identifier: FJ32217
2026-03-28 14:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0dc05495-c3b9-5752-aa65-cd9783d87066 with identifier: FJ32217
2026-03-28 14:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0dc05495-c3b9-5752-aa65-cd9783d87066 with identifier: FJ32217 to the API
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:48:17Z',
 'fuel_type': 'diesel',
 'id': '0dc05495-c3b9-5752-aa65-cd9783d87066',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ32217',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 73368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-20',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2013}
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ32217%27 HTTP/1.1" 200 None
2026-03-28 14:12:02 [auto1.es] INFO: Saving data for FJ32217: {'auction_closing_time': 1774716497.0, 'created_time': 1774004769.51818, 'last_price_update_time': 1774707122.23688}
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FJ32217') HTTP/1.1" 204 0
2026-03-28 14:12:02 [auto1.es] INFO: Found listing with ID: MU50158
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU50158%27 HTTP/1.1" 200 None
2026-03-28 14:12:02 [auto1.es] INFO: Scrape type for MU50158: 2
2026-03-28 14:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2897d578-3111-5e9e-84d2-2cfaaeaee206 with identifier: MU50158
2026-03-28 14:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2897d578-3111-5e9e-84d2-2cfaaeaee206 with scrape type 2
2026-03-28 14:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2897d578-3111-5e9e-84d2-2cfaaeaee206 with scrape type 2
2026-03-28 14:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2897d578-3111-5e9e-84d2-2cfaaeaee206, identifier: MU50158
2026-03-28 14:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2897d578-3111-5e9e-84d2-2cfaaeaee206 with identifier: MU50158
2026-03-28 14:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2897d578-3111-5e9e-84d2-2cfaaeaee206 with identifier: MU50158
2026-03-28 14:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2897d578-3111-5e9e-84d2-2cfaaeaee206 with identifier: MU50158 to the API
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:47:14Z',
 'fuel_type': 'diesel',
 'id': '2897d578-3111-5e9e-84d2-2cfaaeaee206',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU50158',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 214563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-06',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Equilibre',
 'transmission': 'manual',
 'trim': 'Equilibre',
 'year': 2022}
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU50158%27 HTTP/1.1" 200 None
2026-03-28 14:12:02 [auto1.es] INFO: Saving data for MU50158: {'auction_closing_time': 1774716434.0, 'created_time': 1774382775.446977, 'last_price_update_time': 1774707122.592777}
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MU50158') HTTP/1.1" 204 0
2026-03-28 14:12:02 [auto1.es] INFO: Found listing with ID: LV83724
2026-03-28 14:12:02 [auto1.es] INFO: Found listing with ID: KH40259
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH40259%27 HTTP/1.1" 200 None
2026-03-28 14:12:02 [auto1.es] INFO: Scrape type for KH40259: 2
2026-03-28 14:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6461afd6-f600-57b2-8cf2-a13770fa193d with identifier: KH40259
2026-03-28 14:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6461afd6-f600-57b2-8cf2-a13770fa193d with scrape type 2
2026-03-28 14:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6461afd6-f600-57b2-8cf2-a13770fa193d with scrape type 2
2026-03-28 14:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6461afd6-f600-57b2-8cf2-a13770fa193d, identifier: KH40259
2026-03-28 14:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6461afd6-f600-57b2-8cf2-a13770fa193d with identifier: KH40259
2026-03-28 14:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6461afd6-f600-57b2-8cf2-a13770fa193d with identifier: KH40259
2026-03-28 14:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6461afd6-f600-57b2-8cf2-a13770fa193d with identifier: KH40259 to the API
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-28T16:50:43Z',
 'fuel_type': 'hybrid',
 'id': '6461afd6-f600-57b2-8cf2-a13770fa193d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH40259',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'IONIQ',
 'odometer': 170313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-09',
 'seller_name': None,
 'title': 'Hyundai IONIQ 1.6 Hybrid Tecno',
 'transmission': 'automatic',
 'trim': 'Tecno',
 'year': 2022}
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH40259%27 HTTP/1.1" 200 None
2026-03-28 14:12:02 [auto1.es] INFO: Saving data for KH40259: {'auction_closing_time': 1774716643.0, 'created_time': 1773126892.544432, 'last_price_update_time': 1774707122.987713}
2026-03-28 14:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KH40259') HTTP/1.1" 204 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: EF00810
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF00810%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for EF00810: 2
2026-03-28 14:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03eb7cf0-ba17-5462-8f51-fba4060a7d94 with identifier: EF00810
2026-03-28 14:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03eb7cf0-ba17-5462-8f51-fba4060a7d94 with scrape type 2
2026-03-28 14:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03eb7cf0-ba17-5462-8f51-fba4060a7d94 with scrape type 2
2026-03-28 14:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 03eb7cf0-ba17-5462-8f51-fba4060a7d94, identifier: EF00810
2026-03-28 14:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 03eb7cf0-ba17-5462-8f51-fba4060a7d94 with identifier: EF00810
2026-03-28 14:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 03eb7cf0-ba17-5462-8f51-fba4060a7d94 with identifier: EF00810
2026-03-28 14:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 03eb7cf0-ba17-5462-8f51-fba4060a7d94 with identifier: EF00810 to the API
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:02:49Z',
 'fuel_type': 'petrol',
 'id': '03eb7cf0-ba17-5462-8f51-fba4060a7d94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF00810',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 156860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-09',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 T-GDI N Line',
 'transmission': 'manual',
 'trim': 'N Line',
 'year': 2023}
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF00810%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Saving data for EF00810: {'auction_closing_time': 1774713769.0, 'created_time': 1774383030.562801, 'last_price_update_time': 1774707123.365524}
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EF00810') HTTP/1.1" 204 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: CR96058
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: NH80896
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: JJ54433
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ54433%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for JJ54433: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: PX76519
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX76519%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for PX76519: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: TJ03460
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ03460%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for TJ03460: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: EE78385
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE78385%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for EE78385: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: RL54744
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL54744%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for RL54744: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: FL97062
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL97062%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for FL97062: 0
2026-03-28 14:12:03 [auto1.es] INFO: Channel: 24h | Page: 58 | totalHits: 2699 | hits on page: 40
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: PC36576
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: TG55276
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG55276%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for TG55276: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: VL76370
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL76370%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for VL76370: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: AN25119
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: HL96316
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL96316%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for HL96316: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: NA14080
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: KD32086
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: JE90684
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: KL07706
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: ZC57359
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: LJ23140
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ23140%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for LJ23140: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: CH50110
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH50110%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for CH50110: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: ET64130
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET64130%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for ET64130: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: WL07406
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: JL80339
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: UP46325
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP46325%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for UP46325: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: MM77073
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM77073%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for MM77073: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: DV58619
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV58619%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for DV58619: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: MH58773
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: KE17366
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE17366%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for KE17366: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: WM54096
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM54096%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for WM54096: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: YX68233
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX68233%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for YX68233: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: FW39837
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: ES82633
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: JW31558
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: XW86216
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: ZR14615
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: MG74318
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: EB56604
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB56604%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for EB56604: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: EZ75681
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ75681%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for EZ75681: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: YP54060
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: ZF52825
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: FD92977
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: UT04175
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: FJ63213
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: YM46867
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM46867%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for YM46867: 0
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: DM27699
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: FP35669
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: JE09459
2026-03-28 14:12:03 [auto1.es] INFO: Found listing with ID: XE32619
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE32619%27 HTTP/1.1" 200 None
2026-03-28 14:12:03 [auto1.es] INFO: Scrape type for XE32619: 0
2026-03-28 14:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:12:04 [auto1.es] INFO: Channel: 24h | Page: 59 | totalHits: 2699 | hits on page: 40
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: ZY33695
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: XC39222
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: DH28057
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH28057%27 HTTP/1.1" 200 None
2026-03-28 14:12:04 [auto1.es] INFO: Scrape type for DH28057: 0
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: LC81120
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: GD98283
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD98283%27 HTTP/1.1" 200 None
2026-03-28 14:12:04 [auto1.es] INFO: Scrape type for GD98283: 0
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: CB57175
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: PZ72634
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ72634%27 HTTP/1.1" 200 None
2026-03-28 14:12:04 [auto1.es] INFO: Scrape type for PZ72634: 0
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: MS49436
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS49436%27 HTTP/1.1" 200 None
2026-03-28 14:12:04 [auto1.es] INFO: Scrape type for MS49436: 0
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: RR62391
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: AJ84089
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: FB43319
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: XC46914
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC46914%27 HTTP/1.1" 200 None
2026-03-28 14:12:04 [auto1.es] INFO: Scrape type for XC46914: 0
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: RM79142
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: JY09497
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: TD25649
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD25649%27 HTTP/1.1" 200 None
2026-03-28 14:12:04 [auto1.es] INFO: Scrape type for TD25649: 0
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: AS51467
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS51467%27 HTTP/1.1" 200 None
2026-03-28 14:12:04 [auto1.es] INFO: Scrape type for AS51467: 0
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: NZ54247
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ54247%27 HTTP/1.1" 200 None
2026-03-28 14:12:04 [auto1.es] INFO: Scrape type for NZ54247: 0
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: WE21693
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: FR95558
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR95558%27 HTTP/1.1" 200 None
2026-03-28 14:12:04 [auto1.es] INFO: Scrape type for FR95558: 0
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: ZE41555
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE41555%27 HTTP/1.1" 200 None
2026-03-28 14:12:04 [auto1.es] INFO: Scrape type for ZE41555: 0
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: HM27570
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM27570%27 HTTP/1.1" 200 None
2026-03-28 14:12:04 [auto1.es] INFO: Scrape type for HM27570: 0
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: AL28647
2026-03-28 14:12:04 [auto1.es] INFO: Found listing with ID: PC53610
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC53610%27 HTTP/1.1" 200 None
2026-03-28 14:12:05 [auto1.es] INFO: Scrape type for PC53610: 0
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: KM47082
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: FJ09985
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: JZ86442
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ86442%27 HTTP/1.1" 200 None
2026-03-28 14:12:05 [auto1.es] INFO: Scrape type for JZ86442: 0
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: VB06067
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: SA98238
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA98238%27 HTTP/1.1" 200 None
2026-03-28 14:12:05 [auto1.es] INFO: Scrape type for SA98238: 0
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: LS65787
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS65787%27 HTTP/1.1" 200 None
2026-03-28 14:12:05 [auto1.es] INFO: Scrape type for LS65787: 0
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: DA25807
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA25807%27 HTTP/1.1" 200 None
2026-03-28 14:12:05 [auto1.es] INFO: Scrape type for DA25807: 0
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: MA79555
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: TE50739
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE50739%27 HTTP/1.1" 200 None
2026-03-28 14:12:05 [auto1.es] INFO: Scrape type for TE50739: 0
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: VL49161
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: RT14519
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT14519%27 HTTP/1.1" 200 None
2026-03-28 14:12:05 [auto1.es] INFO: Scrape type for RT14519: 0
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: WM24762
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM24762%27 HTTP/1.1" 200 None
2026-03-28 14:12:05 [auto1.es] INFO: Scrape type for WM24762: 0
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: JE26942
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE26942%27 HTTP/1.1" 200 None
2026-03-28 14:12:05 [auto1.es] INFO: Scrape type for JE26942: 0
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: XX85945
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX85945%27 HTTP/1.1" 200 None
2026-03-28 14:12:05 [auto1.es] INFO: Scrape type for XX85945: 0
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: BT54234
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: BE99512
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE99512%27 HTTP/1.1" 200 None
2026-03-28 14:12:05 [auto1.es] INFO: Scrape type for BE99512: 0
2026-03-28 14:12:05 [auto1.es] INFO: Found listing with ID: CN53275
2026-03-28 14:12:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:12:06 [auto1.es] INFO: Channel: 24h | Page: 60 | totalHits: 2699 | hits on page: 40
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: RN90591
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN90591%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for RN90591: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: TC61442
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC61442%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for TC61442: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: PT49535
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: AL30564
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL30564%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for AL30564: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: KE47103
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE47103%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for KE47103: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: SF05146
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: GX55521
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX55521%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for GX55521: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: EL12224
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL12224%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for EL12224: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: EE07728
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE07728%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for EE07728: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: LB97818
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB97818%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for LB97818: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: SU20973
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU20973%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for SU20973: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: RD73162
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: LE09183
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: DL40805
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: AW49477
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: TB74372
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: LU79245
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU79245%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for LU79245: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: RV28339
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV28339%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for RV28339: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: AE79363
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: BP19645
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: RB19136
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: HC67204
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: EL32039
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL32039%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for EL32039: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: YD48242
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD48242%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for YD48242: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: SB84191
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB84191%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for SB84191: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: XF10257
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: UA88301
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA88301%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for UA88301: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: TT54847
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT54847%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for TT54847: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: MF03574
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: CZ73203
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: AJ53679
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: ER99924
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: AJ63740
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: MG24035
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG24035%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for MG24035: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: AG87385
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: XW95149
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: SY91293
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: JC49855
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC49855%27 HTTP/1.1" 200 None
2026-03-28 14:12:06 [auto1.es] INFO: Scrape type for JC49855: 0
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: DM43927
2026-03-28 14:12:06 [auto1.es] INFO: Found listing with ID: ZH88989
2026-03-28 14:12:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:12:07 [auto1.es] INFO: Channel: 24h | Page: 61 | totalHits: 2699 | hits on page: 40
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: AV04114
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV04114%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for AV04114: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: NN13578
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: JB50336
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB50336%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for JB50336: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: XJ92197
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ92197%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for XJ92197: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: TV08054
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV08054%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for TV08054: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: MA21066
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA21066%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for MA21066: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: UK85840
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: HZ40578
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ40578%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for HZ40578: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: AH95116
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: ML07808
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: NE97244
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: UF15640
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF15640%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for UF15640: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: UV13351
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: JY25444
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: CU51757
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU51757%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for CU51757: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: EY86051
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY86051%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for EY86051: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: GP92404
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: NB97215
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB97215%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for NB97215: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: PK58195
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK58195%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for PK58195: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: SG84832
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: NK92990
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK92990%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for NK92990: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: UU25578
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: AB11281
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB11281%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for AB11281: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: PE24027
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: GN52396
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN52396%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for GN52396: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: ZA21810
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA21810%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for ZA21810: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: BJ36748
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ36748%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for BJ36748: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: AV93278
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV93278%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for AV93278: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: AW04396
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: MA61086
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA61086%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for MA61086: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: PS45222
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS45222%27 HTTP/1.1" 200 None
2026-03-28 14:12:07 [auto1.es] INFO: Scrape type for PS45222: 0
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: ZZ72823
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: CW88498
2026-03-28 14:12:07 [auto1.es] INFO: Found listing with ID: KR67716
2026-03-28 14:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR67716%27 HTTP/1.1" 200 None
2026-03-28 14:12:08 [auto1.es] INFO: Scrape type for KR67716: 0
2026-03-28 14:12:08 [auto1.es] INFO: Found listing with ID: NZ88130
2026-03-28 14:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ88130%27 HTTP/1.1" 200 None
2026-03-28 14:12:08 [auto1.es] INFO: Scrape type for NZ88130: 0
2026-03-28 14:12:08 [auto1.es] INFO: Found listing with ID: EA95786
2026-03-28 14:12:08 [auto1.es] INFO: Found listing with ID: GS59468
2026-03-28 14:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS59468%27 HTTP/1.1" 200 None
2026-03-28 14:12:08 [auto1.es] INFO: Scrape type for GS59468: 0
2026-03-28 14:12:08 [auto1.es] INFO: Found listing with ID: NL01395
2026-03-28 14:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL01395%27 HTTP/1.1" 200 None
2026-03-28 14:12:08 [auto1.es] INFO: Scrape type for NL01395: 0
2026-03-28 14:12:08 [auto1.es] INFO: Found listing with ID: FD66693
2026-03-28 14:12:08 [auto1.es] INFO: Found listing with ID: MZ54464
2026-03-28 14:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ54464%27 HTTP/1.1" 200 None
2026-03-28 14:12:08 [auto1.es] INFO: Scrape type for MZ54464: 0
2026-03-28 14:12:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:12:09 [auto1.es] INFO: Channel: 24h | Page: 62 | totalHits: 2699 | hits on page: 40
2026-03-28 14:12:09 [auto1.es] INFO: Found listing with ID: CB03666
2026-03-28 14:12:09 [auto1.es] INFO: Found listing with ID: WN15214
2026-03-28 14:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN15214%27 HTTP/1.1" 200 None
2026-03-28 14:12:09 [auto1.es] INFO: Scrape type for WN15214: 0
2026-03-28 14:12:09 [auto1.es] INFO: Found listing with ID: GP65825
2026-03-28 14:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP65825%27 HTTP/1.1" 200 None
2026-03-28 14:12:09 [auto1.es] INFO: Scrape type for GP65825: 0
2026-03-28 14:12:09 [auto1.es] INFO: Found listing with ID: KP85608
2026-03-28 14:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP85608%27 HTTP/1.1" 200 None
2026-03-28 14:12:09 [auto1.es] INFO: Scrape type for KP85608: 0
2026-03-28 14:12:09 [auto1.es] INFO: Found listing with ID: VU96042
2026-03-28 14:12:09 [auto1.es] INFO: Found listing with ID: TV36544
2026-03-28 14:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV36544%27 HTTP/1.1" 200 None
2026-03-28 14:12:09 [auto1.es] INFO: Scrape type for TV36544: 2
2026-03-28 14:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d49e7ffc-d43a-57d2-b028-267b55cf1fa1 with identifier: TV36544
2026-03-28 14:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d49e7ffc-d43a-57d2-b028-267b55cf1fa1 with scrape type 2
2026-03-28 14:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d49e7ffc-d43a-57d2-b028-267b55cf1fa1 with scrape type 2
2026-03-28 14:12:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d49e7ffc-d43a-57d2-b028-267b55cf1fa1, identifier: TV36544
2026-03-28 14:12:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d49e7ffc-d43a-57d2-b028-267b55cf1fa1 with identifier: TV36544
2026-03-28 14:12:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d49e7ffc-d43a-57d2-b028-267b55cf1fa1 with identifier: TV36544
2026-03-28 14:12:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d49e7ffc-d43a-57d2-b028-267b55cf1fa1 with identifier: TV36544 to the API
2026-03-28 14:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:15:02Z',
 'fuel_type': 'petrol',
 'id': 'd49e7ffc-d43a-57d2-b028-267b55cf1fa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV36544',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 212819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-19',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2007}
2026-03-28 14:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV36544%27 HTTP/1.1" 200 None
2026-03-28 14:12:10 [auto1.es] INFO: Saving data for TV36544: {'auction_closing_time': 1774714502.0, 'created_time': 1773832326.150963, 'last_price_update_time': 1774707130.956724}
2026-03-28 14:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TV36544') HTTP/1.1" 204 0
2026-03-28 14:12:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:12:11 [auto1.es] INFO: Found listing with ID: HF92394
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF92394%27 HTTP/1.1" 200 None
2026-03-28 14:12:11 [auto1.es] INFO: Scrape type for HF92394: 0
2026-03-28 14:12:11 [auto1.es] INFO: Found listing with ID: AS08117
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS08117%27 HTTP/1.1" 200 None
2026-03-28 14:12:11 [auto1.es] INFO: Scrape type for AS08117: 2
2026-03-28 14:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f87fc87d-ab93-58b0-adfc-b7abd97b6458 with identifier: AS08117
2026-03-28 14:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f87fc87d-ab93-58b0-adfc-b7abd97b6458 with scrape type 2
2026-03-28 14:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f87fc87d-ab93-58b0-adfc-b7abd97b6458 with scrape type 2
2026-03-28 14:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f87fc87d-ab93-58b0-adfc-b7abd97b6458, identifier: AS08117
2026-03-28 14:12:11 [scrapy.extensions.logstats] INFO: Crawled 200 pages (at 10 pages/min), scraped 327 items (at 76 items/min)
2026-03-28 14:12:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-28 14:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f87fc87d-ab93-58b0-adfc-b7abd97b6458 with identifier: AS08117
2026-03-28 14:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f87fc87d-ab93-58b0-adfc-b7abd97b6458 with identifier: AS08117
2026-03-28 14:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f87fc87d-ab93-58b0-adfc-b7abd97b6458 with identifier: AS08117 to the API
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:38:19Z',
 'fuel_type': 'diesel',
 'id': 'f87fc87d-ab93-58b0-adfc-b7abd97b6458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS08117',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Freemont',
 'odometer': 182781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-30',
 'seller_name': None,
 'title': 'Fiat Freemont 2.0 Multijet Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS08117%27 HTTP/1.1" 200 None
2026-03-28 14:12:11 [auto1.es] INFO: Saving data for AS08117: {'auction_closing_time': 1774715899.0, 'created_time': 1774253137.235503, 'last_price_update_time': 1774707131.440214}
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AS08117') HTTP/1.1" 204 0
2026-03-28 14:12:11 [auto1.es] INFO: Found listing with ID: HT85667
2026-03-28 14:12:11 [auto1.es] INFO: Found listing with ID: XN45249
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN45249%27 HTTP/1.1" 200 None
2026-03-28 14:12:11 [auto1.es] INFO: Scrape type for XN45249: 0
2026-03-28 14:12:11 [auto1.es] INFO: Found listing with ID: HB38669
2026-03-28 14:12:11 [auto1.es] INFO: Found listing with ID: HZ02297
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ02297%27 HTTP/1.1" 200 None
2026-03-28 14:12:11 [auto1.es] INFO: Scrape type for HZ02297: 2
2026-03-28 14:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8031dd40-c00b-5204-beab-3cc96714de65 with identifier: HZ02297
2026-03-28 14:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8031dd40-c00b-5204-beab-3cc96714de65 with scrape type 2
2026-03-28 14:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8031dd40-c00b-5204-beab-3cc96714de65 with scrape type 2
2026-03-28 14:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8031dd40-c00b-5204-beab-3cc96714de65, identifier: HZ02297
2026-03-28 14:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8031dd40-c00b-5204-beab-3cc96714de65 with identifier: HZ02297
2026-03-28 14:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8031dd40-c00b-5204-beab-3cc96714de65 with identifier: HZ02297
2026-03-28 14:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8031dd40-c00b-5204-beab-3cc96714de65 with identifier: HZ02297 to the API
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:47:22Z',
 'fuel_type': 'petrol',
 'id': '8031dd40-c00b-5204-beab-3cc96714de65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ02297',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 228052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-15',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ02297%27 HTTP/1.1" 200 None
2026-03-28 14:12:11 [auto1.es] INFO: Saving data for HZ02297: {'auction_closing_time': 1774716442.0, 'created_time': 1773128416.65775, 'last_price_update_time': 1774707131.8621}
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HZ02297') HTTP/1.1" 204 0
2026-03-28 14:12:11 [auto1.es] INFO: Found listing with ID: UG78525
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG78525%27 HTTP/1.1" 200 None
2026-03-28 14:12:11 [auto1.es] INFO: Scrape type for UG78525: 0
2026-03-28 14:12:11 [auto1.es] INFO: Found listing with ID: LK07555
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK07555%27 HTTP/1.1" 200 None
2026-03-28 14:12:11 [auto1.es] INFO: Scrape type for LK07555: 2
2026-03-28 14:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 908fddc4-dfb9-51a8-a6a2-6c798b017395 with identifier: LK07555
2026-03-28 14:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 908fddc4-dfb9-51a8-a6a2-6c798b017395 with scrape type 2
2026-03-28 14:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 908fddc4-dfb9-51a8-a6a2-6c798b017395 with scrape type 2
2026-03-28 14:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 908fddc4-dfb9-51a8-a6a2-6c798b017395, identifier: LK07555
2026-03-28 14:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 908fddc4-dfb9-51a8-a6a2-6c798b017395 with identifier: LK07555
2026-03-28 14:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 908fddc4-dfb9-51a8-a6a2-6c798b017395 with identifier: LK07555
2026-03-28 14:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 908fddc4-dfb9-51a8-a6a2-6c798b017395 with identifier: LK07555 to the API
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:40:03Z',
 'fuel_type': 'diesel',
 'id': '908fddc4-dfb9-51a8-a6a2-6c798b017395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK07555',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 114929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK07555%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Saving data for LK07555: {'auction_closing_time': 1774716003.0, 'created_time': 1773129163.900919, 'last_price_update_time': 1774707132.267839}
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LK07555') HTTP/1.1" 204 0
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: XX98366
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: DF08485
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: JC46060
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: VT11458
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: VG77720
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG77720%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Scrape type for VG77720: 0
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: DL11284
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: YV30906
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: DL05579
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL05579%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Scrape type for DL05579: 0
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: UK08613
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK08613%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Scrape type for UK08613: 0
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: AZ15880
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: EV24986
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV24986%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Scrape type for EV24986: 0
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: HA22815
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: RK55405
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK55405%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Scrape type for RK55405: 0
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: UG21171
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG21171%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Scrape type for UG21171: 2
2026-03-28 14:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c4d8a40-2921-501c-8135-0d5236b7589e with identifier: UG21171
2026-03-28 14:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c4d8a40-2921-501c-8135-0d5236b7589e with scrape type 2
2026-03-28 14:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c4d8a40-2921-501c-8135-0d5236b7589e with scrape type 2
2026-03-28 14:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7c4d8a40-2921-501c-8135-0d5236b7589e, identifier: UG21171
2026-03-28 14:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7c4d8a40-2921-501c-8135-0d5236b7589e with identifier: UG21171
2026-03-28 14:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7c4d8a40-2921-501c-8135-0d5236b7589e with identifier: UG21171
2026-03-28 14:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7c4d8a40-2921-501c-8135-0d5236b7589e with identifier: UG21171 to the API
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:59:54Z',
 'fuel_type': 'diesel',
 'id': '7c4d8a40-2921-501c-8135-0d5236b7589e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG21171',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 192641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-22',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2012}
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG21171%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Saving data for UG21171: {'auction_closing_time': 1774717194.0, 'created_time': 1773131659.223148, 'last_price_update_time': 1774707132.742584}
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UG21171') HTTP/1.1" 204 0
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: ME07403
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME07403%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Scrape type for ME07403: 0
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: MF36359
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF36359%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Scrape type for MF36359: 0
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: ES15520
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: HP01859
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP01859%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Scrape type for HP01859: 0
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: CP49442
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP49442%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Scrape type for CP49442: 0
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: TC70621
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: LG93188
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: MY48214
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: ZJ52163
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: VY31603
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY31603%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Scrape type for VY31603: 0
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: WC85393
2026-03-28 14:12:12 [auto1.es] INFO: Found listing with ID: TG12231
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG12231%27 HTTP/1.1" 200 None
2026-03-28 14:12:12 [auto1.es] INFO: Scrape type for TG12231: 0
2026-03-28 14:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:12:14 [auto1.es] INFO: Channel: 24h | Page: 63 | totalHits: 2699 | hits on page: 40
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: VK38327
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: ZJ67299
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ67299%27 HTTP/1.1" 200 None
2026-03-28 14:12:14 [auto1.es] INFO: Scrape type for ZJ67299: 0
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: TZ36663
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: WP66264
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: GR19122
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: EB62750
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: BZ21450
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ21450%27 HTTP/1.1" 200 None
2026-03-28 14:12:14 [auto1.es] INFO: Scrape type for BZ21450: 0
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: XY10294
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: LG59471
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: RV14480
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: ZC21665
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: FA71297
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: VL09919
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: HE42254
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE42254%27 HTTP/1.1" 200 None
2026-03-28 14:12:14 [auto1.es] INFO: Scrape type for HE42254: 0
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: RK09701
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK09701%27 HTTP/1.1" 200 None
2026-03-28 14:12:14 [auto1.es] INFO: Scrape type for RK09701: 0
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: TV36726
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV36726%27 HTTP/1.1" 200 None
2026-03-28 14:12:14 [auto1.es] INFO: Scrape type for TV36726: 0
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: GE62108
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE62108%27 HTTP/1.1" 200 None
2026-03-28 14:12:14 [auto1.es] INFO: Scrape type for GE62108: 0
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: ZH45296
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH45296%27 HTTP/1.1" 200 None
2026-03-28 14:12:14 [auto1.es] INFO: Scrape type for ZH45296: 0
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: WZ44927
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ44927%27 HTTP/1.1" 200 None
2026-03-28 14:12:14 [auto1.es] INFO: Scrape type for WZ44927: 0
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: LP80713
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: DM84841
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM84841%27 HTTP/1.1" 200 None
2026-03-28 14:12:14 [auto1.es] INFO: Scrape type for DM84841: 2
2026-03-28 14:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f34b8b2b-55fd-56a8-83b4-a0994aff6a66 with identifier: DM84841
2026-03-28 14:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f34b8b2b-55fd-56a8-83b4-a0994aff6a66 with scrape type 2
2026-03-28 14:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f34b8b2b-55fd-56a8-83b4-a0994aff6a66 with scrape type 2
2026-03-28 14:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f34b8b2b-55fd-56a8-83b4-a0994aff6a66, identifier: DM84841
2026-03-28 14:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f34b8b2b-55fd-56a8-83b4-a0994aff6a66 with identifier: DM84841
2026-03-28 14:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f34b8b2b-55fd-56a8-83b4-a0994aff6a66 with identifier: DM84841
2026-03-28 14:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f34b8b2b-55fd-56a8-83b4-a0994aff6a66 with identifier: DM84841 to the API
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:15Z',
 'fuel_type': 'diesel',
 'id': 'f34b8b2b-55fd-56a8-83b4-a0994aff6a66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM84841',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 155417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-23',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2013}
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM84841%27 HTTP/1.1" 200 None
2026-03-28 14:12:14 [auto1.es] INFO: Saving data for DM84841: {'auction_closing_time': 1774713615.0, 'created_time': 1774253128.648884, 'last_price_update_time': 1774707134.716731}
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DM84841') HTTP/1.1" 204 0
2026-03-28 14:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: MZ44217
2026-03-28 14:12:14 [auto1.es] INFO: Found listing with ID: DH50359
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH50359%27 HTTP/1.1" 200 None
2026-03-28 14:12:14 [auto1.es] INFO: Scrape type for DH50359: 2
2026-03-28 14:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8712a9b2-39d6-54a6-a1bf-273758521da6 with identifier: DH50359
2026-03-28 14:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8712a9b2-39d6-54a6-a1bf-273758521da6 with scrape type 2
2026-03-28 14:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8712a9b2-39d6-54a6-a1bf-273758521da6 with scrape type 2
2026-03-28 14:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8712a9b2-39d6-54a6-a1bf-273758521da6, identifier: DH50359
2026-03-28 14:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8712a9b2-39d6-54a6-a1bf-273758521da6 with identifier: DH50359
2026-03-28 14:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8712a9b2-39d6-54a6-a1bf-273758521da6 with identifier: DH50359
2026-03-28 14:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8712a9b2-39d6-54a6-a1bf-273758521da6 with identifier: DH50359 to the API
2026-03-28 14:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:53:31Z',
 'fuel_type': 'diesel',
 'id': '8712a9b2-39d6-54a6-a1bf-273758521da6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH50359',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 211140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-16',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 280 CDI Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2008}
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH50359%27 HTTP/1.1" 200 None
2026-03-28 14:12:16 [auto1.es] INFO: Saving data for DH50359: {'auction_closing_time': 1774716811.0, 'created_time': 1772626105.143105, 'last_price_update_time': 1774707136.058629}
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DH50359') HTTP/1.1" 204 0
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: NJ73279
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ73279%27 HTTP/1.1" 200 None
2026-03-28 14:12:16 [auto1.es] INFO: Scrape type for NJ73279: 0
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: GM08675
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM08675%27 HTTP/1.1" 200 None
2026-03-28 14:12:16 [auto1.es] INFO: Scrape type for GM08675: 0
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: ZW95177
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: XX72262
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: EH39769
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: LG94479
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG94479%27 HTTP/1.1" 200 None
2026-03-28 14:12:16 [auto1.es] INFO: Scrape type for LG94479: 0
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: VT96833
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: UR64839
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: TR96675
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: KP83247
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP83247%27 HTTP/1.1" 200 None
2026-03-28 14:12:16 [auto1.es] INFO: Scrape type for KP83247: 0
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: LC59267
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: DV40298
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: DD46195
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: VB81501
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: HN11800
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN11800%27 HTTP/1.1" 200 None
2026-03-28 14:12:16 [auto1.es] INFO: Scrape type for HN11800: 0
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: GH42664
2026-03-28 14:12:16 [auto1.es] INFO: Found listing with ID: UV08458
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV08458%27 HTTP/1.1" 200 None
2026-03-28 14:12:16 [auto1.es] INFO: Scrape type for UV08458: 0
2026-03-28 14:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:12:19 [auto1.es] INFO: Channel: 24h | Page: 64 | totalHits: 2699 | hits on page: 40
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: BB29813
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: DD02198
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: SM77284
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: XS23007
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: TH31010
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: PP39110
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP39110%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for PP39110: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: TT72287
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT72287%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for TT72287: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: KL48857
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: RY19109
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: MK23766
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK23766%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for MK23766: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: DR64033
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR64033%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for DR64033: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: TH38754
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: FU14405
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: PD86662
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD86662%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for PD86662: 2
2026-03-28 14:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5016c1cc-5284-580d-8ec0-8c0183eb2386 with identifier: PD86662
2026-03-28 14:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5016c1cc-5284-580d-8ec0-8c0183eb2386 with scrape type 2
2026-03-28 14:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5016c1cc-5284-580d-8ec0-8c0183eb2386 with scrape type 2
2026-03-28 14:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5016c1cc-5284-580d-8ec0-8c0183eb2386, identifier: PD86662
2026-03-28 14:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5016c1cc-5284-580d-8ec0-8c0183eb2386 with identifier: PD86662
2026-03-28 14:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5016c1cc-5284-580d-8ec0-8c0183eb2386 with identifier: PD86662
2026-03-28 14:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5016c1cc-5284-580d-8ec0-8c0183eb2386 with identifier: PD86662 to the API
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:17:54Z',
 'fuel_type': 'diesel',
 'id': '5016c1cc-5284-580d-8ec0-8c0183eb2386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD86662',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS4',
 'odometer': 203151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-04',
 'seller_name': None,
 'title': 'Citroen DS4 1.6 e-HDi Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2015}
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD86662%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Saving data for PD86662: {'auction_closing_time': 1774714674.0, 'created_time': 1772627967.831829, 'last_price_update_time': 1774707139.708919}
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PD86662') HTTP/1.1" 204 0
2026-03-28 14:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: XC40695
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: VE50785
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: NT66217
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT66217%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for NT66217: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: AP64153
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: PK37230
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: CW49447
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: BG55573
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG55573%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for BG55573: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: CT91769
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT91769%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for CT91769: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: UV80286
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV80286%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for UV80286: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: RP83421
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP83421%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for RP83421: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: YE20956
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE20956%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for YE20956: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: FT33215
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT33215%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for FT33215: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: CB32241
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB32241%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for CB32241: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: DX86055
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: KV41270
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: PD21728
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD21728%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for PD21728: 0
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: XK73032
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: TN29066
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: RS45242
2026-03-28 14:12:19 [auto1.es] INFO: Found listing with ID: RT04886
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT04886%27 HTTP/1.1" 200 None
2026-03-28 14:12:19 [auto1.es] INFO: Scrape type for RT04886: 2
2026-03-28 14:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb4fd07-0346-5c29-9e9a-fe2872374867 with identifier: RT04886
2026-03-28 14:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb4fd07-0346-5c29-9e9a-fe2872374867 with scrape type 2
2026-03-28 14:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acb4fd07-0346-5c29-9e9a-fe2872374867 with scrape type 2
2026-03-28 14:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: acb4fd07-0346-5c29-9e9a-fe2872374867, identifier: RT04886
2026-03-28 14:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: acb4fd07-0346-5c29-9e9a-fe2872374867 with identifier: RT04886
2026-03-28 14:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: acb4fd07-0346-5c29-9e9a-fe2872374867 with identifier: RT04886
2026-03-28 14:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: acb4fd07-0346-5c29-9e9a-fe2872374867 with identifier: RT04886 to the API
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:03:06Z',
 'fuel_type': 'petrol',
 'id': 'acb4fd07-0346-5c29-9e9a-fe2872374867',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT04886',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 98938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-05',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Fun',
 'transmission': 'manual',
 'trim': 'Fun',
 'year': 2003}
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT04886%27 HTTP/1.1" 200 None
2026-03-28 14:12:20 [auto1.es] INFO: Saving data for RT04886: {'auction_closing_time': 1774713786.0, 'created_time': 1773864772.478558, 'last_price_update_time': 1774707140.332094}
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RT04886') HTTP/1.1" 204 0
2026-03-28 14:12:20 [auto1.es] INFO: Found listing with ID: JC38983
2026-03-28 14:12:20 [auto1.es] INFO: Found listing with ID: KD08887
2026-03-28 14:12:20 [auto1.es] INFO: Found listing with ID: EK86006
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK86006%27 HTTP/1.1" 200 None
2026-03-28 14:12:20 [auto1.es] INFO: Scrape type for EK86006: 2
2026-03-28 14:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08e4cd5-415f-5d25-a78c-168bcf34d2b8 with identifier: EK86006
2026-03-28 14:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08e4cd5-415f-5d25-a78c-168bcf34d2b8 with scrape type 2
2026-03-28 14:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08e4cd5-415f-5d25-a78c-168bcf34d2b8 with scrape type 2
2026-03-28 14:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f08e4cd5-415f-5d25-a78c-168bcf34d2b8, identifier: EK86006
2026-03-28 14:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f08e4cd5-415f-5d25-a78c-168bcf34d2b8 with identifier: EK86006
2026-03-28 14:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f08e4cd5-415f-5d25-a78c-168bcf34d2b8 with identifier: EK86006
2026-03-28 14:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f08e4cd5-415f-5d25-a78c-168bcf34d2b8 with identifier: EK86006 to the API
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:51:08Z',
 'fuel_type': 'petrol',
 'id': 'f08e4cd5-415f-5d25-a78c-168bcf34d2b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK86006',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 123516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-27',
 'seller_name': None,
 'title': 'BMW 4er 420i Gran Coupé xDrive',
 'transmission': 'manual',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK86006%27 HTTP/1.1" 200 None
2026-03-28 14:12:20 [auto1.es] INFO: Saving data for EK86006: {'auction_closing_time': 1774716668.0, 'created_time': 1773843334.95345, 'last_price_update_time': 1774707140.834384}
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EK86006') HTTP/1.1" 204 0
2026-03-28 14:12:20 [auto1.es] INFO: Found listing with ID: XL12491
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL12491%27 HTTP/1.1" 200 None
2026-03-28 14:12:20 [auto1.es] INFO: Scrape type for XL12491: 0
2026-03-28 14:12:20 [auto1.es] INFO: Found listing with ID: VR29926
2026-03-28 14:12:20 [auto1.es] INFO: Found listing with ID: YC02097
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC02097%27 HTTP/1.1" 200 None
2026-03-28 14:12:20 [auto1.es] INFO: Scrape type for YC02097: 0
2026-03-28 14:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:12:21 [auto1.es] INFO: Channel: 24h | Page: 65 | totalHits: 2699 | hits on page: 40
2026-03-28 14:12:21 [auto1.es] INFO: Found listing with ID: FK65100
2026-03-28 14:12:21 [auto1.es] INFO: Found listing with ID: ZT16054
2026-03-28 14:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT16054%27 HTTP/1.1" 200 None
2026-03-28 14:12:21 [auto1.es] INFO: Scrape type for ZT16054: 0
2026-03-28 14:12:21 [auto1.es] INFO: Found listing with ID: VC62552
2026-03-28 14:12:21 [auto1.es] INFO: Found listing with ID: DD15597
2026-03-28 14:12:21 [auto1.es] INFO: Found listing with ID: LE34718
2026-03-28 14:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE34718%27 HTTP/1.1" 200 None
2026-03-28 14:12:21 [auto1.es] INFO: Scrape type for LE34718: 2
2026-03-28 14:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce580d8e-2776-56da-b765-2218b6b8c167 with identifier: LE34718
2026-03-28 14:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce580d8e-2776-56da-b765-2218b6b8c167 with scrape type 2
2026-03-28 14:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce580d8e-2776-56da-b765-2218b6b8c167 with scrape type 2
2026-03-28 14:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce580d8e-2776-56da-b765-2218b6b8c167, identifier: LE34718
2026-03-28 14:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce580d8e-2776-56da-b765-2218b6b8c167 with identifier: LE34718
2026-03-28 14:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce580d8e-2776-56da-b765-2218b6b8c167 with identifier: LE34718
2026-03-28 14:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce580d8e-2776-56da-b765-2218b6b8c167 with identifier: LE34718 to the API
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:10:50Z',
 'fuel_type': 'diesel',
 'id': 'ce580d8e-2776-56da-b765-2218b6b8c167',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE34718',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 270301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-17',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE34718%27 HTTP/1.1" 200 None
2026-03-28 14:12:22 [auto1.es] INFO: Saving data for LE34718: {'auction_closing_time': 1774714250.0, 'created_time': 1773129146.987957, 'last_price_update_time': 1774707142.338604}
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LE34718') HTTP/1.1" 204 0
2026-03-28 14:12:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:12:22 [auto1.es] INFO: Found listing with ID: FM31640
2026-03-28 14:12:22 [auto1.es] INFO: Found listing with ID: XS51461
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS51461%27 HTTP/1.1" 200 None
2026-03-28 14:12:22 [auto1.es] INFO: Scrape type for XS51461: 0
2026-03-28 14:12:22 [auto1.es] INFO: Found listing with ID: ZD85047
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD85047%27 HTTP/1.1" 200 None
2026-03-28 14:12:22 [auto1.es] INFO: Scrape type for ZD85047: 2
2026-03-28 14:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff34d06-1162-5f73-9110-c9ac11f20542 with identifier: ZD85047
2026-03-28 14:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff34d06-1162-5f73-9110-c9ac11f20542 with scrape type 2
2026-03-28 14:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ff34d06-1162-5f73-9110-c9ac11f20542 with scrape type 2
2026-03-28 14:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ff34d06-1162-5f73-9110-c9ac11f20542, identifier: ZD85047
2026-03-28 14:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ff34d06-1162-5f73-9110-c9ac11f20542 with identifier: ZD85047
2026-03-28 14:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ff34d06-1162-5f73-9110-c9ac11f20542 with identifier: ZD85047
2026-03-28 14:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ff34d06-1162-5f73-9110-c9ac11f20542 with identifier: ZD85047 to the API
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:54:09Z',
 'fuel_type': 'diesel',
 'id': '1ff34d06-1162-5f73-9110-c9ac11f20542',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD85047',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 114837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-08-25',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2004}
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD85047%27 HTTP/1.1" 200 None
2026-03-28 14:12:22 [auto1.es] INFO: Saving data for ZD85047: {'auction_closing_time': 1774716849.0, 'created_time': 1773843206.742895, 'last_price_update_time': 1774707142.847694}
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZD85047') HTTP/1.1" 204 0
2026-03-28 14:12:22 [auto1.es] INFO: Found listing with ID: MD04984
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD04984%27 HTTP/1.1" 200 None
2026-03-28 14:12:22 [auto1.es] INFO: Scrape type for MD04984: 2
2026-03-28 14:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c098b45c-f03b-58a1-82a4-d17ec4ab9519 with identifier: MD04984
2026-03-28 14:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c098b45c-f03b-58a1-82a4-d17ec4ab9519 with scrape type 2
2026-03-28 14:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c098b45c-f03b-58a1-82a4-d17ec4ab9519 with scrape type 2
2026-03-28 14:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c098b45c-f03b-58a1-82a4-d17ec4ab9519, identifier: MD04984
2026-03-28 14:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c098b45c-f03b-58a1-82a4-d17ec4ab9519 with identifier: MD04984
2026-03-28 14:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c098b45c-f03b-58a1-82a4-d17ec4ab9519 with identifier: MD04984
2026-03-28 14:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c098b45c-f03b-58a1-82a4-d17ec4ab9519 with identifier: MD04984 to the API
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:02:45Z',
 'fuel_type': 'diesel',
 'id': 'c098b45c-f03b-58a1-82a4-d17ec4ab9519',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD04984',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 240079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-19',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi Tekna 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna 4x4',
 'year': 2017}
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD04984%27 HTTP/1.1" 200 None
2026-03-28 14:12:23 [auto1.es] INFO: Saving data for MD04984: {'auction_closing_time': 1774713765.0, 'created_time': 1771481236.016058, 'last_price_update_time': 1774707143.239729}
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MD04984') HTTP/1.1" 204 0
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: WD34727
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: TT49974
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT49974%27 HTTP/1.1" 200 None
2026-03-28 14:12:23 [auto1.es] INFO: Scrape type for TT49974: 0
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: ZE13912
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: AM05329
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM05329%27 HTTP/1.1" 200 None
2026-03-28 14:12:23 [auto1.es] INFO: Scrape type for AM05329: 0
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: TH42321
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: JG85850
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG85850%27 HTTP/1.1" 200 None
2026-03-28 14:12:23 [auto1.es] INFO: Scrape type for JG85850: 0
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: MU04629
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU04629%27 HTTP/1.1" 200 None
2026-03-28 14:12:23 [auto1.es] INFO: Scrape type for MU04629: 0
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: MW15131
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW15131%27 HTTP/1.1" 200 None
2026-03-28 14:12:23 [auto1.es] INFO: Scrape type for MW15131: 2
2026-03-28 14:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dc5681f-2b26-59f5-b78d-522576b01f8a with identifier: MW15131
2026-03-28 14:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc5681f-2b26-59f5-b78d-522576b01f8a with scrape type 2
2026-03-28 14:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dc5681f-2b26-59f5-b78d-522576b01f8a with scrape type 2
2026-03-28 14:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4dc5681f-2b26-59f5-b78d-522576b01f8a, identifier: MW15131
2026-03-28 14:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4dc5681f-2b26-59f5-b78d-522576b01f8a with identifier: MW15131
2026-03-28 14:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4dc5681f-2b26-59f5-b78d-522576b01f8a with identifier: MW15131
2026-03-28 14:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4dc5681f-2b26-59f5-b78d-522576b01f8a with identifier: MW15131 to the API
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:20:26Z',
 'fuel_type': 'petrol',
 'id': '4dc5681f-2b26-59f5-b78d-522576b01f8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW15131',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 137106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-22',
 'seller_name': None,
 'title': 'Opel Insignia 1.4 Turbo Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2016}
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW15131%27 HTTP/1.1" 200 None
2026-03-28 14:12:23 [auto1.es] INFO: Saving data for MW15131: {'auction_closing_time': 1774714826.0, 'created_time': 1773756483.270895, 'last_price_update_time': 1774707143.716678}
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MW15131') HTTP/1.1" 204 0
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: UM71516
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: VT35195
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT35195%27 HTTP/1.1" 200 None
2026-03-28 14:12:23 [auto1.es] INFO: Scrape type for VT35195: 0
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: PD96380
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: UD80298
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD80298%27 HTTP/1.1" 200 None
2026-03-28 14:12:23 [auto1.es] INFO: Scrape type for UD80298: 0
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: PH10774
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH10774%27 HTTP/1.1" 200 None
2026-03-28 14:12:23 [auto1.es] INFO: Scrape type for PH10774: 0
2026-03-28 14:12:23 [auto1.es] INFO: Found listing with ID: AL10193
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL10193%27 HTTP/1.1" 200 None
2026-03-28 14:12:23 [auto1.es] INFO: Scrape type for AL10193: 2
2026-03-28 14:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4ddd022-e867-5899-a9de-97b7cfef4050 with identifier: AL10193
2026-03-28 14:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4ddd022-e867-5899-a9de-97b7cfef4050 with scrape type 2
2026-03-28 14:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4ddd022-e867-5899-a9de-97b7cfef4050 with scrape type 2
2026-03-28 14:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d4ddd022-e867-5899-a9de-97b7cfef4050, identifier: AL10193
2026-03-28 14:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d4ddd022-e867-5899-a9de-97b7cfef4050 with identifier: AL10193
2026-03-28 14:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d4ddd022-e867-5899-a9de-97b7cfef4050 with identifier: AL10193
2026-03-28 14:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d4ddd022-e867-5899-a9de-97b7cfef4050 with identifier: AL10193 to the API
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:38:39Z',
 'fuel_type': 'diesel',
 'id': 'd4ddd022-e867-5899-a9de-97b7cfef4050',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL10193',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 235918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-02',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL10193%27 HTTP/1.1" 200 None
2026-03-28 14:12:24 [auto1.es] INFO: Saving data for AL10193: {'auction_closing_time': 1774715919.0, 'created_time': 1773864362.131766, 'last_price_update_time': 1774707144.228699}
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AL10193') HTTP/1.1" 204 0
2026-03-28 14:12:24 [auto1.es] INFO: Found listing with ID: RR40846
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR40846%27 HTTP/1.1" 200 None
2026-03-28 14:12:24 [auto1.es] INFO: Scrape type for RR40846: 2
2026-03-28 14:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df88d1fd-c578-5c77-a69b-665c8fabb148 with identifier: RR40846
2026-03-28 14:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df88d1fd-c578-5c77-a69b-665c8fabb148 with scrape type 2
2026-03-28 14:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df88d1fd-c578-5c77-a69b-665c8fabb148 with scrape type 2
2026-03-28 14:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: df88d1fd-c578-5c77-a69b-665c8fabb148, identifier: RR40846
2026-03-28 14:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: df88d1fd-c578-5c77-a69b-665c8fabb148 with identifier: RR40846
2026-03-28 14:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: df88d1fd-c578-5c77-a69b-665c8fabb148 with identifier: RR40846
2026-03-28 14:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: df88d1fd-c578-5c77-a69b-665c8fabb148 with identifier: RR40846 to the API
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-28T16:59:55Z',
 'fuel_type': 'hybrid',
 'id': 'df88d1fd-c578-5c77-a69b-665c8fabb148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR40846',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 49793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-28',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2021}
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR40846%27 HTTP/1.1" 200 None
2026-03-28 14:12:24 [auto1.es] INFO: Saving data for RR40846: {'auction_closing_time': 1774717195.0, 'created_time': 1773128442.110542, 'last_price_update_time': 1774707144.649947}
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RR40846') HTTP/1.1" 204 0
2026-03-28 14:12:24 [auto1.es] INFO: Found listing with ID: LR89235
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR89235%27 HTTP/1.1" 200 None
2026-03-28 14:12:24 [auto1.es] INFO: Scrape type for LR89235: 0
2026-03-28 14:12:24 [auto1.es] INFO: Found listing with ID: DU61809
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU61809%27 HTTP/1.1" 200 None
2026-03-28 14:12:24 [auto1.es] INFO: Scrape type for DU61809: 0
2026-03-28 14:12:24 [auto1.es] INFO: Found listing with ID: PH11049
2026-03-28 14:12:24 [auto1.es] INFO: Found listing with ID: GX91950
2026-03-28 14:12:24 [auto1.es] INFO: Found listing with ID: YJ04642
2026-03-28 14:12:24 [auto1.es] INFO: Found listing with ID: XZ30156
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ30156%27 HTTP/1.1" 200 None
2026-03-28 14:12:24 [auto1.es] INFO: Scrape type for XZ30156: 2
2026-03-28 14:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c635464-3041-53ff-9c50-b268d2f40342 with identifier: XZ30156
2026-03-28 14:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c635464-3041-53ff-9c50-b268d2f40342 with scrape type 2
2026-03-28 14:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c635464-3041-53ff-9c50-b268d2f40342 with scrape type 2
2026-03-28 14:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6c635464-3041-53ff-9c50-b268d2f40342, identifier: XZ30156
2026-03-28 14:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6c635464-3041-53ff-9c50-b268d2f40342 with identifier: XZ30156
2026-03-28 14:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6c635464-3041-53ff-9c50-b268d2f40342 with identifier: XZ30156
2026-03-28 14:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6c635464-3041-53ff-9c50-b268d2f40342 with identifier: XZ30156 to the API
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:17:15Z',
 'fuel_type': 'diesel',
 'id': '6c635464-3041-53ff-9c50-b268d2f40342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ30156',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 112815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI AMG Sport',
 'transmission': 'automatic',
 'trim': 'AMG Sport',
 'year': 2017}
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ30156%27 HTTP/1.1" 200 None
2026-03-28 14:12:25 [auto1.es] INFO: Saving data for XZ30156: {'auction_closing_time': 1774714635.0, 'created_time': 1773126767.3296, 'last_price_update_time': 1774707145.098}
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ30156') HTTP/1.1" 204 0
2026-03-28 14:12:25 [auto1.es] INFO: Found listing with ID: XF66468
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF66468%27 HTTP/1.1" 200 None
2026-03-28 14:12:25 [auto1.es] INFO: Scrape type for XF66468: 0
2026-03-28 14:12:25 [auto1.es] INFO: Found listing with ID: FX14772
2026-03-28 14:12:25 [auto1.es] INFO: Found listing with ID: VN13138
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN13138%27 HTTP/1.1" 200 None
2026-03-28 14:12:25 [auto1.es] INFO: Scrape type for VN13138: 0
2026-03-28 14:12:25 [auto1.es] INFO: Found listing with ID: EN73965
2026-03-28 14:12:25 [auto1.es] INFO: Found listing with ID: YA86748
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA86748%27 HTTP/1.1" 200 None
2026-03-28 14:12:25 [auto1.es] INFO: Scrape type for YA86748: 0
2026-03-28 14:12:25 [auto1.es] INFO: Found listing with ID: ND59157
2026-03-28 14:12:25 [auto1.es] INFO: Found listing with ID: KZ49779
2026-03-28 14:12:25 [auto1.es] INFO: Found listing with ID: YT85498
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT85498%27 HTTP/1.1" 200 None
2026-03-28 14:12:25 [auto1.es] INFO: Scrape type for YT85498: 0
2026-03-28 14:12:25 [auto1.es] INFO: Found listing with ID: VZ06267
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ06267%27 HTTP/1.1" 200 None
2026-03-28 14:12:25 [auto1.es] INFO: Scrape type for VZ06267: 2
2026-03-28 14:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e058d52b-79ca-5b76-8c3b-2f3a81b94ee4 with identifier: VZ06267
2026-03-28 14:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e058d52b-79ca-5b76-8c3b-2f3a81b94ee4 with scrape type 2
2026-03-28 14:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e058d52b-79ca-5b76-8c3b-2f3a81b94ee4 with scrape type 2
2026-03-28 14:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e058d52b-79ca-5b76-8c3b-2f3a81b94ee4, identifier: VZ06267
2026-03-28 14:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e058d52b-79ca-5b76-8c3b-2f3a81b94ee4 with identifier: VZ06267
2026-03-28 14:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e058d52b-79ca-5b76-8c3b-2f3a81b94ee4 with identifier: VZ06267
2026-03-28 14:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e058d52b-79ca-5b76-8c3b-2f3a81b94ee4 with identifier: VZ06267 to the API
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:32:45Z',
 'fuel_type': 'petrol',
 'id': 'e058d52b-79ca-5b76-8c3b-2f3a81b94ee4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ06267',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 133613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': None,
 'title': 'Renault Scenic 1.3 TCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2019}
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ06267%27 HTTP/1.1" 200 None
2026-03-28 14:12:25 [auto1.es] INFO: Saving data for VZ06267: {'auction_closing_time': 1774715565.0, 'created_time': 1773130020.978586, 'last_price_update_time': 1774707145.650375}
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VZ06267') HTTP/1.1" 204 0
2026-03-28 14:12:25 [auto1.es] INFO: Found listing with ID: GC26553
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC26553%27 HTTP/1.1" 200 None
2026-03-28 14:12:25 [auto1.es] INFO: Scrape type for GC26553: 2
2026-03-28 14:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac06d88d-ff81-5805-b47a-2b54debde065 with identifier: GC26553
2026-03-28 14:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac06d88d-ff81-5805-b47a-2b54debde065 with scrape type 2
2026-03-28 14:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac06d88d-ff81-5805-b47a-2b54debde065 with scrape type 2
2026-03-28 14:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ac06d88d-ff81-5805-b47a-2b54debde065, identifier: GC26553
2026-03-28 14:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ac06d88d-ff81-5805-b47a-2b54debde065 with identifier: GC26553
2026-03-28 14:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ac06d88d-ff81-5805-b47a-2b54debde065 with identifier: GC26553
2026-03-28 14:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ac06d88d-ff81-5805-b47a-2b54debde065 with identifier: GC26553 to the API
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:09:40Z',
 'fuel_type': 'diesel',
 'id': 'ac06d88d-ff81-5805-b47a-2b54debde065',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC26553',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 260696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-14',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC26553%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Saving data for GC26553: {'auction_closing_time': 1774714180.0, 'created_time': 1773130073.482592, 'last_price_update_time': 1774707146.041533}
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GC26553') HTTP/1.1" 204 0
2026-03-28 14:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:12:26 [auto1.es] INFO: Channel: 24h | Page: 66 | totalHits: 2699 | hits on page: 40
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: YU03196
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU03196%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Scrape type for YU03196: 0
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: PA92548
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA92548%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Scrape type for PA92548: 0
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: JJ75829
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ75829%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Scrape type for JJ75829: 2
2026-03-28 14:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc with identifier: JJ75829
2026-03-28 14:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc with scrape type 2
2026-03-28 14:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc with scrape type 2
2026-03-28 14:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc, identifier: JJ75829
2026-03-28 14:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc with identifier: JJ75829
2026-03-28 14:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc with identifier: JJ75829
2026-03-28 14:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7039613d-ecd3-578a-b8fa-2fdbd4c56ebc with identifier: JJ75829 to the API
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:40:43Z',
 'fuel_type': 'diesel',
 'id': '7039613d-ecd3-578a-b8fa-2fdbd4c56ebc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ75829',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 405740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-14',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 350 CDI L BlueTEC Grand Edition',
 'transmission': 'automatic',
 'trim': 'L BlueTEC Grand Edition',
 'year': 2012}
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JJ75829%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Saving data for JJ75829: {'auction_closing_time': 1774716043.0, 'created_time': 1773843065.922233, 'last_price_update_time': 1774707146.745447}
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JJ75829') HTTP/1.1" 204 0
2026-03-28 14:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: SV29323
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: TB73704
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: VD81677
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: EJ16249
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ16249%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Scrape type for EJ16249: 0
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: UH45112
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH45112%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Scrape type for UH45112: 0
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: DZ42678
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ42678%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Scrape type for DZ42678: 0
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: VR45740
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: FK61059
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK61059%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Scrape type for FK61059: 0
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: VC98401
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC98401%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Scrape type for VC98401: 0
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: PS29729
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS29729%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Scrape type for PS29729: 0
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: WZ34012
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: ZP51440
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP51440%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Scrape type for ZP51440: 0
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: ZS20717
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: NY16020
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY16020%27 HTTP/1.1" 200 None
2026-03-28 14:12:26 [auto1.es] INFO: Scrape type for NY16020: 0
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: GT44883
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: XV33818
2026-03-28 14:12:26 [auto1.es] INFO: Found listing with ID: KX99272
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX99272%27 HTTP/1.1" 200 None
2026-03-28 14:12:27 [auto1.es] INFO: Scrape type for KX99272: 2
2026-03-28 14:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 with identifier: KX99272
2026-03-28 14:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 with scrape type 2
2026-03-28 14:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 with scrape type 2
2026-03-28 14:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6, identifier: KX99272
2026-03-28 14:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 with identifier: KX99272
2026-03-28 14:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 with identifier: KX99272
2026-03-28 14:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 05eccaec-cab8-5dc2-b5ba-0271bd55bdc6 with identifier: KX99272 to the API
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:30:12Z',
 'fuel_type': 'diesel',
 'id': '05eccaec-cab8-5dc2-b5ba-0271bd55bdc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX99272',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 108271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2020}
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX99272%27 HTTP/1.1" 200 None
2026-03-28 14:12:27 [auto1.es] INFO: Saving data for KX99272: {'auction_closing_time': 1774715412.0, 'created_time': 1772625354.364144, 'last_price_update_time': 1774707147.396274}
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KX99272') HTTP/1.1" 204 0
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: AD67761
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: ZE85496
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE85496%27 HTTP/1.1" 200 None
2026-03-28 14:12:27 [auto1.es] INFO: Scrape type for ZE85496: 0
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: RT81282
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT81282%27 HTTP/1.1" 200 None
2026-03-28 14:12:27 [auto1.es] INFO: Scrape type for RT81282: 0
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: XC28006
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: JP11260
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP11260%27 HTTP/1.1" 200 None
2026-03-28 14:12:27 [auto1.es] INFO: Scrape type for JP11260: 0
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: MW05620
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW05620%27 HTTP/1.1" 200 None
2026-03-28 14:12:27 [auto1.es] INFO: Scrape type for MW05620: 0
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: GY32674
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: TV15408
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: HV86151
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: UZ86093
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ86093%27 HTTP/1.1" 200 None
2026-03-28 14:12:27 [auto1.es] INFO: Scrape type for UZ86093: 0
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: ZM69944
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM69944%27 HTTP/1.1" 200 None
2026-03-28 14:12:27 [auto1.es] INFO: Scrape type for ZM69944: 0
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: RT56400
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: MZ66022
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: WN54679
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: VP18393
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: DB92602
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: WX13119
2026-03-28 14:12:27 [auto1.es] INFO: Found listing with ID: UD21856
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD21856%27 HTTP/1.1" 200 None
2026-03-28 14:12:27 [auto1.es] INFO: Scrape type for UD21856: 2
2026-03-28 14:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32f58b76-ec84-5eeb-b44e-6dc2ff6449e5 with identifier: UD21856
2026-03-28 14:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f58b76-ec84-5eeb-b44e-6dc2ff6449e5 with scrape type 2
2026-03-28 14:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32f58b76-ec84-5eeb-b44e-6dc2ff6449e5 with scrape type 2
2026-03-28 14:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 32f58b76-ec84-5eeb-b44e-6dc2ff6449e5, identifier: UD21856
2026-03-28 14:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 32f58b76-ec84-5eeb-b44e-6dc2ff6449e5 with identifier: UD21856
2026-03-28 14:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 32f58b76-ec84-5eeb-b44e-6dc2ff6449e5 with identifier: UD21856
2026-03-28 14:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 32f58b76-ec84-5eeb-b44e-6dc2ff6449e5 with identifier: UD21856 to the API
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:29Z',
 'fuel_type': 'diesel',
 'id': '32f58b76-ec84-5eeb-b44e-6dc2ff6449e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD21856',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 86761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-01',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2023}
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD21856%27 HTTP/1.1" 200 None
2026-03-28 14:12:27 [auto1.es] INFO: Saving data for UD21856: {'auction_closing_time': 1774715969.0, 'created_time': 1773132849.676894, 'last_price_update_time': 1774707147.981559}
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UD21856') HTTP/1.1" 204 0
2026-03-28 14:12:28 [auto1.es] INFO: Found listing with ID: FZ04394
2026-03-28 14:12:28 [auto1.es] INFO: Found listing with ID: XK60422
2026-03-28 14:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:12:29 [auto1.es] INFO: Channel: 24h | Page: 67 | totalHits: 2699 | hits on page: 40
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: UF95473
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF95473%27 HTTP/1.1" 200 None
2026-03-28 14:12:29 [auto1.es] INFO: Scrape type for UF95473: 0
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: ZW56409
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: BR13060
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: FK50437
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: RD21311
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD21311%27 HTTP/1.1" 200 None
2026-03-28 14:12:29 [auto1.es] INFO: Scrape type for RD21311: 0
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: XJ78592
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: FU29422
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU29422%27 HTTP/1.1" 200 None
2026-03-28 14:12:29 [auto1.es] INFO: Scrape type for FU29422: 0
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: NG83144
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: KH84544
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH84544%27 HTTP/1.1" 200 None
2026-03-28 14:12:29 [auto1.es] INFO: Scrape type for KH84544: 0
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: LM59241
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM59241%27 HTTP/1.1" 200 None
2026-03-28 14:12:29 [auto1.es] INFO: Scrape type for LM59241: 0
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: TF39547
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: UT93063
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: WA94101
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA94101%27 HTTP/1.1" 200 None
2026-03-28 14:12:29 [auto1.es] INFO: Scrape type for WA94101: 2
2026-03-28 14:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bab51fd5-ddca-5e46-8cde-d5607766bebd with identifier: WA94101
2026-03-28 14:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bab51fd5-ddca-5e46-8cde-d5607766bebd with scrape type 2
2026-03-28 14:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bab51fd5-ddca-5e46-8cde-d5607766bebd with scrape type 2
2026-03-28 14:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bab51fd5-ddca-5e46-8cde-d5607766bebd, identifier: WA94101
2026-03-28 14:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bab51fd5-ddca-5e46-8cde-d5607766bebd with identifier: WA94101
2026-03-28 14:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bab51fd5-ddca-5e46-8cde-d5607766bebd with identifier: WA94101
2026-03-28 14:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bab51fd5-ddca-5e46-8cde-d5607766bebd with identifier: WA94101 to the API
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:31:38Z',
 'fuel_type': 'petrol',
 'id': 'bab51fd5-ddca-5e46-8cde-d5607766bebd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA94101',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 320914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-19',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 2.0 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2009}
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA94101%27 HTTP/1.1" 200 None
2026-03-28 14:12:29 [auto1.es] INFO: Saving data for WA94101: {'auction_closing_time': 1774715498.0, 'created_time': 1773133345.539527, 'last_price_update_time': 1774707149.557154}
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WA94101') HTTP/1.1" 204 0
2026-03-28 14:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: VJ59554
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ59554%27 HTTP/1.1" 200 None
2026-03-28 14:12:29 [auto1.es] INFO: Scrape type for VJ59554: 0
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: MJ93698
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: RA85318
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA85318%27 HTTP/1.1" 200 None
2026-03-28 14:12:29 [auto1.es] INFO: Scrape type for RA85318: 0
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: RC37181
2026-03-28 14:12:29 [auto1.es] INFO: Found listing with ID: KV37790
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV37790%27 HTTP/1.1" 200 None
2026-03-28 14:12:29 [auto1.es] INFO: Scrape type for KV37790: 2
2026-03-28 14:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f74eb90-3d53-5185-9431-c7217234fdeb with identifier: KV37790
2026-03-28 14:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f74eb90-3d53-5185-9431-c7217234fdeb with scrape type 2
2026-03-28 14:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f74eb90-3d53-5185-9431-c7217234fdeb with scrape type 2
2026-03-28 14:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8f74eb90-3d53-5185-9431-c7217234fdeb, identifier: KV37790
2026-03-28 14:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8f74eb90-3d53-5185-9431-c7217234fdeb with identifier: KV37790
2026-03-28 14:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8f74eb90-3d53-5185-9431-c7217234fdeb with identifier: KV37790
2026-03-28 14:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8f74eb90-3d53-5185-9431-c7217234fdeb with identifier: KV37790 to the API
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:34:55Z',
 'fuel_type': 'diesel',
 'id': '8f74eb90-3d53-5185-9431-c7217234fdeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV37790',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 199530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-01',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2011}
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV37790%27 HTTP/1.1" 200 None
2026-03-28 14:12:30 [auto1.es] INFO: Saving data for KV37790: {'auction_closing_time': 1774715695.0, 'created_time': 1774350426.916044, 'last_price_update_time': 1774707150.07982}
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KV37790') HTTP/1.1" 204 0
2026-03-28 14:12:30 [auto1.es] INFO: Found listing with ID: AP29688
2026-03-28 14:12:30 [auto1.es] INFO: Found listing with ID: RL18296
2026-03-28 14:12:30 [auto1.es] INFO: Found listing with ID: TK95363
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TK95363%27 HTTP/1.1" 200 None
2026-03-28 14:12:30 [auto1.es] INFO: Scrape type for TK95363: 0
2026-03-28 14:12:30 [auto1.es] INFO: Found listing with ID: BE90053
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE90053%27 HTTP/1.1" 200 None
2026-03-28 14:12:30 [auto1.es] INFO: Scrape type for BE90053: 2
2026-03-28 14:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c9375c2-8e26-5984-a996-fd1a1de0d513 with identifier: BE90053
2026-03-28 14:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c9375c2-8e26-5984-a996-fd1a1de0d513 with scrape type 2
2026-03-28 14:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c9375c2-8e26-5984-a996-fd1a1de0d513 with scrape type 2
2026-03-28 14:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c9375c2-8e26-5984-a996-fd1a1de0d513, identifier: BE90053
2026-03-28 14:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c9375c2-8e26-5984-a996-fd1a1de0d513 with identifier: BE90053
2026-03-28 14:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c9375c2-8e26-5984-a996-fd1a1de0d513 with identifier: BE90053
2026-03-28 14:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3c9375c2-8e26-5984-a996-fd1a1de0d513 with identifier: BE90053 to the API
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:42:33Z',
 'fuel_type': 'diesel',
 'id': '3c9375c2-8e26-5984-a996-fd1a1de0d513',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE90053',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 253748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-27',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style Edition',
 'transmission': 'manual',
 'trim': 'Style Edition',
 'year': 2020}
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE90053%27 HTTP/1.1" 200 None
2026-03-28 14:12:30 [auto1.es] INFO: Saving data for BE90053: {'auction_closing_time': 1774716153.0, 'created_time': 1774296640.823154, 'last_price_update_time': 1774707150.513285}
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BE90053') HTTP/1.1" 204 0
2026-03-28 14:12:30 [auto1.es] INFO: Found listing with ID: VY28267
2026-03-28 14:12:30 [auto1.es] INFO: Found listing with ID: HV58793
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV58793%27 HTTP/1.1" 200 None
2026-03-28 14:12:30 [auto1.es] INFO: Scrape type for HV58793: 2
2026-03-28 14:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33de7598-ca18-59f7-a249-5998f428d24a with identifier: HV58793
2026-03-28 14:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33de7598-ca18-59f7-a249-5998f428d24a with scrape type 2
2026-03-28 14:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33de7598-ca18-59f7-a249-5998f428d24a with scrape type 2
2026-03-28 14:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 33de7598-ca18-59f7-a249-5998f428d24a, identifier: HV58793
2026-03-28 14:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 33de7598-ca18-59f7-a249-5998f428d24a with identifier: HV58793
2026-03-28 14:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 33de7598-ca18-59f7-a249-5998f428d24a with identifier: HV58793
2026-03-28 14:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 33de7598-ca18-59f7-a249-5998f428d24a with identifier: HV58793 to the API
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:50:49Z',
 'fuel_type': 'petrol',
 'id': '33de7598-ca18-59f7-a249-5998f428d24a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV58793',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 102330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI R BlueMotion 4Motion',
 'transmission': 'automatic',
 'trim': 'R BlueMotion 4Motion',
 'year': 2019}
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV58793%27 HTTP/1.1" 200 None
2026-03-28 14:12:30 [auto1.es] INFO: Saving data for HV58793: {'auction_closing_time': 1774716649.0, 'created_time': 1774296650.089251, 'last_price_update_time': 1774707150.931157}
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HV58793') HTTP/1.1" 204 0
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: AU82484
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: CL32416
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: YF90515
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF90515%27 HTTP/1.1" 200 None
2026-03-28 14:12:31 [auto1.es] INFO: Scrape type for YF90515: 0
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: TL16652
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: ET37328
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET37328%27 HTTP/1.1" 200 None
2026-03-28 14:12:31 [auto1.es] INFO: Scrape type for ET37328: 0
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: VB46301
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB46301%27 HTTP/1.1" 200 None
2026-03-28 14:12:31 [auto1.es] INFO: Scrape type for VB46301: 0
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: SU85789
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU85789%27 HTTP/1.1" 200 None
2026-03-28 14:12:31 [auto1.es] INFO: Scrape type for SU85789: 0
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: JW67554
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: CY04008
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY04008%27 HTTP/1.1" 200 None
2026-03-28 14:12:31 [auto1.es] INFO: Scrape type for CY04008: 0
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: NV45891
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV45891%27 HTTP/1.1" 200 None
2026-03-28 14:12:31 [auto1.es] INFO: Scrape type for NV45891: 0
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: NS96167
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS96167%27 HTTP/1.1" 200 None
2026-03-28 14:12:31 [auto1.es] INFO: Scrape type for NS96167: 0
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: XV58633
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV58633%27 HTTP/1.1" 200 None
2026-03-28 14:12:31 [auto1.es] INFO: Scrape type for XV58633: 0
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: UV89988
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV89988%27 HTTP/1.1" 200 None
2026-03-28 14:12:31 [auto1.es] INFO: Scrape type for UV89988: 0
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: SB36142
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB36142%27 HTTP/1.1" 200 None
2026-03-28 14:12:31 [auto1.es] INFO: Scrape type for SB36142: 0
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: UU20141
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU20141%27 HTTP/1.1" 200 None
2026-03-28 14:12:31 [auto1.es] INFO: Scrape type for UU20141: 0
2026-03-28 14:12:31 [auto1.es] INFO: Found listing with ID: DH00541
2026-03-28 14:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:12:32 [auto1.es] INFO: Channel: 24h | Page: 68 | totalHits: 2699 | hits on page: 19
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: ND20390
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: CA13811
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA13811%27 HTTP/1.1" 200 None
2026-03-28 14:12:32 [auto1.es] INFO: Scrape type for CA13811: 0
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: VM06943
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM06943%27 HTTP/1.1" 200 None
2026-03-28 14:12:32 [auto1.es] INFO: Scrape type for VM06943: 0
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: GF91510
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: GE94512
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE94512%27 HTTP/1.1" 200 None
2026-03-28 14:12:32 [auto1.es] INFO: Scrape type for GE94512: 0
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: NM44751
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM44751%27 HTTP/1.1" 200 None
2026-03-28 14:12:32 [auto1.es] INFO: Scrape type for NM44751: 0
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: HD74513
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD74513%27 HTTP/1.1" 200 None
2026-03-28 14:12:32 [auto1.es] INFO: Scrape type for HD74513: 0
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: GT92698
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT92698%27 HTTP/1.1" 200 None
2026-03-28 14:12:32 [auto1.es] INFO: Scrape type for GT92698: 0
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: VN26021
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: WH54771
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH54771%27 HTTP/1.1" 200 None
2026-03-28 14:12:32 [auto1.es] INFO: Scrape type for WH54771: 0
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: NL75511
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL75511%27 HTTP/1.1" 200 None
2026-03-28 14:12:32 [auto1.es] INFO: Scrape type for NL75511: 0
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: LX82632
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: WW97634
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW97634%27 HTTP/1.1" 200 None
2026-03-28 14:12:32 [auto1.es] INFO: Scrape type for WW97634: 0
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: JM72010
2026-03-28 14:12:32 [auto1.es] INFO: Found listing with ID: SD86160
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD86160%27 HTTP/1.1" 200 None
2026-03-28 14:12:32 [auto1.es] INFO: Scrape type for SD86160: 2
2026-03-28 14:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edbe7aa5-858d-5a38-b293-929c54660bed with identifier: SD86160
2026-03-28 14:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edbe7aa5-858d-5a38-b293-929c54660bed with scrape type 2
2026-03-28 14:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edbe7aa5-858d-5a38-b293-929c54660bed with scrape type 2
2026-03-28 14:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: edbe7aa5-858d-5a38-b293-929c54660bed, identifier: SD86160
2026-03-28 14:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: edbe7aa5-858d-5a38-b293-929c54660bed with identifier: SD86160
2026-03-28 14:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: edbe7aa5-858d-5a38-b293-929c54660bed with identifier: SD86160
2026-03-28 14:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: edbe7aa5-858d-5a38-b293-929c54660bed with identifier: SD86160 to the API
2026-03-28 14:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 14:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 14:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:54:26Z',
 'fuel_type': 'diesel',
 'id': 'edbe7aa5-858d-5a38-b293-929c54660bed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD86160',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 152260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-28 14:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD86160%27 HTTP/1.1" 200 None
2026-03-28 14:12:33 [auto1.es] INFO: Saving data for SD86160: {'auction_closing_time': 1774716866.0, 'created_time': 1773126989.346635, 'last_price_update_time': 1774707153.364874}
2026-03-28 14:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SD86160') HTTP/1.1" 204 0
2026-03-28 14:12:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 14:12:33 [auto1.es] INFO: Found listing with ID: HF43561
2026-03-28 14:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF43561%27 HTTP/1.1" 200 None
2026-03-28 14:12:33 [auto1.es] INFO: Scrape type for HF43561: 0
2026-03-28 14:12:33 [auto1.es] INFO: Found listing with ID: PP85710
2026-03-28 14:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 14:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP85710%27 HTTP/1.1" 200 None
2026-03-28 14:12:33 [auto1.es] INFO: Scrape type for PP85710: 0
2026-03-28 14:12:33 [auto1.es] INFO: Found listing with ID: PL21143
2026-03-28 14:12:33 [auto1.es] INFO: Found listing with ID: ZL14108
2026-03-28 14:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 14:12:34 [auto1.es] INFO: Channel: 24h | Page: 69 | totalHits: 2699 | hits on page: 0
2026-03-28 14:12:34 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 14:12:34 [auto1.es] INFO: auto1.es Batch config: batch 2/2
2026-03-28 14:12:34 [auto1.es] INFO: auto1.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 2, <ScrapeType.BATCH_SKIPPED: 5>: 2}
2026-03-28 14:12:34 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (353 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.es/task_22_2026-03-28T14_05_00.jl
2026-03-28 14:12:34 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 78,
 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 78,
 'downloader/request_bytes': 1112754,
 'downloader/request_count': 635,
 'downloader/request_method_count/GET': 564,
 'downloader/request_method_count/POST': 71,
 'downloader/response_bytes': 44307619,
 'downloader/response_count': 557,
 'downloader/response_status_count/200': 557,
 'dupefilter/filtered': 12,
 'elapsed_time_seconds': 444.316861,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 14, 12, 34, 555715, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 353,
 'log_count/DEBUG': 8694,
 'log_count/INFO': 9808,
 'memusage/max': 178233344,
 'memusage/startup': 150159360,
 'photo_download_count': 350,
 'request_depth_max': 72,
 'response_received_count': 207,
 'scheduler/dequeued': 635,
 'scheduler/dequeued/memory': 635,
 'scheduler/enqueued': 635,
 'scheduler/enqueued/memory': 635,
 'scrape_type/batch_skipped': 1343,
 'scrape_type/new': 67,
 'scrape_type/price_update': 286,
 'scrape_type/skipped': 1031,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 207,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.3539077978680174,
 'scrapy-zyte-api/mean_response_seconds': 3.402839713772659,
 'scrapy-zyte-api/processed': 207,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 207,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 206,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 207,
 'scrapy-zyte-api/request_args/httpRequestBody': 71,
 'scrapy-zyte-api/request_args/httpRequestMethod': 71,
 'scrapy-zyte-api/request_args/httpResponseBody': 207,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 207,
 'scrapy-zyte-api/request_args/sessionContext': 207,
 'scrapy-zyte-api/request_args/url': 207,
 'scrapy-zyte-api/status_codes/200': 207,
 'scrapy-zyte-api/success': 207,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 2739,
 'source/total_available': 2699,
 'start_time': datetime.datetime(2026, 3, 28, 14, 5, 10, 238854, tzinfo=datetime.timezone.utc)}
2026-03-28 14:12:34 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 14:12:34 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f64413b9f90>
2026-03-28 14:12:34 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f64413ba390>